00:00:00.000 Started by upstream project "autotest-nightly-lts" build number 2388 00:00:00.000 originally caused by: 00:00:00.000 Started by upstream project "nightly-trigger" build number 3649 00:00:00.000 originally caused by: 00:00:00.000 Started by timer 00:00:00.071 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.071 The recommended git tool is: git 00:00:00.072 using credential 00000000-0000-0000-0000-000000000002 00:00:00.073 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.151 Fetching changes from the remote Git repository 00:00:00.154 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.230 Using shallow fetch with depth 1 00:00:00.230 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.230 > git --version # timeout=10 00:00:00.296 > git --version # 'git version 2.39.2' 00:00:00.296 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.334 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.334 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.639 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.653 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.669 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.669 > git config core.sparsecheckout # timeout=10 00:00:05.684 > git read-tree -mu HEAD # timeout=10 00:00:05.700 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.722 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.723 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.840 [Pipeline] Start of Pipeline 00:00:05.855 [Pipeline] library 00:00:05.856 Loading library shm_lib@master 00:00:05.857 Library shm_lib@master is cached. Copying from home. 00:00:05.950 [Pipeline] node 00:00:05.970 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.972 [Pipeline] { 00:00:05.982 [Pipeline] catchError 00:00:05.984 [Pipeline] { 00:00:05.994 [Pipeline] wrap 00:00:06.000 [Pipeline] { 00:00:06.010 [Pipeline] stage 00:00:06.012 [Pipeline] { (Prologue) 00:00:06.256 [Pipeline] sh 00:00:06.548 + logger -p user.info -t JENKINS-CI 00:00:06.569 [Pipeline] echo 00:00:06.571 Node: GP11 00:00:06.580 [Pipeline] sh 00:00:06.884 [Pipeline] setCustomBuildProperty 00:00:06.894 [Pipeline] echo 00:00:06.895 Cleanup processes 00:00:06.899 [Pipeline] sh 00:00:07.181 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.181 3323827 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.195 [Pipeline] sh 00:00:07.483 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.483 ++ grep -v 'sudo pgrep' 00:00:07.483 ++ awk '{print $1}' 00:00:07.483 + sudo kill -9 00:00:07.483 + true 00:00:07.500 [Pipeline] cleanWs 00:00:07.512 [WS-CLEANUP] Deleting project workspace... 00:00:07.512 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.519 [WS-CLEANUP] done 00:00:07.523 [Pipeline] setCustomBuildProperty 00:00:07.536 [Pipeline] sh 00:00:07.838 + sudo git config --global --replace-all safe.directory '*' 00:00:07.917 [Pipeline] httpRequest 00:00:08.236 [Pipeline] echo 00:00:08.237 Sorcerer 10.211.164.20 is alive 00:00:08.246 [Pipeline] retry 00:00:08.248 [Pipeline] { 00:00:08.261 [Pipeline] httpRequest 00:00:08.265 HttpMethod: GET 00:00:08.266 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.266 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.269 Response Code: HTTP/1.1 200 OK 00:00:08.269 Success: Status code 200 is in the accepted range: 200,404 00:00:08.269 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.415 [Pipeline] } 00:00:08.435 [Pipeline] // retry 00:00:08.441 [Pipeline] sh 00:00:08.724 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.741 [Pipeline] httpRequest 00:00:09.403 [Pipeline] echo 00:00:09.405 Sorcerer 10.211.164.20 is alive 00:00:09.415 [Pipeline] retry 00:00:09.417 [Pipeline] { 00:00:09.433 [Pipeline] httpRequest 00:00:09.438 HttpMethod: GET 00:00:09.438 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:09.438 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:09.441 Response Code: HTTP/1.1 200 OK 00:00:09.441 Success: Status code 200 is in the accepted range: 200,404 00:00:09.441 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:32.131 [Pipeline] } 00:00:32.149 [Pipeline] // retry 00:00:32.158 [Pipeline] sh 00:00:32.441 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:34.989 [Pipeline] sh 00:00:35.273 + git -C spdk log --oneline -n5 00:00:35.273 c13c99a5e test: Various fixes for Fedora40 00:00:35.273 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:35.273 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:35.273 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:35.273 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:35.285 [Pipeline] } 00:00:35.299 [Pipeline] // stage 00:00:35.308 [Pipeline] stage 00:00:35.311 [Pipeline] { (Prepare) 00:00:35.328 [Pipeline] writeFile 00:00:35.344 [Pipeline] sh 00:00:35.629 + logger -p user.info -t JENKINS-CI 00:00:35.642 [Pipeline] sh 00:00:35.926 + logger -p user.info -t JENKINS-CI 00:00:35.939 [Pipeline] sh 00:00:36.223 + cat autorun-spdk.conf 00:00:36.223 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:36.223 SPDK_TEST_NVMF=1 00:00:36.223 SPDK_TEST_NVME_CLI=1 00:00:36.223 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:36.223 SPDK_TEST_NVMF_NICS=e810 00:00:36.223 SPDK_RUN_UBSAN=1 00:00:36.223 NET_TYPE=phy 00:00:36.231 RUN_NIGHTLY=1 00:00:36.236 [Pipeline] readFile 00:00:36.272 [Pipeline] withEnv 00:00:36.288 [Pipeline] { 00:00:36.324 [Pipeline] sh 00:00:36.604 + set -ex 00:00:36.604 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:36.604 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:36.604 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:36.604 ++ SPDK_TEST_NVMF=1 00:00:36.604 ++ SPDK_TEST_NVME_CLI=1 00:00:36.604 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:36.604 ++ SPDK_TEST_NVMF_NICS=e810 00:00:36.604 ++ SPDK_RUN_UBSAN=1 00:00:36.604 ++ NET_TYPE=phy 00:00:36.604 ++ RUN_NIGHTLY=1 00:00:36.604 + case $SPDK_TEST_NVMF_NICS in 00:00:36.604 + DRIVERS=ice 00:00:36.604 + [[ tcp == \r\d\m\a ]] 00:00:36.604 + [[ -n ice ]] 00:00:36.604 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:36.604 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:36.604 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:36.604 rmmod: ERROR: Module irdma is not currently loaded 00:00:36.604 rmmod: ERROR: Module i40iw is not currently loaded 00:00:36.604 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:36.604 + true 00:00:36.604 + for D in $DRIVERS 00:00:36.604 + sudo modprobe ice 00:00:36.604 + exit 0 00:00:36.613 [Pipeline] } 00:00:36.629 [Pipeline] // withEnv 00:00:36.634 [Pipeline] } 00:00:36.648 [Pipeline] // stage 00:00:36.659 [Pipeline] catchError 00:00:36.660 [Pipeline] { 00:00:36.676 [Pipeline] timeout 00:00:36.677 Timeout set to expire in 1 hr 0 min 00:00:36.679 [Pipeline] { 00:00:36.694 [Pipeline] stage 00:00:36.697 [Pipeline] { (Tests) 00:00:36.712 [Pipeline] sh 00:00:36.998 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:36.998 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:36.998 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:36.998 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:36.998 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:36.998 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:36.998 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:36.998 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:36.998 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:36.998 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:36.998 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:36.998 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:36.998 + source /etc/os-release 00:00:36.998 ++ NAME='Fedora Linux' 00:00:36.998 ++ VERSION='39 (Cloud Edition)' 00:00:36.998 ++ ID=fedora 00:00:36.998 ++ VERSION_ID=39 00:00:36.998 ++ VERSION_CODENAME= 00:00:36.998 ++ PLATFORM_ID=platform:f39 00:00:36.998 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:00:36.998 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:36.998 ++ LOGO=fedora-logo-icon 00:00:36.998 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:00:36.998 ++ HOME_URL=https://fedoraproject.org/ 00:00:36.998 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:00:36.998 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:36.998 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:36.998 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:36.998 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:00:36.998 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:36.998 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:00:36.998 ++ SUPPORT_END=2024-11-12 00:00:36.998 ++ VARIANT='Cloud Edition' 00:00:36.998 ++ VARIANT_ID=cloud 00:00:36.998 + uname -a 00:00:36.998 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:00:36.998 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:37.938 Hugepages 00:00:37.938 node hugesize free / total 00:00:37.938 node0 1048576kB 0 / 0 00:00:37.938 node0 2048kB 0 / 0 00:00:37.938 node1 1048576kB 0 / 0 00:00:37.938 node1 2048kB 0 / 0 00:00:37.938 00:00:37.938 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:37.938 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:00:37.938 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:00:37.938 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:00:37.938 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:00:37.938 + rm -f /tmp/spdk-ld-path 00:00:37.938 + source autorun-spdk.conf 00:00:37.938 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:37.938 ++ SPDK_TEST_NVMF=1 00:00:37.938 ++ SPDK_TEST_NVME_CLI=1 00:00:37.938 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:37.938 ++ SPDK_TEST_NVMF_NICS=e810 00:00:37.938 ++ SPDK_RUN_UBSAN=1 00:00:37.938 ++ NET_TYPE=phy 00:00:37.938 ++ RUN_NIGHTLY=1 00:00:37.938 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:37.938 + [[ -n '' ]] 00:00:37.938 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:37.938 + for M in /var/spdk/build-*-manifest.txt 00:00:37.938 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:00:37.938 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:37.938 + for M in /var/spdk/build-*-manifest.txt 00:00:37.938 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:37.938 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:37.938 + for M in /var/spdk/build-*-manifest.txt 00:00:37.938 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:37.938 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:37.938 ++ uname 00:00:37.938 + [[ Linux == \L\i\n\u\x ]] 00:00:37.938 + sudo dmesg -T 00:00:37.938 + sudo dmesg --clear 00:00:37.938 + dmesg_pid=3324492 00:00:37.938 + [[ Fedora Linux == FreeBSD ]] 00:00:37.938 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:37.938 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:37.938 + sudo dmesg -Tw 00:00:37.938 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:37.938 + [[ -x /usr/src/fio-static/fio ]] 00:00:37.938 + export FIO_BIN=/usr/src/fio-static/fio 00:00:37.938 + FIO_BIN=/usr/src/fio-static/fio 00:00:37.938 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:37.938 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:37.938 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:37.938 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:37.938 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:37.938 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:37.938 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:37.938 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:37.938 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:37.938 Test configuration: 00:00:37.938 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:37.938 SPDK_TEST_NVMF=1 00:00:37.938 SPDK_TEST_NVME_CLI=1 00:00:37.938 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:37.938 SPDK_TEST_NVMF_NICS=e810 00:00:37.938 SPDK_RUN_UBSAN=1 00:00:37.938 NET_TYPE=phy 00:00:37.938 RUN_NIGHTLY=1 12:28:11 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:00:37.938 12:28:11 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:37.938 12:28:11 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:37.938 12:28:11 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:37.938 12:28:11 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:37.938 12:28:11 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:37.938 12:28:11 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:37.938 12:28:11 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:37.938 12:28:11 -- paths/export.sh@5 -- $ export PATH 00:00:37.938 12:28:11 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:38.197 12:28:11 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:38.197 12:28:11 -- common/autobuild_common.sh@440 -- $ date +%s 00:00:38.197 12:28:11 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732102091.XXXXXX 00:00:38.197 12:28:11 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732102091.wLFkV6 00:00:38.197 12:28:11 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:00:38.197 12:28:11 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:00:38.197 12:28:11 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:38.197 12:28:11 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:38.197 12:28:11 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:38.197 12:28:11 -- common/autobuild_common.sh@456 -- $ get_config_params 00:00:38.197 12:28:11 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:00:38.197 12:28:11 -- common/autotest_common.sh@10 -- $ set +x 00:00:38.197 12:28:11 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:38.197 12:28:11 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:38.197 12:28:11 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:38.197 12:28:11 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:38.197 12:28:11 -- spdk/autobuild.sh@16 -- $ date -u 00:00:38.197 Wed Nov 20 11:28:11 AM UTC 2024 00:00:38.197 12:28:11 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:38.197 LTS-67-gc13c99a5e 00:00:38.197 12:28:11 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:38.198 12:28:11 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:38.198 12:28:11 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:38.198 12:28:11 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:38.198 12:28:11 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:38.198 12:28:11 -- common/autotest_common.sh@10 -- $ set +x 00:00:38.198 ************************************ 00:00:38.198 START TEST ubsan 00:00:38.198 ************************************ 00:00:38.198 12:28:11 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:00:38.198 using ubsan 00:00:38.198 00:00:38.198 real 0m0.000s 00:00:38.198 user 0m0.000s 00:00:38.198 sys 0m0.000s 00:00:38.198 12:28:11 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:00:38.198 12:28:11 -- common/autotest_common.sh@10 -- $ set +x 00:00:38.198 ************************************ 00:00:38.198 END TEST ubsan 00:00:38.198 ************************************ 00:00:38.198 12:28:11 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:38.198 12:28:11 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:38.198 12:28:11 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:38.198 12:28:11 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:38.198 12:28:11 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:38.198 12:28:11 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:38.198 12:28:11 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:38.198 12:28:11 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:38.198 12:28:11 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:38.198 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:38.198 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:38.456 Using 'verbs' RDMA provider 00:00:49.044 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:00:59.030 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:00:59.030 Creating mk/config.mk...done. 00:00:59.030 Creating mk/cc.flags.mk...done. 00:00:59.030 Type 'make' to build. 00:00:59.030 12:28:31 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:00:59.030 12:28:31 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:59.030 12:28:31 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:59.030 12:28:31 -- common/autotest_common.sh@10 -- $ set +x 00:00:59.030 ************************************ 00:00:59.030 START TEST make 00:00:59.030 ************************************ 00:00:59.030 12:28:31 -- common/autotest_common.sh@1114 -- $ make -j48 00:00:59.030 make[1]: Nothing to be done for 'all'. 00:01:07.170 The Meson build system 00:01:07.170 Version: 1.5.0 00:01:07.170 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:07.170 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:07.170 Build type: native build 00:01:07.170 Program cat found: YES (/usr/bin/cat) 00:01:07.170 Project name: DPDK 00:01:07.170 Project version: 23.11.0 00:01:07.170 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:07.170 C linker for the host machine: cc ld.bfd 2.40-14 00:01:07.170 Host machine cpu family: x86_64 00:01:07.170 Host machine cpu: x86_64 00:01:07.170 Message: ## Building in Developer Mode ## 00:01:07.170 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:07.170 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:07.170 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:07.170 Program python3 found: YES (/usr/bin/python3) 00:01:07.170 Program cat found: YES (/usr/bin/cat) 00:01:07.170 Compiler for C supports arguments -march=native: YES 00:01:07.170 Checking for size of "void *" : 8 00:01:07.170 Checking for size of "void *" : 8 (cached) 00:01:07.170 Library m found: YES 00:01:07.170 Library numa found: YES 00:01:07.170 Has header "numaif.h" : YES 00:01:07.170 Library fdt found: NO 00:01:07.170 Library execinfo found: NO 00:01:07.170 Has header "execinfo.h" : YES 00:01:07.170 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:07.170 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:07.170 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:07.170 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:07.170 Run-time dependency openssl found: YES 3.1.1 00:01:07.170 Run-time dependency libpcap found: YES 1.10.4 00:01:07.170 Has header "pcap.h" with dependency libpcap: YES 00:01:07.170 Compiler for C supports arguments -Wcast-qual: YES 00:01:07.170 Compiler for C supports arguments -Wdeprecated: YES 00:01:07.170 Compiler for C supports arguments -Wformat: YES 00:01:07.170 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:07.170 Compiler for C supports arguments -Wformat-security: NO 00:01:07.170 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:07.170 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:07.170 Compiler for C supports arguments -Wnested-externs: YES 00:01:07.170 Compiler for C supports arguments -Wold-style-definition: YES 00:01:07.170 Compiler for C supports arguments -Wpointer-arith: YES 00:01:07.170 Compiler for C supports arguments -Wsign-compare: YES 00:01:07.170 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:07.170 Compiler for C supports arguments -Wundef: YES 00:01:07.170 Compiler for C supports arguments -Wwrite-strings: YES 00:01:07.170 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:07.170 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:07.170 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:07.170 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:07.170 Program objdump found: YES (/usr/bin/objdump) 00:01:07.170 Compiler for C supports arguments -mavx512f: YES 00:01:07.170 Checking if "AVX512 checking" compiles: YES 00:01:07.170 Fetching value of define "__SSE4_2__" : 1 00:01:07.170 Fetching value of define "__AES__" : 1 00:01:07.170 Fetching value of define "__AVX__" : 1 00:01:07.170 Fetching value of define "__AVX2__" : (undefined) 00:01:07.170 Fetching value of define "__AVX512BW__" : (undefined) 00:01:07.170 Fetching value of define "__AVX512CD__" : (undefined) 00:01:07.170 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:07.170 Fetching value of define "__AVX512F__" : (undefined) 00:01:07.170 Fetching value of define "__AVX512VL__" : (undefined) 00:01:07.170 Fetching value of define "__PCLMUL__" : 1 00:01:07.170 Fetching value of define "__RDRND__" : 1 00:01:07.170 Fetching value of define "__RDSEED__" : (undefined) 00:01:07.170 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:07.170 Fetching value of define "__znver1__" : (undefined) 00:01:07.170 Fetching value of define "__znver2__" : (undefined) 00:01:07.170 Fetching value of define "__znver3__" : (undefined) 00:01:07.170 Fetching value of define "__znver4__" : (undefined) 00:01:07.170 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:07.170 Message: lib/log: Defining dependency "log" 00:01:07.170 Message: lib/kvargs: Defining dependency "kvargs" 00:01:07.170 Message: lib/telemetry: Defining dependency "telemetry" 00:01:07.170 Checking for function "getentropy" : NO 00:01:07.170 Message: lib/eal: Defining dependency "eal" 00:01:07.170 Message: lib/ring: Defining dependency "ring" 00:01:07.170 Message: lib/rcu: Defining dependency "rcu" 00:01:07.170 Message: lib/mempool: Defining dependency "mempool" 00:01:07.170 Message: lib/mbuf: Defining dependency "mbuf" 00:01:07.170 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:07.170 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:07.170 Compiler for C supports arguments -mpclmul: YES 00:01:07.170 Compiler for C supports arguments -maes: YES 00:01:07.170 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:07.170 Compiler for C supports arguments -mavx512bw: YES 00:01:07.170 Compiler for C supports arguments -mavx512dq: YES 00:01:07.170 Compiler for C supports arguments -mavx512vl: YES 00:01:07.170 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:07.170 Compiler for C supports arguments -mavx2: YES 00:01:07.170 Compiler for C supports arguments -mavx: YES 00:01:07.170 Message: lib/net: Defining dependency "net" 00:01:07.170 Message: lib/meter: Defining dependency "meter" 00:01:07.170 Message: lib/ethdev: Defining dependency "ethdev" 00:01:07.170 Message: lib/pci: Defining dependency "pci" 00:01:07.170 Message: lib/cmdline: Defining dependency "cmdline" 00:01:07.170 Message: lib/hash: Defining dependency "hash" 00:01:07.170 Message: lib/timer: Defining dependency "timer" 00:01:07.170 Message: lib/compressdev: Defining dependency "compressdev" 00:01:07.170 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:07.170 Message: lib/dmadev: Defining dependency "dmadev" 00:01:07.170 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:07.170 Message: lib/power: Defining dependency "power" 00:01:07.170 Message: lib/reorder: Defining dependency "reorder" 00:01:07.170 Message: lib/security: Defining dependency "security" 00:01:07.170 Has header "linux/userfaultfd.h" : YES 00:01:07.170 Has header "linux/vduse.h" : YES 00:01:07.170 Message: lib/vhost: Defining dependency "vhost" 00:01:07.170 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:07.170 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:07.170 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:07.170 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:07.170 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:07.170 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:07.171 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:07.171 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:07.171 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:07.171 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:07.171 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:07.171 Configuring doxy-api-html.conf using configuration 00:01:07.171 Configuring doxy-api-man.conf using configuration 00:01:07.171 Program mandb found: YES (/usr/bin/mandb) 00:01:07.171 Program sphinx-build found: NO 00:01:07.171 Configuring rte_build_config.h using configuration 00:01:07.171 Message: 00:01:07.171 ================= 00:01:07.171 Applications Enabled 00:01:07.171 ================= 00:01:07.171 00:01:07.171 apps: 00:01:07.171 00:01:07.171 00:01:07.171 Message: 00:01:07.171 ================= 00:01:07.171 Libraries Enabled 00:01:07.171 ================= 00:01:07.171 00:01:07.171 libs: 00:01:07.171 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:07.171 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:07.171 cryptodev, dmadev, power, reorder, security, vhost, 00:01:07.171 00:01:07.171 Message: 00:01:07.171 =============== 00:01:07.171 Drivers Enabled 00:01:07.171 =============== 00:01:07.171 00:01:07.171 common: 00:01:07.171 00:01:07.171 bus: 00:01:07.171 pci, vdev, 00:01:07.171 mempool: 00:01:07.171 ring, 00:01:07.171 dma: 00:01:07.171 00:01:07.171 net: 00:01:07.171 00:01:07.171 crypto: 00:01:07.171 00:01:07.171 compress: 00:01:07.171 00:01:07.171 vdpa: 00:01:07.171 00:01:07.171 00:01:07.171 Message: 00:01:07.171 ================= 00:01:07.171 Content Skipped 00:01:07.171 ================= 00:01:07.171 00:01:07.171 apps: 00:01:07.171 dumpcap: explicitly disabled via build config 00:01:07.171 graph: explicitly disabled via build config 00:01:07.171 pdump: explicitly disabled via build config 00:01:07.171 proc-info: explicitly disabled via build config 00:01:07.171 test-acl: explicitly disabled via build config 00:01:07.171 test-bbdev: explicitly disabled via build config 00:01:07.171 test-cmdline: explicitly disabled via build config 00:01:07.171 test-compress-perf: explicitly disabled via build config 00:01:07.171 test-crypto-perf: explicitly disabled via build config 00:01:07.171 test-dma-perf: explicitly disabled via build config 00:01:07.171 test-eventdev: explicitly disabled via build config 00:01:07.171 test-fib: explicitly disabled via build config 00:01:07.171 test-flow-perf: explicitly disabled via build config 00:01:07.171 test-gpudev: explicitly disabled via build config 00:01:07.171 test-mldev: explicitly disabled via build config 00:01:07.171 test-pipeline: explicitly disabled via build config 00:01:07.171 test-pmd: explicitly disabled via build config 00:01:07.171 test-regex: explicitly disabled via build config 00:01:07.171 test-sad: explicitly disabled via build config 00:01:07.171 test-security-perf: explicitly disabled via build config 00:01:07.171 00:01:07.171 libs: 00:01:07.171 metrics: explicitly disabled via build config 00:01:07.171 acl: explicitly disabled via build config 00:01:07.171 bbdev: explicitly disabled via build config 00:01:07.171 bitratestats: explicitly disabled via build config 00:01:07.171 bpf: explicitly disabled via build config 00:01:07.171 cfgfile: explicitly disabled via build config 00:01:07.171 distributor: explicitly disabled via build config 00:01:07.171 efd: explicitly disabled via build config 00:01:07.171 eventdev: explicitly disabled via build config 00:01:07.171 dispatcher: explicitly disabled via build config 00:01:07.171 gpudev: explicitly disabled via build config 00:01:07.171 gro: explicitly disabled via build config 00:01:07.171 gso: explicitly disabled via build config 00:01:07.171 ip_frag: explicitly disabled via build config 00:01:07.171 jobstats: explicitly disabled via build config 00:01:07.171 latencystats: explicitly disabled via build config 00:01:07.171 lpm: explicitly disabled via build config 00:01:07.171 member: explicitly disabled via build config 00:01:07.171 pcapng: explicitly disabled via build config 00:01:07.171 rawdev: explicitly disabled via build config 00:01:07.171 regexdev: explicitly disabled via build config 00:01:07.171 mldev: explicitly disabled via build config 00:01:07.171 rib: explicitly disabled via build config 00:01:07.171 sched: explicitly disabled via build config 00:01:07.171 stack: explicitly disabled via build config 00:01:07.171 ipsec: explicitly disabled via build config 00:01:07.171 pdcp: explicitly disabled via build config 00:01:07.171 fib: explicitly disabled via build config 00:01:07.171 port: explicitly disabled via build config 00:01:07.171 pdump: explicitly disabled via build config 00:01:07.171 table: explicitly disabled via build config 00:01:07.171 pipeline: explicitly disabled via build config 00:01:07.171 graph: explicitly disabled via build config 00:01:07.171 node: explicitly disabled via build config 00:01:07.171 00:01:07.171 drivers: 00:01:07.171 common/cpt: not in enabled drivers build config 00:01:07.171 common/dpaax: not in enabled drivers build config 00:01:07.171 common/iavf: not in enabled drivers build config 00:01:07.171 common/idpf: not in enabled drivers build config 00:01:07.171 common/mvep: not in enabled drivers build config 00:01:07.171 common/octeontx: not in enabled drivers build config 00:01:07.171 bus/auxiliary: not in enabled drivers build config 00:01:07.171 bus/cdx: not in enabled drivers build config 00:01:07.171 bus/dpaa: not in enabled drivers build config 00:01:07.171 bus/fslmc: not in enabled drivers build config 00:01:07.171 bus/ifpga: not in enabled drivers build config 00:01:07.171 bus/platform: not in enabled drivers build config 00:01:07.171 bus/vmbus: not in enabled drivers build config 00:01:07.171 common/cnxk: not in enabled drivers build config 00:01:07.171 common/mlx5: not in enabled drivers build config 00:01:07.171 common/nfp: not in enabled drivers build config 00:01:07.171 common/qat: not in enabled drivers build config 00:01:07.171 common/sfc_efx: not in enabled drivers build config 00:01:07.171 mempool/bucket: not in enabled drivers build config 00:01:07.171 mempool/cnxk: not in enabled drivers build config 00:01:07.171 mempool/dpaa: not in enabled drivers build config 00:01:07.171 mempool/dpaa2: not in enabled drivers build config 00:01:07.171 mempool/octeontx: not in enabled drivers build config 00:01:07.171 mempool/stack: not in enabled drivers build config 00:01:07.171 dma/cnxk: not in enabled drivers build config 00:01:07.171 dma/dpaa: not in enabled drivers build config 00:01:07.171 dma/dpaa2: not in enabled drivers build config 00:01:07.171 dma/hisilicon: not in enabled drivers build config 00:01:07.171 dma/idxd: not in enabled drivers build config 00:01:07.171 dma/ioat: not in enabled drivers build config 00:01:07.171 dma/skeleton: not in enabled drivers build config 00:01:07.171 net/af_packet: not in enabled drivers build config 00:01:07.171 net/af_xdp: not in enabled drivers build config 00:01:07.171 net/ark: not in enabled drivers build config 00:01:07.171 net/atlantic: not in enabled drivers build config 00:01:07.171 net/avp: not in enabled drivers build config 00:01:07.171 net/axgbe: not in enabled drivers build config 00:01:07.171 net/bnx2x: not in enabled drivers build config 00:01:07.171 net/bnxt: not in enabled drivers build config 00:01:07.171 net/bonding: not in enabled drivers build config 00:01:07.171 net/cnxk: not in enabled drivers build config 00:01:07.171 net/cpfl: not in enabled drivers build config 00:01:07.171 net/cxgbe: not in enabled drivers build config 00:01:07.171 net/dpaa: not in enabled drivers build config 00:01:07.171 net/dpaa2: not in enabled drivers build config 00:01:07.171 net/e1000: not in enabled drivers build config 00:01:07.171 net/ena: not in enabled drivers build config 00:01:07.171 net/enetc: not in enabled drivers build config 00:01:07.171 net/enetfec: not in enabled drivers build config 00:01:07.171 net/enic: not in enabled drivers build config 00:01:07.171 net/failsafe: not in enabled drivers build config 00:01:07.171 net/fm10k: not in enabled drivers build config 00:01:07.171 net/gve: not in enabled drivers build config 00:01:07.171 net/hinic: not in enabled drivers build config 00:01:07.171 net/hns3: not in enabled drivers build config 00:01:07.171 net/i40e: not in enabled drivers build config 00:01:07.171 net/iavf: not in enabled drivers build config 00:01:07.171 net/ice: not in enabled drivers build config 00:01:07.171 net/idpf: not in enabled drivers build config 00:01:07.171 net/igc: not in enabled drivers build config 00:01:07.171 net/ionic: not in enabled drivers build config 00:01:07.171 net/ipn3ke: not in enabled drivers build config 00:01:07.171 net/ixgbe: not in enabled drivers build config 00:01:07.171 net/mana: not in enabled drivers build config 00:01:07.171 net/memif: not in enabled drivers build config 00:01:07.171 net/mlx4: not in enabled drivers build config 00:01:07.171 net/mlx5: not in enabled drivers build config 00:01:07.171 net/mvneta: not in enabled drivers build config 00:01:07.171 net/mvpp2: not in enabled drivers build config 00:01:07.171 net/netvsc: not in enabled drivers build config 00:01:07.171 net/nfb: not in enabled drivers build config 00:01:07.171 net/nfp: not in enabled drivers build config 00:01:07.171 net/ngbe: not in enabled drivers build config 00:01:07.171 net/null: not in enabled drivers build config 00:01:07.171 net/octeontx: not in enabled drivers build config 00:01:07.171 net/octeon_ep: not in enabled drivers build config 00:01:07.171 net/pcap: not in enabled drivers build config 00:01:07.171 net/pfe: not in enabled drivers build config 00:01:07.171 net/qede: not in enabled drivers build config 00:01:07.171 net/ring: not in enabled drivers build config 00:01:07.171 net/sfc: not in enabled drivers build config 00:01:07.171 net/softnic: not in enabled drivers build config 00:01:07.171 net/tap: not in enabled drivers build config 00:01:07.171 net/thunderx: not in enabled drivers build config 00:01:07.171 net/txgbe: not in enabled drivers build config 00:01:07.171 net/vdev_netvsc: not in enabled drivers build config 00:01:07.171 net/vhost: not in enabled drivers build config 00:01:07.171 net/virtio: not in enabled drivers build config 00:01:07.171 net/vmxnet3: not in enabled drivers build config 00:01:07.171 raw/*: missing internal dependency, "rawdev" 00:01:07.171 crypto/armv8: not in enabled drivers build config 00:01:07.172 crypto/bcmfs: not in enabled drivers build config 00:01:07.172 crypto/caam_jr: not in enabled drivers build config 00:01:07.172 crypto/ccp: not in enabled drivers build config 00:01:07.172 crypto/cnxk: not in enabled drivers build config 00:01:07.172 crypto/dpaa_sec: not in enabled drivers build config 00:01:07.172 crypto/dpaa2_sec: not in enabled drivers build config 00:01:07.172 crypto/ipsec_mb: not in enabled drivers build config 00:01:07.172 crypto/mlx5: not in enabled drivers build config 00:01:07.172 crypto/mvsam: not in enabled drivers build config 00:01:07.172 crypto/nitrox: not in enabled drivers build config 00:01:07.172 crypto/null: not in enabled drivers build config 00:01:07.172 crypto/octeontx: not in enabled drivers build config 00:01:07.172 crypto/openssl: not in enabled drivers build config 00:01:07.172 crypto/scheduler: not in enabled drivers build config 00:01:07.172 crypto/uadk: not in enabled drivers build config 00:01:07.172 crypto/virtio: not in enabled drivers build config 00:01:07.172 compress/isal: not in enabled drivers build config 00:01:07.172 compress/mlx5: not in enabled drivers build config 00:01:07.172 compress/octeontx: not in enabled drivers build config 00:01:07.172 compress/zlib: not in enabled drivers build config 00:01:07.172 regex/*: missing internal dependency, "regexdev" 00:01:07.172 ml/*: missing internal dependency, "mldev" 00:01:07.172 vdpa/ifc: not in enabled drivers build config 00:01:07.172 vdpa/mlx5: not in enabled drivers build config 00:01:07.172 vdpa/nfp: not in enabled drivers build config 00:01:07.172 vdpa/sfc: not in enabled drivers build config 00:01:07.172 event/*: missing internal dependency, "eventdev" 00:01:07.172 baseband/*: missing internal dependency, "bbdev" 00:01:07.172 gpu/*: missing internal dependency, "gpudev" 00:01:07.172 00:01:07.172 00:01:07.737 Build targets in project: 85 00:01:07.737 00:01:07.737 DPDK 23.11.0 00:01:07.737 00:01:07.737 User defined options 00:01:07.737 buildtype : debug 00:01:07.737 default_library : shared 00:01:07.737 libdir : lib 00:01:07.737 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:07.737 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:07.737 c_link_args : 00:01:07.737 cpu_instruction_set: native 00:01:07.737 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:07.738 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:07.738 enable_docs : false 00:01:07.738 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:07.738 enable_kmods : false 00:01:07.738 tests : false 00:01:07.738 00:01:07.738 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:08.311 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:08.311 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:08.311 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:08.311 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:08.311 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:08.311 [5/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:08.311 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:08.311 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:08.311 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:08.311 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:08.311 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:08.311 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:08.311 [12/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:08.311 [13/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:08.311 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:08.311 [15/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:08.311 [16/265] Linking static target lib/librte_log.a 00:01:08.311 [17/265] Linking static target lib/librte_kvargs.a 00:01:08.311 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:08.311 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:08.311 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:08.568 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:09.150 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:09.150 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:09.150 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:09.150 [25/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:09.150 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:09.150 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:09.150 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:09.150 [29/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:09.150 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:09.150 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:09.150 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:09.150 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:09.150 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:09.150 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:09.150 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:09.150 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:09.150 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:09.150 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:09.150 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:09.150 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:09.150 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:09.150 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:09.150 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:09.150 [45/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:09.150 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:09.150 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:09.150 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:09.150 [49/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:09.150 [50/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:09.150 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:09.150 [52/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:09.150 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:09.150 [54/265] Linking static target lib/librte_telemetry.a 00:01:09.150 [55/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:09.150 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:09.150 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:09.150 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:09.412 [59/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:09.412 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:09.412 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:09.412 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:09.412 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:09.412 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:09.412 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:09.412 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:09.412 [67/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:09.412 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:09.412 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:09.412 [70/265] Linking target lib/librte_log.so.24.0 00:01:09.412 [71/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:09.412 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:09.412 [73/265] Linking static target lib/librte_pci.a 00:01:09.675 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:09.675 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:09.675 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:09.675 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:09.675 [78/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:09.675 [79/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:09.675 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:09.675 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:09.675 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:09.675 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:09.675 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:09.675 [85/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:09.675 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:09.935 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:09.935 [88/265] Linking target lib/librte_kvargs.so.24.0 00:01:09.935 [89/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:09.935 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:09.935 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:09.935 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:09.935 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:09.935 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:09.935 [95/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:10.197 [96/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:10.197 [97/265] Linking static target lib/librte_ring.a 00:01:10.197 [98/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:10.197 [99/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:10.197 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:10.197 [101/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:10.197 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:10.197 [103/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:10.197 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:10.197 [105/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:10.197 [106/265] Linking static target lib/librte_meter.a 00:01:10.197 [107/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:10.197 [108/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:10.197 [109/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:10.197 [110/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.197 [111/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:10.197 [112/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:10.197 [113/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:10.197 [114/265] Linking static target lib/librte_eal.a 00:01:10.197 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:10.197 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:10.460 [117/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:10.460 [118/265] Linking static target lib/librte_rcu.a 00:01:10.460 [119/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:10.460 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:10.460 [121/265] Linking target lib/librte_telemetry.so.24.0 00:01:10.460 [122/265] Linking static target lib/librte_mempool.a 00:01:10.460 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:10.460 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:10.460 [125/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:10.460 [126/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:10.460 [127/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:10.460 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:10.460 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:10.460 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:10.460 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:10.460 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:10.722 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:10.722 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:10.722 [135/265] Linking static target lib/librte_cmdline.a 00:01:10.722 [136/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:10.722 [137/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:10.722 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:10.722 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:10.722 [140/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.722 [141/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:10.722 [142/265] Linking static target lib/librte_timer.a 00:01:10.722 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:10.722 [144/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.722 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:10.984 [146/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:10.984 [147/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:10.984 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:10.984 [149/265] Linking static target lib/librte_net.a 00:01:10.984 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.984 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:10.984 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:10.984 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:11.245 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:11.245 [155/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:11.245 [156/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:11.245 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:11.245 [158/265] Linking static target lib/librte_dmadev.a 00:01:11.245 [159/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:11.245 [160/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.245 [161/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:11.245 [162/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.245 [163/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:11.245 [164/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:11.245 [165/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:11.245 [166/265] Linking static target lib/librte_hash.a 00:01:11.245 [167/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.503 [168/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:11.503 [169/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:11.503 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:11.503 [171/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:11.503 [172/265] Linking static target lib/librte_compressdev.a 00:01:11.503 [173/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:11.503 [174/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:11.503 [175/265] Linking static target lib/librte_power.a 00:01:11.503 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:11.503 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:11.503 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:11.503 [179/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:11.503 [180/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:11.503 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:11.503 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:11.503 [183/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.503 [184/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:11.503 [185/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.503 [186/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:11.761 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:11.761 [188/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:11.761 [189/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:11.761 [190/265] Linking static target lib/librte_reorder.a 00:01:11.761 [191/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:11.762 [192/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:11.762 [193/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:11.762 [194/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:11.762 [195/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:11.762 [196/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:11.762 [197/265] Linking static target drivers/librte_bus_vdev.a 00:01:11.762 [198/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:11.762 [199/265] Linking static target lib/librte_mbuf.a 00:01:11.762 [200/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:12.020 [201/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:12.020 [202/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.020 [203/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:12.020 [204/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:12.020 [205/265] Linking static target drivers/librte_bus_pci.a 00:01:12.020 [206/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.020 [207/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.020 [208/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:12.020 [209/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:12.020 [210/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:12.020 [211/265] Linking static target drivers/librte_mempool_ring.a 00:01:12.020 [212/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.020 [213/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.020 [214/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:12.020 [215/265] Linking static target lib/librte_security.a 00:01:12.278 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:12.278 [217/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.278 [218/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.278 [219/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:12.536 [220/265] Linking static target lib/librte_ethdev.a 00:01:12.536 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:12.536 [222/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.536 [223/265] Linking static target lib/librte_cryptodev.a 00:01:13.472 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.846 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:16.746 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.746 [227/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.746 [228/265] Linking target lib/librte_eal.so.24.0 00:01:16.746 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:16.746 [230/265] Linking target lib/librte_timer.so.24.0 00:01:16.746 [231/265] Linking target lib/librte_ring.so.24.0 00:01:16.746 [232/265] Linking target lib/librte_meter.so.24.0 00:01:16.746 [233/265] Linking target lib/librte_pci.so.24.0 00:01:16.746 [234/265] Linking target lib/librte_dmadev.so.24.0 00:01:16.746 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:16.746 [236/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:16.746 [237/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:16.746 [238/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:16.746 [239/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:16.746 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:16.746 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:16.746 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:16.746 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:17.004 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:17.004 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:17.004 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:17.004 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:17.004 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:17.004 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:17.004 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:17.004 [251/265] Linking target lib/librte_net.so.24.0 00:01:17.004 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:17.262 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:17.262 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:17.262 [255/265] Linking target lib/librte_hash.so.24.0 00:01:17.262 [256/265] Linking target lib/librte_cmdline.so.24.0 00:01:17.262 [257/265] Linking target lib/librte_security.so.24.0 00:01:17.262 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:17.520 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:17.520 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:17.520 [261/265] Linking target lib/librte_power.so.24.0 00:01:20.056 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:20.056 [263/265] Linking static target lib/librte_vhost.a 00:01:21.437 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.437 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:21.437 INFO: autodetecting backend as ninja 00:01:21.437 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:22.372 CC lib/log/log.o 00:01:22.372 CC lib/log/log_flags.o 00:01:22.372 CC lib/log/log_deprecated.o 00:01:22.372 CC lib/ut/ut.o 00:01:22.372 CC lib/ut_mock/mock.o 00:01:22.372 LIB libspdk_ut_mock.a 00:01:22.372 LIB libspdk_log.a 00:01:22.372 LIB libspdk_ut.a 00:01:22.372 SO libspdk_ut_mock.so.5.0 00:01:22.372 SO libspdk_ut.so.1.0 00:01:22.372 SO libspdk_log.so.6.1 00:01:22.372 SYMLINK libspdk_ut_mock.so 00:01:22.372 SYMLINK libspdk_ut.so 00:01:22.372 SYMLINK libspdk_log.so 00:01:22.630 CC lib/dma/dma.o 00:01:22.630 CXX lib/trace_parser/trace.o 00:01:22.630 CC lib/util/base64.o 00:01:22.630 CC lib/ioat/ioat.o 00:01:22.630 CC lib/util/bit_array.o 00:01:22.630 CC lib/util/cpuset.o 00:01:22.630 CC lib/util/crc16.o 00:01:22.630 CC lib/util/crc32.o 00:01:22.630 CC lib/util/crc32c.o 00:01:22.630 CC lib/util/crc32_ieee.o 00:01:22.630 CC lib/util/crc64.o 00:01:22.630 CC lib/util/dif.o 00:01:22.630 CC lib/util/fd.o 00:01:22.630 CC lib/util/file.o 00:01:22.630 CC lib/util/hexlify.o 00:01:22.631 CC lib/util/iov.o 00:01:22.631 CC lib/util/math.o 00:01:22.631 CC lib/util/pipe.o 00:01:22.631 CC lib/util/strerror_tls.o 00:01:22.631 CC lib/util/string.o 00:01:22.631 CC lib/util/uuid.o 00:01:22.631 CC lib/util/fd_group.o 00:01:22.631 CC lib/util/xor.o 00:01:22.631 CC lib/util/zipf.o 00:01:22.631 CC lib/vfio_user/host/vfio_user_pci.o 00:01:22.631 CC lib/vfio_user/host/vfio_user.o 00:01:22.631 LIB libspdk_dma.a 00:01:22.631 SO libspdk_dma.so.3.0 00:01:22.888 SYMLINK libspdk_dma.so 00:01:22.888 LIB libspdk_vfio_user.a 00:01:22.888 SO libspdk_vfio_user.so.4.0 00:01:22.889 LIB libspdk_ioat.a 00:01:22.889 SO libspdk_ioat.so.6.0 00:01:22.889 SYMLINK libspdk_vfio_user.so 00:01:22.889 SYMLINK libspdk_ioat.so 00:01:23.146 LIB libspdk_util.a 00:01:23.146 SO libspdk_util.so.8.0 00:01:23.146 SYMLINK libspdk_util.so 00:01:23.404 CC lib/idxd/idxd.o 00:01:23.404 CC lib/vmd/vmd.o 00:01:23.404 CC lib/json/json_parse.o 00:01:23.404 CC lib/vmd/led.o 00:01:23.404 CC lib/idxd/idxd_user.o 00:01:23.404 CC lib/json/json_util.o 00:01:23.404 CC lib/json/json_write.o 00:01:23.404 CC lib/idxd/idxd_kernel.o 00:01:23.404 CC lib/rdma/common.o 00:01:23.404 CC lib/env_dpdk/env.o 00:01:23.404 CC lib/conf/conf.o 00:01:23.404 CC lib/rdma/rdma_verbs.o 00:01:23.404 CC lib/env_dpdk/memory.o 00:01:23.404 CC lib/env_dpdk/pci.o 00:01:23.404 CC lib/env_dpdk/init.o 00:01:23.404 CC lib/env_dpdk/threads.o 00:01:23.404 CC lib/env_dpdk/pci_ioat.o 00:01:23.404 CC lib/env_dpdk/pci_virtio.o 00:01:23.404 CC lib/env_dpdk/pci_vmd.o 00:01:23.404 CC lib/env_dpdk/pci_idxd.o 00:01:23.404 CC lib/env_dpdk/pci_event.o 00:01:23.404 CC lib/env_dpdk/sigbus_handler.o 00:01:23.404 CC lib/env_dpdk/pci_dpdk.o 00:01:23.404 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:23.404 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:23.404 LIB libspdk_trace_parser.a 00:01:23.662 SO libspdk_trace_parser.so.4.0 00:01:23.662 LIB libspdk_conf.a 00:01:23.662 SO libspdk_conf.so.5.0 00:01:23.662 SYMLINK libspdk_trace_parser.so 00:01:23.662 LIB libspdk_rdma.a 00:01:23.662 SYMLINK libspdk_conf.so 00:01:23.662 SO libspdk_rdma.so.5.0 00:01:23.662 LIB libspdk_json.a 00:01:23.662 SO libspdk_json.so.5.1 00:01:23.662 SYMLINK libspdk_rdma.so 00:01:23.662 SYMLINK libspdk_json.so 00:01:23.921 CC lib/jsonrpc/jsonrpc_server.o 00:01:23.921 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:23.921 CC lib/jsonrpc/jsonrpc_client.o 00:01:23.921 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:23.921 LIB libspdk_idxd.a 00:01:23.921 SO libspdk_idxd.so.11.0 00:01:23.921 SYMLINK libspdk_idxd.so 00:01:24.179 LIB libspdk_vmd.a 00:01:24.179 SO libspdk_vmd.so.5.0 00:01:24.179 LIB libspdk_jsonrpc.a 00:01:24.179 SYMLINK libspdk_vmd.so 00:01:24.179 SO libspdk_jsonrpc.so.5.1 00:01:24.179 SYMLINK libspdk_jsonrpc.so 00:01:24.438 CC lib/rpc/rpc.o 00:01:24.438 LIB libspdk_rpc.a 00:01:24.438 SO libspdk_rpc.so.5.0 00:01:24.438 SYMLINK libspdk_rpc.so 00:01:24.697 CC lib/trace/trace.o 00:01:24.697 CC lib/trace/trace_flags.o 00:01:24.697 CC lib/trace/trace_rpc.o 00:01:24.697 CC lib/notify/notify.o 00:01:24.697 CC lib/sock/sock.o 00:01:24.697 CC lib/sock/sock_rpc.o 00:01:24.697 CC lib/notify/notify_rpc.o 00:01:24.956 LIB libspdk_notify.a 00:01:24.956 SO libspdk_notify.so.5.0 00:01:24.956 SYMLINK libspdk_notify.so 00:01:24.956 LIB libspdk_trace.a 00:01:24.956 SO libspdk_trace.so.9.0 00:01:24.956 SYMLINK libspdk_trace.so 00:01:24.956 LIB libspdk_sock.a 00:01:25.214 CC lib/thread/thread.o 00:01:25.214 CC lib/thread/iobuf.o 00:01:25.214 SO libspdk_sock.so.8.0 00:01:25.214 SYMLINK libspdk_sock.so 00:01:25.214 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:25.214 CC lib/nvme/nvme_ctrlr.o 00:01:25.214 CC lib/nvme/nvme_fabric.o 00:01:25.214 CC lib/nvme/nvme_ns_cmd.o 00:01:25.214 CC lib/nvme/nvme_ns.o 00:01:25.214 CC lib/nvme/nvme_pcie_common.o 00:01:25.214 CC lib/nvme/nvme_pcie.o 00:01:25.214 CC lib/nvme/nvme_qpair.o 00:01:25.214 CC lib/nvme/nvme.o 00:01:25.214 CC lib/nvme/nvme_quirks.o 00:01:25.214 CC lib/nvme/nvme_transport.o 00:01:25.214 CC lib/nvme/nvme_discovery.o 00:01:25.214 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:25.214 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:25.214 CC lib/nvme/nvme_tcp.o 00:01:25.214 CC lib/nvme/nvme_opal.o 00:01:25.214 CC lib/nvme/nvme_io_msg.o 00:01:25.214 CC lib/nvme/nvme_poll_group.o 00:01:25.214 CC lib/nvme/nvme_zns.o 00:01:25.214 CC lib/nvme/nvme_cuse.o 00:01:25.214 CC lib/nvme/nvme_vfio_user.o 00:01:25.214 CC lib/nvme/nvme_rdma.o 00:01:25.473 LIB libspdk_env_dpdk.a 00:01:25.473 SO libspdk_env_dpdk.so.13.0 00:01:25.473 SYMLINK libspdk_env_dpdk.so 00:01:26.848 LIB libspdk_thread.a 00:01:26.848 SO libspdk_thread.so.9.0 00:01:26.848 SYMLINK libspdk_thread.so 00:01:26.848 CC lib/init/json_config.o 00:01:26.848 CC lib/virtio/virtio.o 00:01:26.848 CC lib/accel/accel.o 00:01:26.848 CC lib/accel/accel_rpc.o 00:01:26.848 CC lib/blob/blobstore.o 00:01:26.848 CC lib/virtio/virtio_vhost_user.o 00:01:26.848 CC lib/init/subsystem.o 00:01:26.848 CC lib/blob/request.o 00:01:26.848 CC lib/accel/accel_sw.o 00:01:26.848 CC lib/virtio/virtio_vfio_user.o 00:01:26.848 CC lib/init/subsystem_rpc.o 00:01:26.848 CC lib/blob/zeroes.o 00:01:26.848 CC lib/virtio/virtio_pci.o 00:01:26.848 CC lib/blob/blob_bs_dev.o 00:01:26.848 CC lib/init/rpc.o 00:01:27.106 LIB libspdk_init.a 00:01:27.106 SO libspdk_init.so.4.0 00:01:27.106 SYMLINK libspdk_init.so 00:01:27.364 LIB libspdk_virtio.a 00:01:27.364 SO libspdk_virtio.so.6.0 00:01:27.364 CC lib/event/app.o 00:01:27.364 CC lib/event/reactor.o 00:01:27.364 CC lib/event/log_rpc.o 00:01:27.364 CC lib/event/app_rpc.o 00:01:27.364 CC lib/event/scheduler_static.o 00:01:27.364 SYMLINK libspdk_virtio.so 00:01:27.622 LIB libspdk_nvme.a 00:01:27.622 SO libspdk_nvme.so.12.0 00:01:27.622 LIB libspdk_event.a 00:01:27.881 SO libspdk_event.so.12.0 00:01:27.881 SYMLINK libspdk_event.so 00:01:27.881 SYMLINK libspdk_nvme.so 00:01:27.881 LIB libspdk_accel.a 00:01:27.881 SO libspdk_accel.so.14.0 00:01:28.140 SYMLINK libspdk_accel.so 00:01:28.140 CC lib/bdev/bdev.o 00:01:28.140 CC lib/bdev/bdev_rpc.o 00:01:28.140 CC lib/bdev/bdev_zone.o 00:01:28.140 CC lib/bdev/part.o 00:01:28.140 CC lib/bdev/scsi_nvme.o 00:01:30.047 LIB libspdk_blob.a 00:01:30.047 SO libspdk_blob.so.10.1 00:01:30.047 SYMLINK libspdk_blob.so 00:01:30.047 CC lib/blobfs/blobfs.o 00:01:30.047 CC lib/blobfs/tree.o 00:01:30.047 CC lib/lvol/lvol.o 00:01:30.614 LIB libspdk_blobfs.a 00:01:30.873 SO libspdk_blobfs.so.9.0 00:01:30.873 LIB libspdk_lvol.a 00:01:30.873 SO libspdk_lvol.so.9.1 00:01:30.873 SYMLINK libspdk_blobfs.so 00:01:30.873 LIB libspdk_bdev.a 00:01:30.873 SYMLINK libspdk_lvol.so 00:01:30.873 SO libspdk_bdev.so.14.0 00:01:30.873 SYMLINK libspdk_bdev.so 00:01:31.138 CC lib/nbd/nbd.o 00:01:31.138 CC lib/nbd/nbd_rpc.o 00:01:31.138 CC lib/ftl/ftl_core.o 00:01:31.138 CC lib/ftl/ftl_init.o 00:01:31.138 CC lib/nvmf/ctrlr.o 00:01:31.138 CC lib/scsi/dev.o 00:01:31.138 CC lib/ublk/ublk.o 00:01:31.138 CC lib/nvmf/ctrlr_discovery.o 00:01:31.138 CC lib/ftl/ftl_layout.o 00:01:31.138 CC lib/scsi/lun.o 00:01:31.138 CC lib/ublk/ublk_rpc.o 00:01:31.138 CC lib/nvmf/ctrlr_bdev.o 00:01:31.138 CC lib/ftl/ftl_debug.o 00:01:31.138 CC lib/scsi/port.o 00:01:31.138 CC lib/nvmf/subsystem.o 00:01:31.138 CC lib/ftl/ftl_io.o 00:01:31.138 CC lib/scsi/scsi.o 00:01:31.138 CC lib/nvmf/nvmf.o 00:01:31.138 CC lib/scsi/scsi_bdev.o 00:01:31.138 CC lib/ftl/ftl_sb.o 00:01:31.138 CC lib/nvmf/nvmf_rpc.o 00:01:31.138 CC lib/ftl/ftl_l2p.o 00:01:31.138 CC lib/ftl/ftl_l2p_flat.o 00:01:31.138 CC lib/nvmf/transport.o 00:01:31.138 CC lib/scsi/scsi_pr.o 00:01:31.138 CC lib/scsi/scsi_rpc.o 00:01:31.138 CC lib/scsi/task.o 00:01:31.138 CC lib/ftl/ftl_nv_cache.o 00:01:31.138 CC lib/nvmf/rdma.o 00:01:31.138 CC lib/ftl/ftl_band.o 00:01:31.138 CC lib/nvmf/tcp.o 00:01:31.138 CC lib/ftl/ftl_band_ops.o 00:01:31.138 CC lib/ftl/ftl_writer.o 00:01:31.138 CC lib/ftl/ftl_rq.o 00:01:31.138 CC lib/ftl/ftl_reloc.o 00:01:31.138 CC lib/ftl/ftl_l2p_cache.o 00:01:31.138 CC lib/ftl/ftl_p2l.o 00:01:31.138 CC lib/ftl/mngt/ftl_mngt.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:31.139 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:31.398 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:31.398 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:31.398 CC lib/ftl/utils/ftl_conf.o 00:01:31.398 CC lib/ftl/utils/ftl_md.o 00:01:31.398 CC lib/ftl/utils/ftl_mempool.o 00:01:31.398 CC lib/ftl/utils/ftl_bitmap.o 00:01:31.398 CC lib/ftl/utils/ftl_property.o 00:01:31.398 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:31.398 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:31.398 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:31.398 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:31.398 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:31.398 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:31.398 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:31.398 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:31.398 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:31.398 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:31.656 CC lib/ftl/base/ftl_base_dev.o 00:01:31.656 CC lib/ftl/base/ftl_base_bdev.o 00:01:31.656 CC lib/ftl/ftl_trace.o 00:01:31.656 LIB libspdk_nbd.a 00:01:31.915 SO libspdk_nbd.so.6.0 00:01:31.915 SYMLINK libspdk_nbd.so 00:01:31.915 LIB libspdk_scsi.a 00:01:31.915 SO libspdk_scsi.so.8.0 00:01:32.173 SYMLINK libspdk_scsi.so 00:01:32.173 LIB libspdk_ublk.a 00:01:32.173 SO libspdk_ublk.so.2.0 00:01:32.173 CC lib/vhost/vhost.o 00:01:32.173 CC lib/iscsi/conn.o 00:01:32.173 CC lib/vhost/vhost_rpc.o 00:01:32.173 CC lib/iscsi/init_grp.o 00:01:32.173 CC lib/vhost/vhost_scsi.o 00:01:32.173 CC lib/iscsi/iscsi.o 00:01:32.173 CC lib/vhost/vhost_blk.o 00:01:32.173 CC lib/iscsi/md5.o 00:01:32.173 CC lib/iscsi/param.o 00:01:32.173 CC lib/vhost/rte_vhost_user.o 00:01:32.173 CC lib/iscsi/portal_grp.o 00:01:32.173 CC lib/iscsi/tgt_node.o 00:01:32.173 CC lib/iscsi/iscsi_subsystem.o 00:01:32.173 CC lib/iscsi/iscsi_rpc.o 00:01:32.173 CC lib/iscsi/task.o 00:01:32.173 SYMLINK libspdk_ublk.so 00:01:32.431 LIB libspdk_ftl.a 00:01:32.431 SO libspdk_ftl.so.8.0 00:01:32.689 SYMLINK libspdk_ftl.so 00:01:33.254 LIB libspdk_vhost.a 00:01:33.513 SO libspdk_vhost.so.7.1 00:01:33.513 SYMLINK libspdk_vhost.so 00:01:33.513 LIB libspdk_nvmf.a 00:01:33.513 LIB libspdk_iscsi.a 00:01:33.771 SO libspdk_nvmf.so.17.0 00:01:33.771 SO libspdk_iscsi.so.7.0 00:01:33.771 SYMLINK libspdk_nvmf.so 00:01:33.771 SYMLINK libspdk_iscsi.so 00:01:34.030 CC module/env_dpdk/env_dpdk_rpc.o 00:01:34.030 CC module/scheduler/gscheduler/gscheduler.o 00:01:34.030 CC module/sock/posix/posix.o 00:01:34.030 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:34.030 CC module/blob/bdev/blob_bdev.o 00:01:34.030 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:34.030 CC module/accel/dsa/accel_dsa.o 00:01:34.030 CC module/accel/dsa/accel_dsa_rpc.o 00:01:34.030 CC module/accel/error/accel_error.o 00:01:34.030 CC module/accel/error/accel_error_rpc.o 00:01:34.030 CC module/accel/ioat/accel_ioat.o 00:01:34.030 CC module/accel/ioat/accel_ioat_rpc.o 00:01:34.030 CC module/accel/iaa/accel_iaa.o 00:01:34.030 CC module/accel/iaa/accel_iaa_rpc.o 00:01:34.030 LIB libspdk_env_dpdk_rpc.a 00:01:34.030 SO libspdk_env_dpdk_rpc.so.5.0 00:01:34.287 SYMLINK libspdk_env_dpdk_rpc.so 00:01:34.287 LIB libspdk_scheduler_gscheduler.a 00:01:34.287 LIB libspdk_scheduler_dpdk_governor.a 00:01:34.287 SO libspdk_scheduler_gscheduler.so.3.0 00:01:34.287 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:34.287 LIB libspdk_accel_error.a 00:01:34.287 LIB libspdk_accel_ioat.a 00:01:34.287 LIB libspdk_scheduler_dynamic.a 00:01:34.287 LIB libspdk_accel_iaa.a 00:01:34.287 SO libspdk_accel_error.so.1.0 00:01:34.287 SYMLINK libspdk_scheduler_gscheduler.so 00:01:34.287 SO libspdk_accel_ioat.so.5.0 00:01:34.287 SO libspdk_scheduler_dynamic.so.3.0 00:01:34.287 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:34.287 SO libspdk_accel_iaa.so.2.0 00:01:34.287 LIB libspdk_accel_dsa.a 00:01:34.287 SYMLINK libspdk_accel_error.so 00:01:34.287 SYMLINK libspdk_scheduler_dynamic.so 00:01:34.287 SYMLINK libspdk_accel_ioat.so 00:01:34.287 LIB libspdk_blob_bdev.a 00:01:34.287 SO libspdk_accel_dsa.so.4.0 00:01:34.287 SYMLINK libspdk_accel_iaa.so 00:01:34.287 SO libspdk_blob_bdev.so.10.1 00:01:34.287 SYMLINK libspdk_accel_dsa.so 00:01:34.287 SYMLINK libspdk_blob_bdev.so 00:01:34.548 CC module/bdev/delay/vbdev_delay.o 00:01:34.548 CC module/bdev/gpt/gpt.o 00:01:34.548 CC module/bdev/error/vbdev_error.o 00:01:34.548 CC module/blobfs/bdev/blobfs_bdev.o 00:01:34.548 CC module/bdev/gpt/vbdev_gpt.o 00:01:34.548 CC module/bdev/lvol/vbdev_lvol.o 00:01:34.548 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:34.548 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:34.548 CC module/bdev/null/bdev_null.o 00:01:34.548 CC module/bdev/error/vbdev_error_rpc.o 00:01:34.548 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:34.548 CC module/bdev/raid/bdev_raid.o 00:01:34.548 CC module/bdev/malloc/bdev_malloc.o 00:01:34.548 CC module/bdev/null/bdev_null_rpc.o 00:01:34.548 CC module/bdev/raid/bdev_raid_rpc.o 00:01:34.548 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:34.548 CC module/bdev/raid/bdev_raid_sb.o 00:01:34.548 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:34.548 CC module/bdev/aio/bdev_aio.o 00:01:34.548 CC module/bdev/raid/raid0.o 00:01:34.548 CC module/bdev/aio/bdev_aio_rpc.o 00:01:34.548 CC module/bdev/raid/raid1.o 00:01:34.548 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:34.548 CC module/bdev/ftl/bdev_ftl.o 00:01:34.548 CC module/bdev/passthru/vbdev_passthru.o 00:01:34.548 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:34.548 CC module/bdev/raid/concat.o 00:01:34.548 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:34.548 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:34.548 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:34.548 CC module/bdev/iscsi/bdev_iscsi.o 00:01:34.548 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:34.548 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:34.548 CC module/bdev/split/vbdev_split.o 00:01:34.548 CC module/bdev/split/vbdev_split_rpc.o 00:01:34.548 CC module/bdev/nvme/bdev_nvme.o 00:01:34.548 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:34.548 CC module/bdev/nvme/nvme_rpc.o 00:01:34.548 CC module/bdev/nvme/bdev_mdns_client.o 00:01:34.548 CC module/bdev/nvme/vbdev_opal.o 00:01:34.548 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:34.548 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:34.807 LIB libspdk_sock_posix.a 00:01:34.807 LIB libspdk_blobfs_bdev.a 00:01:34.807 SO libspdk_sock_posix.so.5.0 00:01:34.807 SO libspdk_blobfs_bdev.so.5.0 00:01:35.066 LIB libspdk_bdev_null.a 00:01:35.066 SO libspdk_bdev_null.so.5.0 00:01:35.066 SYMLINK libspdk_sock_posix.so 00:01:35.066 SYMLINK libspdk_blobfs_bdev.so 00:01:35.066 LIB libspdk_bdev_split.a 00:01:35.066 LIB libspdk_bdev_error.a 00:01:35.066 SO libspdk_bdev_split.so.5.0 00:01:35.066 SYMLINK libspdk_bdev_null.so 00:01:35.066 LIB libspdk_bdev_ftl.a 00:01:35.066 SO libspdk_bdev_error.so.5.0 00:01:35.066 LIB libspdk_bdev_gpt.a 00:01:35.066 SO libspdk_bdev_ftl.so.5.0 00:01:35.066 LIB libspdk_bdev_passthru.a 00:01:35.066 LIB libspdk_bdev_zone_block.a 00:01:35.066 SYMLINK libspdk_bdev_split.so 00:01:35.066 SO libspdk_bdev_passthru.so.5.0 00:01:35.066 SO libspdk_bdev_gpt.so.5.0 00:01:35.066 SYMLINK libspdk_bdev_error.so 00:01:35.066 SO libspdk_bdev_zone_block.so.5.0 00:01:35.066 LIB libspdk_bdev_delay.a 00:01:35.066 LIB libspdk_bdev_aio.a 00:01:35.066 SYMLINK libspdk_bdev_ftl.so 00:01:35.066 SO libspdk_bdev_delay.so.5.0 00:01:35.066 LIB libspdk_bdev_malloc.a 00:01:35.066 SO libspdk_bdev_aio.so.5.0 00:01:35.066 SYMLINK libspdk_bdev_gpt.so 00:01:35.066 SYMLINK libspdk_bdev_passthru.so 00:01:35.066 SYMLINK libspdk_bdev_zone_block.so 00:01:35.066 LIB libspdk_bdev_iscsi.a 00:01:35.066 SO libspdk_bdev_malloc.so.5.0 00:01:35.066 SO libspdk_bdev_iscsi.so.5.0 00:01:35.066 SYMLINK libspdk_bdev_delay.so 00:01:35.066 SYMLINK libspdk_bdev_aio.so 00:01:35.325 SYMLINK libspdk_bdev_malloc.so 00:01:35.325 SYMLINK libspdk_bdev_iscsi.so 00:01:35.325 LIB libspdk_bdev_lvol.a 00:01:35.325 SO libspdk_bdev_lvol.so.5.0 00:01:35.325 LIB libspdk_bdev_virtio.a 00:01:35.325 SYMLINK libspdk_bdev_lvol.so 00:01:35.325 SO libspdk_bdev_virtio.so.5.0 00:01:35.325 SYMLINK libspdk_bdev_virtio.so 00:01:35.584 LIB libspdk_bdev_raid.a 00:01:35.584 SO libspdk_bdev_raid.so.5.0 00:01:35.853 SYMLINK libspdk_bdev_raid.so 00:01:36.843 LIB libspdk_bdev_nvme.a 00:01:36.843 SO libspdk_bdev_nvme.so.6.0 00:01:36.843 SYMLINK libspdk_bdev_nvme.so 00:01:37.101 CC module/event/subsystems/vmd/vmd.o 00:01:37.101 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:37.101 CC module/event/subsystems/iobuf/iobuf.o 00:01:37.101 CC module/event/subsystems/sock/sock.o 00:01:37.101 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:37.102 CC module/event/subsystems/scheduler/scheduler.o 00:01:37.102 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:37.360 LIB libspdk_event_sock.a 00:01:37.360 LIB libspdk_event_vhost_blk.a 00:01:37.360 LIB libspdk_event_scheduler.a 00:01:37.360 LIB libspdk_event_vmd.a 00:01:37.360 SO libspdk_event_sock.so.4.0 00:01:37.360 LIB libspdk_event_iobuf.a 00:01:37.360 SO libspdk_event_vhost_blk.so.2.0 00:01:37.360 SO libspdk_event_scheduler.so.3.0 00:01:37.360 SO libspdk_event_vmd.so.5.0 00:01:37.360 SO libspdk_event_iobuf.so.2.0 00:01:37.360 SYMLINK libspdk_event_sock.so 00:01:37.360 SYMLINK libspdk_event_vhost_blk.so 00:01:37.360 SYMLINK libspdk_event_scheduler.so 00:01:37.360 SYMLINK libspdk_event_vmd.so 00:01:37.360 SYMLINK libspdk_event_iobuf.so 00:01:37.360 CC module/event/subsystems/accel/accel.o 00:01:37.618 LIB libspdk_event_accel.a 00:01:37.618 SO libspdk_event_accel.so.5.0 00:01:37.618 SYMLINK libspdk_event_accel.so 00:01:37.876 CC module/event/subsystems/bdev/bdev.o 00:01:37.876 LIB libspdk_event_bdev.a 00:01:38.134 SO libspdk_event_bdev.so.5.0 00:01:38.134 SYMLINK libspdk_event_bdev.so 00:01:38.134 CC module/event/subsystems/ublk/ublk.o 00:01:38.134 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:38.134 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:38.134 CC module/event/subsystems/nbd/nbd.o 00:01:38.134 CC module/event/subsystems/scsi/scsi.o 00:01:38.393 LIB libspdk_event_ublk.a 00:01:38.393 LIB libspdk_event_nbd.a 00:01:38.393 LIB libspdk_event_scsi.a 00:01:38.393 SO libspdk_event_ublk.so.2.0 00:01:38.393 SO libspdk_event_nbd.so.5.0 00:01:38.393 SO libspdk_event_scsi.so.5.0 00:01:38.393 SYMLINK libspdk_event_ublk.so 00:01:38.393 SYMLINK libspdk_event_nbd.so 00:01:38.393 SYMLINK libspdk_event_scsi.so 00:01:38.393 LIB libspdk_event_nvmf.a 00:01:38.393 SO libspdk_event_nvmf.so.5.0 00:01:38.393 SYMLINK libspdk_event_nvmf.so 00:01:38.393 CC module/event/subsystems/iscsi/iscsi.o 00:01:38.393 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:38.652 LIB libspdk_event_vhost_scsi.a 00:01:38.652 LIB libspdk_event_iscsi.a 00:01:38.652 SO libspdk_event_vhost_scsi.so.2.0 00:01:38.652 SO libspdk_event_iscsi.so.5.0 00:01:38.652 SYMLINK libspdk_event_vhost_scsi.so 00:01:38.652 SYMLINK libspdk_event_iscsi.so 00:01:38.914 SO libspdk.so.5.0 00:01:38.914 SYMLINK libspdk.so 00:01:38.914 CC app/trace_record/trace_record.o 00:01:38.914 CC app/spdk_nvme_perf/perf.o 00:01:38.914 CXX app/trace/trace.o 00:01:38.914 CC app/spdk_lspci/spdk_lspci.o 00:01:38.914 CC app/spdk_nvme_identify/identify.o 00:01:38.914 CC app/spdk_top/spdk_top.o 00:01:38.914 CC app/spdk_nvme_discover/discovery_aer.o 00:01:38.914 TEST_HEADER include/spdk/accel.h 00:01:38.914 CC test/rpc_client/rpc_client_test.o 00:01:38.914 TEST_HEADER include/spdk/accel_module.h 00:01:38.914 TEST_HEADER include/spdk/assert.h 00:01:38.914 TEST_HEADER include/spdk/barrier.h 00:01:38.914 TEST_HEADER include/spdk/base64.h 00:01:38.914 TEST_HEADER include/spdk/bdev.h 00:01:38.914 TEST_HEADER include/spdk/bdev_module.h 00:01:38.914 TEST_HEADER include/spdk/bdev_zone.h 00:01:38.914 TEST_HEADER include/spdk/bit_array.h 00:01:38.914 TEST_HEADER include/spdk/bit_pool.h 00:01:38.914 TEST_HEADER include/spdk/blob_bdev.h 00:01:38.914 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:38.914 TEST_HEADER include/spdk/blobfs.h 00:01:38.914 CC app/spdk_dd/spdk_dd.o 00:01:38.914 TEST_HEADER include/spdk/blob.h 00:01:38.914 TEST_HEADER include/spdk/conf.h 00:01:38.914 TEST_HEADER include/spdk/config.h 00:01:38.914 TEST_HEADER include/spdk/cpuset.h 00:01:38.914 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:38.914 TEST_HEADER include/spdk/crc16.h 00:01:38.914 CC app/iscsi_tgt/iscsi_tgt.o 00:01:38.914 TEST_HEADER include/spdk/crc32.h 00:01:38.914 TEST_HEADER include/spdk/crc64.h 00:01:38.914 TEST_HEADER include/spdk/dif.h 00:01:39.177 CC examples/sock/hello_world/hello_sock.o 00:01:39.177 TEST_HEADER include/spdk/dma.h 00:01:39.177 CC app/nvmf_tgt/nvmf_main.o 00:01:39.177 TEST_HEADER include/spdk/endian.h 00:01:39.177 TEST_HEADER include/spdk/env_dpdk.h 00:01:39.177 CC examples/ioat/perf/perf.o 00:01:39.177 TEST_HEADER include/spdk/env.h 00:01:39.177 CC examples/util/zipf/zipf.o 00:01:39.177 CC app/vhost/vhost.o 00:01:39.177 CC examples/accel/perf/accel_perf.o 00:01:39.177 CC examples/vmd/lsvmd/lsvmd.o 00:01:39.177 CC examples/ioat/verify/verify.o 00:01:39.177 CC examples/idxd/perf/perf.o 00:01:39.177 TEST_HEADER include/spdk/event.h 00:01:39.177 CC examples/nvme/reconnect/reconnect.o 00:01:39.177 TEST_HEADER include/spdk/fd_group.h 00:01:39.177 CC app/fio/nvme/fio_plugin.o 00:01:39.177 CC test/env/vtophys/vtophys.o 00:01:39.177 TEST_HEADER include/spdk/fd.h 00:01:39.177 CC examples/vmd/led/led.o 00:01:39.177 CC examples/nvme/hotplug/hotplug.o 00:01:39.177 CC examples/nvme/arbitration/arbitration.o 00:01:39.177 TEST_HEADER include/spdk/file.h 00:01:39.177 TEST_HEADER include/spdk/ftl.h 00:01:39.177 CC test/nvme/aer/aer.o 00:01:39.177 CC test/event/event_perf/event_perf.o 00:01:39.177 CC examples/nvme/hello_world/hello_world.o 00:01:39.177 CC test/thread/poller_perf/poller_perf.o 00:01:39.177 TEST_HEADER include/spdk/gpt_spec.h 00:01:39.177 CC app/spdk_tgt/spdk_tgt.o 00:01:39.177 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:39.177 TEST_HEADER include/spdk/hexlify.h 00:01:39.177 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:39.177 TEST_HEADER include/spdk/histogram_data.h 00:01:39.177 TEST_HEADER include/spdk/idxd.h 00:01:39.177 TEST_HEADER include/spdk/idxd_spec.h 00:01:39.177 TEST_HEADER include/spdk/init.h 00:01:39.177 TEST_HEADER include/spdk/ioat.h 00:01:39.177 TEST_HEADER include/spdk/ioat_spec.h 00:01:39.177 TEST_HEADER include/spdk/iscsi_spec.h 00:01:39.177 TEST_HEADER include/spdk/json.h 00:01:39.178 CC examples/blob/cli/blobcli.o 00:01:39.178 TEST_HEADER include/spdk/jsonrpc.h 00:01:39.178 CC examples/blob/hello_world/hello_blob.o 00:01:39.178 TEST_HEADER include/spdk/likely.h 00:01:39.178 TEST_HEADER include/spdk/log.h 00:01:39.178 CC examples/bdev/hello_world/hello_bdev.o 00:01:39.178 TEST_HEADER include/spdk/lvol.h 00:01:39.178 CC examples/nvmf/nvmf/nvmf.o 00:01:39.178 CC test/bdev/bdevio/bdevio.o 00:01:39.178 TEST_HEADER include/spdk/memory.h 00:01:39.178 CC app/fio/bdev/fio_plugin.o 00:01:39.178 CC examples/thread/thread/thread_ex.o 00:01:39.178 CC examples/bdev/bdevperf/bdevperf.o 00:01:39.178 CC test/accel/dif/dif.o 00:01:39.178 TEST_HEADER include/spdk/mmio.h 00:01:39.178 CC test/blobfs/mkfs/mkfs.o 00:01:39.178 TEST_HEADER include/spdk/nbd.h 00:01:39.178 TEST_HEADER include/spdk/notify.h 00:01:39.178 CC test/app/bdev_svc/bdev_svc.o 00:01:39.178 CC test/dma/test_dma/test_dma.o 00:01:39.178 TEST_HEADER include/spdk/nvme.h 00:01:39.178 TEST_HEADER include/spdk/nvme_intel.h 00:01:39.178 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:39.178 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:39.178 CC test/env/mem_callbacks/mem_callbacks.o 00:01:39.178 TEST_HEADER include/spdk/nvme_spec.h 00:01:39.178 TEST_HEADER include/spdk/nvme_zns.h 00:01:39.178 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:39.178 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:39.178 TEST_HEADER include/spdk/nvmf.h 00:01:39.178 TEST_HEADER include/spdk/nvmf_spec.h 00:01:39.178 TEST_HEADER include/spdk/nvmf_transport.h 00:01:39.178 TEST_HEADER include/spdk/opal.h 00:01:39.178 CC test/lvol/esnap/esnap.o 00:01:39.178 TEST_HEADER include/spdk/opal_spec.h 00:01:39.178 TEST_HEADER include/spdk/pci_ids.h 00:01:39.178 TEST_HEADER include/spdk/pipe.h 00:01:39.178 TEST_HEADER include/spdk/queue.h 00:01:39.178 TEST_HEADER include/spdk/reduce.h 00:01:39.178 TEST_HEADER include/spdk/rpc.h 00:01:39.178 TEST_HEADER include/spdk/scheduler.h 00:01:39.178 TEST_HEADER include/spdk/scsi.h 00:01:39.178 TEST_HEADER include/spdk/scsi_spec.h 00:01:39.178 TEST_HEADER include/spdk/sock.h 00:01:39.178 TEST_HEADER include/spdk/stdinc.h 00:01:39.178 TEST_HEADER include/spdk/string.h 00:01:39.178 TEST_HEADER include/spdk/thread.h 00:01:39.178 TEST_HEADER include/spdk/trace.h 00:01:39.178 LINK spdk_lspci 00:01:39.178 TEST_HEADER include/spdk/trace_parser.h 00:01:39.178 TEST_HEADER include/spdk/tree.h 00:01:39.178 TEST_HEADER include/spdk/ublk.h 00:01:39.178 TEST_HEADER include/spdk/util.h 00:01:39.178 TEST_HEADER include/spdk/uuid.h 00:01:39.178 TEST_HEADER include/spdk/version.h 00:01:39.178 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:39.178 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:39.178 TEST_HEADER include/spdk/vhost.h 00:01:39.178 TEST_HEADER include/spdk/vmd.h 00:01:39.178 TEST_HEADER include/spdk/xor.h 00:01:39.178 TEST_HEADER include/spdk/zipf.h 00:01:39.178 CXX test/cpp_headers/accel.o 00:01:39.442 LINK lsvmd 00:01:39.442 LINK rpc_client_test 00:01:39.442 LINK vtophys 00:01:39.442 LINK led 00:01:39.442 LINK spdk_nvme_discover 00:01:39.442 LINK poller_perf 00:01:39.442 LINK zipf 00:01:39.442 LINK event_perf 00:01:39.442 LINK interrupt_tgt 00:01:39.442 LINK nvmf_tgt 00:01:39.442 LINK vhost 00:01:39.442 LINK iscsi_tgt 00:01:39.442 LINK spdk_trace_record 00:01:39.442 LINK cmb_copy 00:01:39.442 LINK ioat_perf 00:01:39.442 LINK spdk_tgt 00:01:39.442 LINK verify 00:01:39.442 LINK bdev_svc 00:01:39.442 LINK hello_sock 00:01:39.442 LINK hello_world 00:01:39.442 LINK mkfs 00:01:39.442 LINK hotplug 00:01:39.442 LINK hello_blob 00:01:39.705 LINK hello_bdev 00:01:39.705 LINK thread 00:01:39.705 LINK aer 00:01:39.705 CXX test/cpp_headers/accel_module.o 00:01:39.705 CC examples/nvme/abort/abort.o 00:01:39.705 LINK nvmf 00:01:39.705 CXX test/cpp_headers/assert.o 00:01:39.705 LINK arbitration 00:01:39.705 LINK idxd_perf 00:01:39.705 LINK reconnect 00:01:39.705 LINK spdk_dd 00:01:39.705 CC test/event/reactor/reactor.o 00:01:39.705 CC test/event/reactor_perf/reactor_perf.o 00:01:39.705 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:39.705 CC test/app/histogram_perf/histogram_perf.o 00:01:39.705 CC test/nvme/reset/reset.o 00:01:39.705 LINK spdk_trace 00:01:39.705 CC test/event/app_repeat/app_repeat.o 00:01:39.705 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:39.705 LINK dif 00:01:39.967 CXX test/cpp_headers/barrier.o 00:01:39.967 LINK test_dma 00:01:39.967 LINK bdevio 00:01:39.967 CC test/nvme/sgl/sgl.o 00:01:39.967 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:39.967 CC test/nvme/e2edp/nvme_dp.o 00:01:39.967 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:39.967 CXX test/cpp_headers/base64.o 00:01:39.967 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:39.967 CC test/app/jsoncat/jsoncat.o 00:01:39.967 CC test/env/memory/memory_ut.o 00:01:39.967 LINK accel_perf 00:01:39.967 CXX test/cpp_headers/bdev.o 00:01:39.967 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:39.967 CC test/nvme/overhead/overhead.o 00:01:39.967 CC test/nvme/err_injection/err_injection.o 00:01:39.967 CC test/nvme/startup/startup.o 00:01:39.967 CXX test/cpp_headers/bdev_module.o 00:01:39.967 CC test/event/scheduler/scheduler.o 00:01:39.967 LINK nvme_manage 00:01:39.967 LINK reactor_perf 00:01:39.967 LINK reactor 00:01:39.967 CC test/nvme/reserve/reserve.o 00:01:39.967 LINK blobcli 00:01:39.967 CC test/env/pci/pci_ut.o 00:01:39.967 LINK app_repeat 00:01:39.967 CC test/app/stub/stub.o 00:01:39.967 LINK histogram_perf 00:01:40.232 LINK env_dpdk_post_init 00:01:40.232 LINK spdk_nvme 00:01:40.232 CC test/nvme/simple_copy/simple_copy.o 00:01:40.232 CC test/nvme/connect_stress/connect_stress.o 00:01:40.232 CC test/nvme/boot_partition/boot_partition.o 00:01:40.232 LINK spdk_bdev 00:01:40.232 CC test/nvme/compliance/nvme_compliance.o 00:01:40.232 CC test/nvme/fused_ordering/fused_ordering.o 00:01:40.232 CXX test/cpp_headers/bdev_zone.o 00:01:40.232 LINK pmr_persistence 00:01:40.232 LINK jsoncat 00:01:40.232 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:40.232 CXX test/cpp_headers/bit_array.o 00:01:40.232 CXX test/cpp_headers/bit_pool.o 00:01:40.232 CXX test/cpp_headers/blob_bdev.o 00:01:40.232 CXX test/cpp_headers/blobfs_bdev.o 00:01:40.232 CC test/nvme/fdp/fdp.o 00:01:40.232 CXX test/cpp_headers/blobfs.o 00:01:40.232 CXX test/cpp_headers/blob.o 00:01:40.232 CC test/nvme/cuse/cuse.o 00:01:40.232 LINK reset 00:01:40.232 LINK startup 00:01:40.232 CXX test/cpp_headers/conf.o 00:01:40.232 LINK err_injection 00:01:40.232 LINK sgl 00:01:40.232 CXX test/cpp_headers/config.o 00:01:40.232 CXX test/cpp_headers/cpuset.o 00:01:40.232 CXX test/cpp_headers/crc16.o 00:01:40.495 LINK abort 00:01:40.495 CXX test/cpp_headers/crc32.o 00:01:40.495 CXX test/cpp_headers/crc64.o 00:01:40.495 LINK nvme_dp 00:01:40.495 CXX test/cpp_headers/dif.o 00:01:40.495 LINK mem_callbacks 00:01:40.495 CXX test/cpp_headers/dma.o 00:01:40.495 LINK stub 00:01:40.495 CXX test/cpp_headers/endian.o 00:01:40.495 CXX test/cpp_headers/env_dpdk.o 00:01:40.495 CXX test/cpp_headers/env.o 00:01:40.495 LINK scheduler 00:01:40.495 LINK boot_partition 00:01:40.495 CXX test/cpp_headers/event.o 00:01:40.495 LINK reserve 00:01:40.495 CXX test/cpp_headers/fd_group.o 00:01:40.495 LINK spdk_nvme_perf 00:01:40.495 LINK connect_stress 00:01:40.495 CXX test/cpp_headers/fd.o 00:01:40.495 LINK overhead 00:01:40.495 LINK simple_copy 00:01:40.495 LINK fused_ordering 00:01:40.495 LINK spdk_nvme_identify 00:01:40.495 CXX test/cpp_headers/file.o 00:01:40.495 LINK doorbell_aers 00:01:40.495 LINK bdevperf 00:01:40.495 CXX test/cpp_headers/ftl.o 00:01:40.495 CXX test/cpp_headers/gpt_spec.o 00:01:40.760 CXX test/cpp_headers/hexlify.o 00:01:40.760 LINK nvme_fuzz 00:01:40.760 CXX test/cpp_headers/histogram_data.o 00:01:40.760 CXX test/cpp_headers/idxd.o 00:01:40.760 CXX test/cpp_headers/idxd_spec.o 00:01:40.760 CXX test/cpp_headers/init.o 00:01:40.760 CXX test/cpp_headers/ioat.o 00:01:40.760 LINK spdk_top 00:01:40.760 CXX test/cpp_headers/ioat_spec.o 00:01:40.760 CXX test/cpp_headers/iscsi_spec.o 00:01:40.760 CXX test/cpp_headers/json.o 00:01:40.760 CXX test/cpp_headers/jsonrpc.o 00:01:40.760 CXX test/cpp_headers/likely.o 00:01:40.760 CXX test/cpp_headers/log.o 00:01:40.760 CXX test/cpp_headers/lvol.o 00:01:40.760 LINK nvme_compliance 00:01:40.760 CXX test/cpp_headers/memory.o 00:01:40.760 CXX test/cpp_headers/mmio.o 00:01:40.760 CXX test/cpp_headers/nbd.o 00:01:40.760 LINK vhost_fuzz 00:01:40.760 CXX test/cpp_headers/notify.o 00:01:40.760 CXX test/cpp_headers/nvme.o 00:01:40.760 CXX test/cpp_headers/nvme_intel.o 00:01:40.760 CXX test/cpp_headers/nvme_ocssd.o 00:01:40.760 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:40.760 CXX test/cpp_headers/nvme_spec.o 00:01:40.760 CXX test/cpp_headers/nvme_zns.o 00:01:40.760 CXX test/cpp_headers/nvmf_cmd.o 00:01:40.760 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:40.760 CXX test/cpp_headers/nvmf.o 00:01:40.760 CXX test/cpp_headers/nvmf_spec.o 00:01:40.760 CXX test/cpp_headers/nvmf_transport.o 00:01:40.760 CXX test/cpp_headers/opal.o 00:01:40.760 CXX test/cpp_headers/opal_spec.o 00:01:40.760 LINK pci_ut 00:01:40.760 CXX test/cpp_headers/pci_ids.o 00:01:40.760 LINK fdp 00:01:40.760 CXX test/cpp_headers/pipe.o 00:01:40.760 CXX test/cpp_headers/queue.o 00:01:41.022 CXX test/cpp_headers/reduce.o 00:01:41.022 CXX test/cpp_headers/rpc.o 00:01:41.022 CXX test/cpp_headers/scheduler.o 00:01:41.022 CXX test/cpp_headers/scsi.o 00:01:41.022 CXX test/cpp_headers/scsi_spec.o 00:01:41.022 CXX test/cpp_headers/sock.o 00:01:41.022 CXX test/cpp_headers/stdinc.o 00:01:41.022 CXX test/cpp_headers/string.o 00:01:41.022 CXX test/cpp_headers/thread.o 00:01:41.022 CXX test/cpp_headers/trace.o 00:01:41.022 CXX test/cpp_headers/trace_parser.o 00:01:41.022 CXX test/cpp_headers/tree.o 00:01:41.022 CXX test/cpp_headers/ublk.o 00:01:41.022 CXX test/cpp_headers/util.o 00:01:41.022 CXX test/cpp_headers/uuid.o 00:01:41.022 CXX test/cpp_headers/version.o 00:01:41.022 CXX test/cpp_headers/vfio_user_pci.o 00:01:41.022 CXX test/cpp_headers/vfio_user_spec.o 00:01:41.022 CXX test/cpp_headers/vhost.o 00:01:41.022 CXX test/cpp_headers/vmd.o 00:01:41.022 CXX test/cpp_headers/xor.o 00:01:41.022 CXX test/cpp_headers/zipf.o 00:01:41.589 LINK memory_ut 00:01:41.847 LINK cuse 00:01:42.415 LINK iscsi_fuzz 00:01:44.946 LINK esnap 00:01:44.946 00:01:44.946 real 0m46.308s 00:01:44.946 user 9m38.954s 00:01:44.946 sys 2m9.738s 00:01:44.946 12:29:17 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:44.946 12:29:17 -- common/autotest_common.sh@10 -- $ set +x 00:01:44.946 ************************************ 00:01:44.946 END TEST make 00:01:44.946 ************************************ 00:01:44.946 12:29:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:01:44.946 12:29:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:01:44.946 12:29:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:01:44.946 12:29:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:01:44.946 12:29:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:01:44.946 12:29:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:01:44.947 12:29:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:01:44.947 12:29:17 -- scripts/common.sh@335 -- # IFS=.-: 00:01:44.947 12:29:17 -- scripts/common.sh@335 -- # read -ra ver1 00:01:44.947 12:29:17 -- scripts/common.sh@336 -- # IFS=.-: 00:01:44.947 12:29:17 -- scripts/common.sh@336 -- # read -ra ver2 00:01:44.947 12:29:17 -- scripts/common.sh@337 -- # local 'op=<' 00:01:44.947 12:29:17 -- scripts/common.sh@339 -- # ver1_l=2 00:01:44.947 12:29:17 -- scripts/common.sh@340 -- # ver2_l=1 00:01:44.947 12:29:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:01:44.947 12:29:17 -- scripts/common.sh@343 -- # case "$op" in 00:01:44.947 12:29:17 -- scripts/common.sh@344 -- # : 1 00:01:44.947 12:29:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:01:44.947 12:29:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:44.947 12:29:17 -- scripts/common.sh@364 -- # decimal 1 00:01:44.947 12:29:17 -- scripts/common.sh@352 -- # local d=1 00:01:44.947 12:29:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:01:44.947 12:29:17 -- scripts/common.sh@354 -- # echo 1 00:01:44.947 12:29:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:01:44.947 12:29:17 -- scripts/common.sh@365 -- # decimal 2 00:01:44.947 12:29:17 -- scripts/common.sh@352 -- # local d=2 00:01:44.947 12:29:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:01:44.947 12:29:17 -- scripts/common.sh@354 -- # echo 2 00:01:44.947 12:29:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:01:44.947 12:29:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:01:44.947 12:29:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:01:44.947 12:29:17 -- scripts/common.sh@367 -- # return 0 00:01:44.947 12:29:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:01:44.947 12:29:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:01:44.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:44.947 --rc genhtml_branch_coverage=1 00:01:44.947 --rc genhtml_function_coverage=1 00:01:44.947 --rc genhtml_legend=1 00:01:44.947 --rc geninfo_all_blocks=1 00:01:44.947 --rc geninfo_unexecuted_blocks=1 00:01:44.947 00:01:44.947 ' 00:01:44.947 12:29:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:01:44.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:44.947 --rc genhtml_branch_coverage=1 00:01:44.947 --rc genhtml_function_coverage=1 00:01:44.947 --rc genhtml_legend=1 00:01:44.947 --rc geninfo_all_blocks=1 00:01:44.947 --rc geninfo_unexecuted_blocks=1 00:01:44.947 00:01:44.947 ' 00:01:44.947 12:29:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:01:44.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:44.947 --rc genhtml_branch_coverage=1 00:01:44.947 --rc genhtml_function_coverage=1 00:01:44.947 --rc genhtml_legend=1 00:01:44.947 --rc geninfo_all_blocks=1 00:01:44.947 --rc geninfo_unexecuted_blocks=1 00:01:44.947 00:01:44.947 ' 00:01:44.947 12:29:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:01:44.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:44.947 --rc genhtml_branch_coverage=1 00:01:44.947 --rc genhtml_function_coverage=1 00:01:44.947 --rc genhtml_legend=1 00:01:44.947 --rc geninfo_all_blocks=1 00:01:44.947 --rc geninfo_unexecuted_blocks=1 00:01:44.947 00:01:44.947 ' 00:01:44.947 12:29:17 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:01:44.947 12:29:17 -- nvmf/common.sh@7 -- # uname -s 00:01:44.947 12:29:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:44.947 12:29:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:44.947 12:29:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:44.947 12:29:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:44.947 12:29:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:44.947 12:29:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:44.947 12:29:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:44.947 12:29:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:44.947 12:29:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:44.947 12:29:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:44.947 12:29:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:01:44.947 12:29:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:01:44.947 12:29:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:44.947 12:29:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:44.947 12:29:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:44.947 12:29:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:44.947 12:29:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:44.947 12:29:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:44.947 12:29:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:44.947 12:29:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:44.947 12:29:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:44.947 12:29:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:44.947 12:29:17 -- paths/export.sh@5 -- # export PATH 00:01:44.947 12:29:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:44.947 12:29:17 -- nvmf/common.sh@46 -- # : 0 00:01:44.947 12:29:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:01:44.947 12:29:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:01:44.947 12:29:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:01:44.947 12:29:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:44.947 12:29:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:44.947 12:29:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:01:44.947 12:29:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:01:44.947 12:29:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:01:44.947 12:29:17 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:44.947 12:29:17 -- spdk/autotest.sh@32 -- # uname -s 00:01:44.947 12:29:17 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:44.947 12:29:17 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:44.947 12:29:17 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:44.947 12:29:17 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:44.947 12:29:17 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:44.947 12:29:17 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:44.947 12:29:17 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:44.947 12:29:17 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:44.947 12:29:17 -- spdk/autotest.sh@48 -- # udevadm_pid=3366815 00:01:44.947 12:29:17 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:44.947 12:29:17 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:44.947 12:29:17 -- spdk/autotest.sh@54 -- # echo 3366817 00:01:44.947 12:29:17 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:44.947 12:29:17 -- spdk/autotest.sh@56 -- # echo 3366818 00:01:44.947 12:29:17 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:01:44.947 12:29:17 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:44.947 12:29:17 -- spdk/autotest.sh@60 -- # echo 3366819 00:01:44.948 12:29:17 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:44.948 12:29:17 -- spdk/autotest.sh@62 -- # echo 3366820 00:01:44.948 12:29:17 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:44.948 12:29:17 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:44.948 12:29:17 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:01:44.948 12:29:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:01:44.948 12:29:17 -- common/autotest_common.sh@10 -- # set +x 00:01:44.948 12:29:17 -- spdk/autotest.sh@70 -- # create_test_list 00:01:44.948 12:29:17 -- common/autotest_common.sh@746 -- # xtrace_disable 00:01:44.948 12:29:17 -- common/autotest_common.sh@10 -- # set +x 00:01:44.948 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:01:44.948 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:01:44.948 12:29:17 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:01:44.948 12:29:17 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:44.948 12:29:17 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:44.948 12:29:17 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:44.948 12:29:17 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:44.948 12:29:17 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:01:44.948 12:29:17 -- common/autotest_common.sh@1450 -- # uname 00:01:44.948 12:29:18 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:01:44.948 12:29:18 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:01:44.948 12:29:18 -- common/autotest_common.sh@1470 -- # uname 00:01:44.948 12:29:18 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:01:44.948 12:29:18 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:01:44.948 12:29:18 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:01:45.238 lcov: LCOV version 1.15 00:01:45.238 12:29:18 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:01:48.516 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:01:48.516 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:01:48.516 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:01:48.516 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:01:48.516 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:01:48.516 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:20.586 12:29:50 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:20.586 12:29:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:20.586 12:29:50 -- common/autotest_common.sh@10 -- # set +x 00:02:20.586 12:29:50 -- spdk/autotest.sh@89 -- # rm -f 00:02:20.586 12:29:50 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:20.586 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:20.586 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:20.586 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:20.586 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:20.587 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:20.587 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:20.587 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:20.587 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:20.587 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:20.587 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:20.587 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:20.587 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:20.587 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:20.587 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:20.587 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:20.587 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:20.587 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:20.587 12:29:52 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:20.587 12:29:52 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:20.587 12:29:52 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:20.587 12:29:52 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:20.587 12:29:52 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:20.587 12:29:52 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:20.587 12:29:52 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:20.587 12:29:52 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:20.587 12:29:52 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:20.587 12:29:52 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:20.587 12:29:52 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:20.587 12:29:52 -- spdk/autotest.sh@108 -- # grep -v p 00:02:20.587 12:29:52 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:20.587 12:29:52 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:20.587 12:29:52 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:20.587 12:29:52 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:20.587 12:29:52 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:20.587 No valid GPT data, bailing 00:02:20.587 12:29:52 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:20.587 12:29:52 -- scripts/common.sh@393 -- # pt= 00:02:20.587 12:29:52 -- scripts/common.sh@394 -- # return 1 00:02:20.587 12:29:52 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:20.587 1+0 records in 00:02:20.587 1+0 records out 00:02:20.587 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0023526 s, 446 MB/s 00:02:20.587 12:29:52 -- spdk/autotest.sh@116 -- # sync 00:02:20.587 12:29:52 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:20.587 12:29:52 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:20.587 12:29:52 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:20.845 12:29:53 -- spdk/autotest.sh@122 -- # uname -s 00:02:20.845 12:29:53 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:20.845 12:29:53 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:20.845 12:29:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:20.845 12:29:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:20.845 12:29:53 -- common/autotest_common.sh@10 -- # set +x 00:02:20.845 ************************************ 00:02:20.845 START TEST setup.sh 00:02:20.845 ************************************ 00:02:20.845 12:29:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:20.845 * Looking for test storage... 00:02:20.845 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:20.845 12:29:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:20.845 12:29:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:20.845 12:29:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:21.104 12:29:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:21.104 12:29:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:21.104 12:29:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:21.104 12:29:54 -- scripts/common.sh@335 -- # IFS=.-: 00:02:21.104 12:29:54 -- scripts/common.sh@335 -- # read -ra ver1 00:02:21.104 12:29:54 -- scripts/common.sh@336 -- # IFS=.-: 00:02:21.104 12:29:54 -- scripts/common.sh@336 -- # read -ra ver2 00:02:21.104 12:29:54 -- scripts/common.sh@337 -- # local 'op=<' 00:02:21.104 12:29:54 -- scripts/common.sh@339 -- # ver1_l=2 00:02:21.104 12:29:54 -- scripts/common.sh@340 -- # ver2_l=1 00:02:21.104 12:29:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:21.104 12:29:54 -- scripts/common.sh@343 -- # case "$op" in 00:02:21.104 12:29:54 -- scripts/common.sh@344 -- # : 1 00:02:21.104 12:29:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:21.104 12:29:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:21.104 12:29:54 -- scripts/common.sh@364 -- # decimal 1 00:02:21.104 12:29:54 -- scripts/common.sh@352 -- # local d=1 00:02:21.104 12:29:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:21.104 12:29:54 -- scripts/common.sh@354 -- # echo 1 00:02:21.104 12:29:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:21.104 12:29:54 -- scripts/common.sh@365 -- # decimal 2 00:02:21.104 12:29:54 -- scripts/common.sh@352 -- # local d=2 00:02:21.104 12:29:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:21.104 12:29:54 -- scripts/common.sh@354 -- # echo 2 00:02:21.104 12:29:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:21.104 12:29:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:21.104 12:29:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:21.104 12:29:54 -- scripts/common.sh@367 -- # return 0 00:02:21.104 12:29:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:21.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.104 --rc genhtml_branch_coverage=1 00:02:21.104 --rc genhtml_function_coverage=1 00:02:21.104 --rc genhtml_legend=1 00:02:21.104 --rc geninfo_all_blocks=1 00:02:21.104 --rc geninfo_unexecuted_blocks=1 00:02:21.104 00:02:21.104 ' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:21.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.104 --rc genhtml_branch_coverage=1 00:02:21.104 --rc genhtml_function_coverage=1 00:02:21.104 --rc genhtml_legend=1 00:02:21.104 --rc geninfo_all_blocks=1 00:02:21.104 --rc geninfo_unexecuted_blocks=1 00:02:21.104 00:02:21.104 ' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:21.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.104 --rc genhtml_branch_coverage=1 00:02:21.104 --rc genhtml_function_coverage=1 00:02:21.104 --rc genhtml_legend=1 00:02:21.104 --rc geninfo_all_blocks=1 00:02:21.104 --rc geninfo_unexecuted_blocks=1 00:02:21.104 00:02:21.104 ' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:21.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.104 --rc genhtml_branch_coverage=1 00:02:21.104 --rc genhtml_function_coverage=1 00:02:21.104 --rc genhtml_legend=1 00:02:21.104 --rc geninfo_all_blocks=1 00:02:21.104 --rc geninfo_unexecuted_blocks=1 00:02:21.104 00:02:21.104 ' 00:02:21.104 12:29:54 -- setup/test-setup.sh@10 -- # uname -s 00:02:21.104 12:29:54 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:21.104 12:29:54 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:21.104 12:29:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:21.104 12:29:54 -- common/autotest_common.sh@10 -- # set +x 00:02:21.104 ************************************ 00:02:21.104 START TEST acl 00:02:21.104 ************************************ 00:02:21.104 12:29:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:21.104 * Looking for test storage... 00:02:21.104 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:21.104 12:29:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:21.104 12:29:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:21.104 12:29:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:21.104 12:29:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:21.104 12:29:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:21.104 12:29:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:21.104 12:29:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:21.104 12:29:54 -- scripts/common.sh@335 -- # IFS=.-: 00:02:21.104 12:29:54 -- scripts/common.sh@335 -- # read -ra ver1 00:02:21.104 12:29:54 -- scripts/common.sh@336 -- # IFS=.-: 00:02:21.104 12:29:54 -- scripts/common.sh@336 -- # read -ra ver2 00:02:21.104 12:29:54 -- scripts/common.sh@337 -- # local 'op=<' 00:02:21.104 12:29:54 -- scripts/common.sh@339 -- # ver1_l=2 00:02:21.104 12:29:54 -- scripts/common.sh@340 -- # ver2_l=1 00:02:21.104 12:29:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:21.104 12:29:54 -- scripts/common.sh@343 -- # case "$op" in 00:02:21.104 12:29:54 -- scripts/common.sh@344 -- # : 1 00:02:21.104 12:29:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:21.104 12:29:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:21.104 12:29:54 -- scripts/common.sh@364 -- # decimal 1 00:02:21.104 12:29:54 -- scripts/common.sh@352 -- # local d=1 00:02:21.104 12:29:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:21.104 12:29:54 -- scripts/common.sh@354 -- # echo 1 00:02:21.104 12:29:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:21.104 12:29:54 -- scripts/common.sh@365 -- # decimal 2 00:02:21.104 12:29:54 -- scripts/common.sh@352 -- # local d=2 00:02:21.105 12:29:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:21.105 12:29:54 -- scripts/common.sh@354 -- # echo 2 00:02:21.105 12:29:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:21.105 12:29:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:21.105 12:29:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:21.105 12:29:54 -- scripts/common.sh@367 -- # return 0 00:02:21.105 12:29:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:21.105 12:29:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:21.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.105 --rc genhtml_branch_coverage=1 00:02:21.105 --rc genhtml_function_coverage=1 00:02:21.105 --rc genhtml_legend=1 00:02:21.105 --rc geninfo_all_blocks=1 00:02:21.105 --rc geninfo_unexecuted_blocks=1 00:02:21.105 00:02:21.105 ' 00:02:21.105 12:29:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:21.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.105 --rc genhtml_branch_coverage=1 00:02:21.105 --rc genhtml_function_coverage=1 00:02:21.105 --rc genhtml_legend=1 00:02:21.105 --rc geninfo_all_blocks=1 00:02:21.105 --rc geninfo_unexecuted_blocks=1 00:02:21.105 00:02:21.105 ' 00:02:21.105 12:29:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:21.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.105 --rc genhtml_branch_coverage=1 00:02:21.105 --rc genhtml_function_coverage=1 00:02:21.105 --rc genhtml_legend=1 00:02:21.105 --rc geninfo_all_blocks=1 00:02:21.105 --rc geninfo_unexecuted_blocks=1 00:02:21.105 00:02:21.105 ' 00:02:21.105 12:29:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:21.105 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.105 --rc genhtml_branch_coverage=1 00:02:21.105 --rc genhtml_function_coverage=1 00:02:21.105 --rc genhtml_legend=1 00:02:21.105 --rc geninfo_all_blocks=1 00:02:21.105 --rc geninfo_unexecuted_blocks=1 00:02:21.105 00:02:21.105 ' 00:02:21.105 12:29:54 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:21.105 12:29:54 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:21.105 12:29:54 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:21.105 12:29:54 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:21.105 12:29:54 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:21.105 12:29:54 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:21.105 12:29:54 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:21.105 12:29:54 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:21.105 12:29:54 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:21.105 12:29:54 -- setup/acl.sh@12 -- # devs=() 00:02:21.105 12:29:54 -- setup/acl.sh@12 -- # declare -a devs 00:02:21.105 12:29:54 -- setup/acl.sh@13 -- # drivers=() 00:02:21.105 12:29:54 -- setup/acl.sh@13 -- # declare -A drivers 00:02:21.105 12:29:54 -- setup/acl.sh@51 -- # setup reset 00:02:21.105 12:29:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:21.105 12:29:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:22.480 12:29:55 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:22.480 12:29:55 -- setup/acl.sh@16 -- # local dev driver 00:02:22.480 12:29:55 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.480 12:29:55 -- setup/acl.sh@15 -- # setup output status 00:02:22.480 12:29:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:22.480 12:29:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:23.857 Hugepages 00:02:23.857 node hugesize free / total 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 00:02:23.857 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.857 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.857 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:23.857 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.858 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.858 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.858 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.858 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.858 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.858 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # continue 00:02:23.858 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.858 12:29:56 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:23.858 12:29:56 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:23.858 12:29:56 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:23.858 12:29:56 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:23.858 12:29:56 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:23.858 12:29:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:23.858 12:29:56 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:23.858 12:29:56 -- setup/acl.sh@54 -- # run_test denied denied 00:02:23.858 12:29:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:23.858 12:29:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:23.858 12:29:56 -- common/autotest_common.sh@10 -- # set +x 00:02:23.858 ************************************ 00:02:23.858 START TEST denied 00:02:23.858 ************************************ 00:02:23.858 12:29:56 -- common/autotest_common.sh@1114 -- # denied 00:02:23.858 12:29:56 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:23.858 12:29:56 -- setup/acl.sh@38 -- # setup output config 00:02:23.858 12:29:56 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:23.858 12:29:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:23.858 12:29:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:25.234 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:02:25.234 12:29:58 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:02:25.234 12:29:58 -- setup/acl.sh@28 -- # local dev driver 00:02:25.234 12:29:58 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:25.234 12:29:58 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:02:25.234 12:29:58 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:02:25.234 12:29:58 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:25.234 12:29:58 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:25.234 12:29:58 -- setup/acl.sh@41 -- # setup reset 00:02:25.234 12:29:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:25.234 12:29:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:27.768 00:02:27.768 real 0m3.988s 00:02:27.768 user 0m1.186s 00:02:27.768 sys 0m1.941s 00:02:27.768 12:30:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:27.768 12:30:00 -- common/autotest_common.sh@10 -- # set +x 00:02:27.768 ************************************ 00:02:27.768 END TEST denied 00:02:27.768 ************************************ 00:02:27.768 12:30:00 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:27.768 12:30:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:27.768 12:30:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:27.768 12:30:00 -- common/autotest_common.sh@10 -- # set +x 00:02:27.768 ************************************ 00:02:27.768 START TEST allowed 00:02:27.768 ************************************ 00:02:27.768 12:30:00 -- common/autotest_common.sh@1114 -- # allowed 00:02:27.768 12:30:00 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:02:27.768 12:30:00 -- setup/acl.sh@45 -- # setup output config 00:02:27.768 12:30:00 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:02:27.768 12:30:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:27.768 12:30:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:30.301 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:30.301 12:30:03 -- setup/acl.sh@47 -- # verify 00:02:30.301 12:30:03 -- setup/acl.sh@28 -- # local dev driver 00:02:30.301 12:30:03 -- setup/acl.sh@48 -- # setup reset 00:02:30.301 12:30:03 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:30.301 12:30:03 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:31.676 00:02:31.676 real 0m3.819s 00:02:31.676 user 0m0.986s 00:02:31.676 sys 0m1.707s 00:02:31.676 12:30:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:31.676 12:30:04 -- common/autotest_common.sh@10 -- # set +x 00:02:31.676 ************************************ 00:02:31.676 END TEST allowed 00:02:31.676 ************************************ 00:02:31.676 00:02:31.676 real 0m10.520s 00:02:31.676 user 0m3.285s 00:02:31.676 sys 0m5.334s 00:02:31.676 12:30:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:31.676 12:30:04 -- common/autotest_common.sh@10 -- # set +x 00:02:31.676 ************************************ 00:02:31.676 END TEST acl 00:02:31.676 ************************************ 00:02:31.676 12:30:04 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:31.676 12:30:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:31.676 12:30:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:31.676 12:30:04 -- common/autotest_common.sh@10 -- # set +x 00:02:31.676 ************************************ 00:02:31.676 START TEST hugepages 00:02:31.676 ************************************ 00:02:31.676 12:30:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:31.676 * Looking for test storage... 00:02:31.676 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:31.676 12:30:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:31.676 12:30:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:31.676 12:30:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:31.676 12:30:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:31.676 12:30:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:31.676 12:30:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:31.676 12:30:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:31.676 12:30:04 -- scripts/common.sh@335 -- # IFS=.-: 00:02:31.676 12:30:04 -- scripts/common.sh@335 -- # read -ra ver1 00:02:31.676 12:30:04 -- scripts/common.sh@336 -- # IFS=.-: 00:02:31.676 12:30:04 -- scripts/common.sh@336 -- # read -ra ver2 00:02:31.676 12:30:04 -- scripts/common.sh@337 -- # local 'op=<' 00:02:31.676 12:30:04 -- scripts/common.sh@339 -- # ver1_l=2 00:02:31.676 12:30:04 -- scripts/common.sh@340 -- # ver2_l=1 00:02:31.676 12:30:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:31.676 12:30:04 -- scripts/common.sh@343 -- # case "$op" in 00:02:31.676 12:30:04 -- scripts/common.sh@344 -- # : 1 00:02:31.676 12:30:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:31.676 12:30:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:31.676 12:30:04 -- scripts/common.sh@364 -- # decimal 1 00:02:31.676 12:30:04 -- scripts/common.sh@352 -- # local d=1 00:02:31.676 12:30:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:31.676 12:30:04 -- scripts/common.sh@354 -- # echo 1 00:02:31.676 12:30:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:31.676 12:30:04 -- scripts/common.sh@365 -- # decimal 2 00:02:31.676 12:30:04 -- scripts/common.sh@352 -- # local d=2 00:02:31.676 12:30:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:31.676 12:30:04 -- scripts/common.sh@354 -- # echo 2 00:02:31.676 12:30:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:31.676 12:30:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:31.676 12:30:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:31.676 12:30:04 -- scripts/common.sh@367 -- # return 0 00:02:31.676 12:30:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:31.676 12:30:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:31.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.676 --rc genhtml_branch_coverage=1 00:02:31.676 --rc genhtml_function_coverage=1 00:02:31.676 --rc genhtml_legend=1 00:02:31.676 --rc geninfo_all_blocks=1 00:02:31.676 --rc geninfo_unexecuted_blocks=1 00:02:31.676 00:02:31.676 ' 00:02:31.676 12:30:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:31.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.676 --rc genhtml_branch_coverage=1 00:02:31.676 --rc genhtml_function_coverage=1 00:02:31.676 --rc genhtml_legend=1 00:02:31.676 --rc geninfo_all_blocks=1 00:02:31.676 --rc geninfo_unexecuted_blocks=1 00:02:31.676 00:02:31.676 ' 00:02:31.676 12:30:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:31.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.676 --rc genhtml_branch_coverage=1 00:02:31.676 --rc genhtml_function_coverage=1 00:02:31.676 --rc genhtml_legend=1 00:02:31.676 --rc geninfo_all_blocks=1 00:02:31.676 --rc geninfo_unexecuted_blocks=1 00:02:31.676 00:02:31.676 ' 00:02:31.676 12:30:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:31.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.676 --rc genhtml_branch_coverage=1 00:02:31.676 --rc genhtml_function_coverage=1 00:02:31.676 --rc genhtml_legend=1 00:02:31.676 --rc geninfo_all_blocks=1 00:02:31.676 --rc geninfo_unexecuted_blocks=1 00:02:31.676 00:02:31.676 ' 00:02:31.676 12:30:04 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:31.676 12:30:04 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:31.676 12:30:04 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:31.676 12:30:04 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:31.676 12:30:04 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:31.676 12:30:04 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:31.676 12:30:04 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:31.676 12:30:04 -- setup/common.sh@18 -- # local node= 00:02:31.676 12:30:04 -- setup/common.sh@19 -- # local var val 00:02:31.676 12:30:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:31.676 12:30:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:31.676 12:30:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:31.676 12:30:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:31.676 12:30:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:31.676 12:30:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42472876 kB' 'MemAvailable: 46784600 kB' 'Buffers: 2708 kB' 'Cached: 10988928 kB' 'SwapCached: 0 kB' 'Active: 7396212 kB' 'Inactive: 4089812 kB' 'Active(anon): 6995092 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 497856 kB' 'Mapped: 193076 kB' 'Shmem: 6500704 kB' 'KReclaimable: 465424 kB' 'Slab: 1044564 kB' 'SReclaimable: 465424 kB' 'SUnreclaim: 579140 kB' 'KernelStack: 12992 kB' 'PageTables: 8580 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 8080912 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198848 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.676 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.676 12:30:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.677 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.677 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.678 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.678 12:30:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.678 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.678 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.678 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.678 12:30:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.678 12:30:04 -- setup/common.sh@32 -- # continue 00:02:31.678 12:30:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:31.678 12:30:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:31.678 12:30:04 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:31.678 12:30:04 -- setup/common.sh@33 -- # echo 2048 00:02:31.678 12:30:04 -- setup/common.sh@33 -- # return 0 00:02:31.678 12:30:04 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:31.678 12:30:04 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:31.678 12:30:04 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:31.678 12:30:04 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:31.678 12:30:04 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:31.678 12:30:04 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:31.678 12:30:04 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:31.678 12:30:04 -- setup/hugepages.sh@207 -- # get_nodes 00:02:31.678 12:30:04 -- setup/hugepages.sh@27 -- # local node 00:02:31.678 12:30:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:31.678 12:30:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:31.678 12:30:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:31.678 12:30:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:31.678 12:30:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:31.678 12:30:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:31.678 12:30:04 -- setup/hugepages.sh@208 -- # clear_hp 00:02:31.678 12:30:04 -- setup/hugepages.sh@37 -- # local node hp 00:02:31.678 12:30:04 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:31.678 12:30:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:31.678 12:30:04 -- setup/hugepages.sh@41 -- # echo 0 00:02:31.678 12:30:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:31.678 12:30:04 -- setup/hugepages.sh@41 -- # echo 0 00:02:31.678 12:30:04 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:31.678 12:30:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:31.678 12:30:04 -- setup/hugepages.sh@41 -- # echo 0 00:02:31.678 12:30:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:31.678 12:30:04 -- setup/hugepages.sh@41 -- # echo 0 00:02:31.678 12:30:04 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:31.678 12:30:04 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:31.678 12:30:04 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:31.678 12:30:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:31.678 12:30:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:31.678 12:30:04 -- common/autotest_common.sh@10 -- # set +x 00:02:31.935 ************************************ 00:02:31.935 START TEST default_setup 00:02:31.935 ************************************ 00:02:31.935 12:30:04 -- common/autotest_common.sh@1114 -- # default_setup 00:02:31.935 12:30:04 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:31.935 12:30:04 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:31.935 12:30:04 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:31.935 12:30:04 -- setup/hugepages.sh@51 -- # shift 00:02:31.935 12:30:04 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:31.935 12:30:04 -- setup/hugepages.sh@52 -- # local node_ids 00:02:31.936 12:30:04 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:31.936 12:30:04 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:31.936 12:30:04 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:31.936 12:30:04 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:31.936 12:30:04 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:31.936 12:30:04 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:31.936 12:30:04 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:31.936 12:30:04 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:31.936 12:30:04 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:31.936 12:30:04 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:31.936 12:30:04 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:31.936 12:30:04 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:31.936 12:30:04 -- setup/hugepages.sh@73 -- # return 0 00:02:31.936 12:30:04 -- setup/hugepages.sh@137 -- # setup output 00:02:31.936 12:30:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:31.936 12:30:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:32.870 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:32.870 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:32.870 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:33.129 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:34.072 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:34.072 12:30:07 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:34.072 12:30:07 -- setup/hugepages.sh@89 -- # local node 00:02:34.072 12:30:07 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:34.072 12:30:07 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:34.072 12:30:07 -- setup/hugepages.sh@92 -- # local surp 00:02:34.072 12:30:07 -- setup/hugepages.sh@93 -- # local resv 00:02:34.072 12:30:07 -- setup/hugepages.sh@94 -- # local anon 00:02:34.072 12:30:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:34.072 12:30:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:34.072 12:30:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:34.072 12:30:07 -- setup/common.sh@18 -- # local node= 00:02:34.072 12:30:07 -- setup/common.sh@19 -- # local var val 00:02:34.072 12:30:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:34.072 12:30:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:34.072 12:30:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:34.072 12:30:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:34.072 12:30:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:34.072 12:30:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44607512 kB' 'MemAvailable: 48919204 kB' 'Buffers: 2708 kB' 'Cached: 10989016 kB' 'SwapCached: 0 kB' 'Active: 7393776 kB' 'Inactive: 4089812 kB' 'Active(anon): 6992656 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495220 kB' 'Mapped: 191932 kB' 'Shmem: 6500792 kB' 'KReclaimable: 465392 kB' 'Slab: 1044096 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578704 kB' 'KernelStack: 13168 kB' 'PageTables: 8292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8083292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199004 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.072 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.072 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.073 12:30:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:34.073 12:30:07 -- setup/common.sh@33 -- # echo 0 00:02:34.073 12:30:07 -- setup/common.sh@33 -- # return 0 00:02:34.073 12:30:07 -- setup/hugepages.sh@97 -- # anon=0 00:02:34.073 12:30:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:34.073 12:30:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:34.073 12:30:07 -- setup/common.sh@18 -- # local node= 00:02:34.073 12:30:07 -- setup/common.sh@19 -- # local var val 00:02:34.073 12:30:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:34.073 12:30:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:34.073 12:30:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:34.073 12:30:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:34.073 12:30:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:34.073 12:30:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.073 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44604660 kB' 'MemAvailable: 48916352 kB' 'Buffers: 2708 kB' 'Cached: 10989020 kB' 'SwapCached: 0 kB' 'Active: 7394660 kB' 'Inactive: 4089812 kB' 'Active(anon): 6993540 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496124 kB' 'Mapped: 191964 kB' 'Shmem: 6500796 kB' 'KReclaimable: 465392 kB' 'Slab: 1044096 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578704 kB' 'KernelStack: 13232 kB' 'PageTables: 9244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8084688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199068 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.074 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.074 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.075 12:30:07 -- setup/common.sh@33 -- # echo 0 00:02:34.075 12:30:07 -- setup/common.sh@33 -- # return 0 00:02:34.075 12:30:07 -- setup/hugepages.sh@99 -- # surp=0 00:02:34.075 12:30:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:34.075 12:30:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:34.075 12:30:07 -- setup/common.sh@18 -- # local node= 00:02:34.075 12:30:07 -- setup/common.sh@19 -- # local var val 00:02:34.075 12:30:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:34.075 12:30:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:34.075 12:30:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:34.075 12:30:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:34.075 12:30:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:34.075 12:30:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44605712 kB' 'MemAvailable: 48917404 kB' 'Buffers: 2708 kB' 'Cached: 10989020 kB' 'SwapCached: 0 kB' 'Active: 7395836 kB' 'Inactive: 4089812 kB' 'Active(anon): 6994716 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 497360 kB' 'Mapped: 192400 kB' 'Shmem: 6500796 kB' 'KReclaimable: 465392 kB' 'Slab: 1044096 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578704 kB' 'KernelStack: 13248 kB' 'PageTables: 9076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8083656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.075 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.075 12:30:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:34.076 12:30:07 -- setup/common.sh@33 -- # echo 0 00:02:34.076 12:30:07 -- setup/common.sh@33 -- # return 0 00:02:34.076 12:30:07 -- setup/hugepages.sh@100 -- # resv=0 00:02:34.076 12:30:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:34.076 nr_hugepages=1024 00:02:34.076 12:30:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:34.076 resv_hugepages=0 00:02:34.076 12:30:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:34.076 surplus_hugepages=0 00:02:34.076 12:30:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:34.076 anon_hugepages=0 00:02:34.076 12:30:07 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:34.076 12:30:07 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:34.076 12:30:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:34.076 12:30:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:34.076 12:30:07 -- setup/common.sh@18 -- # local node= 00:02:34.076 12:30:07 -- setup/common.sh@19 -- # local var val 00:02:34.076 12:30:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:34.076 12:30:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:34.076 12:30:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:34.076 12:30:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:34.076 12:30:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:34.076 12:30:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44602380 kB' 'MemAvailable: 48914072 kB' 'Buffers: 2708 kB' 'Cached: 10989040 kB' 'SwapCached: 0 kB' 'Active: 7398536 kB' 'Inactive: 4089812 kB' 'Active(anon): 6997416 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499904 kB' 'Mapped: 192416 kB' 'Shmem: 6500816 kB' 'KReclaimable: 465392 kB' 'Slab: 1044052 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578660 kB' 'KernelStack: 12992 kB' 'PageTables: 8304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8086972 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198972 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.076 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.076 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.077 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.077 12:30:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:34.078 12:30:07 -- setup/common.sh@33 -- # echo 1024 00:02:34.078 12:30:07 -- setup/common.sh@33 -- # return 0 00:02:34.078 12:30:07 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:34.078 12:30:07 -- setup/hugepages.sh@112 -- # get_nodes 00:02:34.078 12:30:07 -- setup/hugepages.sh@27 -- # local node 00:02:34.078 12:30:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:34.078 12:30:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:34.078 12:30:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:34.078 12:30:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:34.078 12:30:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:34.078 12:30:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:34.078 12:30:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:34.078 12:30:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:34.078 12:30:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:34.078 12:30:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:34.078 12:30:07 -- setup/common.sh@18 -- # local node=0 00:02:34.078 12:30:07 -- setup/common.sh@19 -- # local var val 00:02:34.078 12:30:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:34.078 12:30:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:34.078 12:30:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:34.078 12:30:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:34.078 12:30:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:34.078 12:30:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20159900 kB' 'MemUsed: 12715024 kB' 'SwapCached: 0 kB' 'Active: 5490540 kB' 'Inactive: 3554096 kB' 'Active(anon): 5283032 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793260 kB' 'Mapped: 134816 kB' 'AnonPages: 254472 kB' 'Shmem: 5031656 kB' 'KernelStack: 7880 kB' 'PageTables: 5136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683268 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372092 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.078 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.078 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # continue 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:34.339 12:30:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:34.339 12:30:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:34.339 12:30:07 -- setup/common.sh@33 -- # echo 0 00:02:34.339 12:30:07 -- setup/common.sh@33 -- # return 0 00:02:34.339 12:30:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:34.339 12:30:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:34.339 12:30:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:34.339 12:30:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:34.339 12:30:07 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:34.339 node0=1024 expecting 1024 00:02:34.339 12:30:07 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:34.339 00:02:34.339 real 0m2.401s 00:02:34.339 user 0m0.601s 00:02:34.339 sys 0m0.887s 00:02:34.339 12:30:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:34.339 12:30:07 -- common/autotest_common.sh@10 -- # set +x 00:02:34.339 ************************************ 00:02:34.339 END TEST default_setup 00:02:34.339 ************************************ 00:02:34.339 12:30:07 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:34.339 12:30:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:34.340 12:30:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:34.340 12:30:07 -- common/autotest_common.sh@10 -- # set +x 00:02:34.340 ************************************ 00:02:34.340 START TEST per_node_1G_alloc 00:02:34.340 ************************************ 00:02:34.340 12:30:07 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:02:34.340 12:30:07 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:34.340 12:30:07 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:34.340 12:30:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:34.340 12:30:07 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:34.340 12:30:07 -- setup/hugepages.sh@51 -- # shift 00:02:34.340 12:30:07 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:34.340 12:30:07 -- setup/hugepages.sh@52 -- # local node_ids 00:02:34.340 12:30:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:34.340 12:30:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:34.340 12:30:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:34.340 12:30:07 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:34.340 12:30:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:34.340 12:30:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:34.340 12:30:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:34.340 12:30:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:34.340 12:30:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:34.340 12:30:07 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:34.340 12:30:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:34.340 12:30:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:34.340 12:30:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:34.340 12:30:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:34.340 12:30:07 -- setup/hugepages.sh@73 -- # return 0 00:02:34.340 12:30:07 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:34.340 12:30:07 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:34.340 12:30:07 -- setup/hugepages.sh@146 -- # setup output 00:02:34.340 12:30:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:34.340 12:30:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:35.278 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:35.278 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:35.278 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:35.278 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:35.278 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:35.278 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:35.278 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:35.278 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:35.278 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:35.278 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:35.579 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:35.579 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:35.579 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:35.579 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:35.579 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:35.579 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:35.579 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:35.579 12:30:08 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:35.579 12:30:08 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:35.579 12:30:08 -- setup/hugepages.sh@89 -- # local node 00:02:35.579 12:30:08 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:35.579 12:30:08 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:35.579 12:30:08 -- setup/hugepages.sh@92 -- # local surp 00:02:35.579 12:30:08 -- setup/hugepages.sh@93 -- # local resv 00:02:35.579 12:30:08 -- setup/hugepages.sh@94 -- # local anon 00:02:35.579 12:30:08 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:35.579 12:30:08 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:35.579 12:30:08 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:35.579 12:30:08 -- setup/common.sh@18 -- # local node= 00:02:35.579 12:30:08 -- setup/common.sh@19 -- # local var val 00:02:35.579 12:30:08 -- setup/common.sh@20 -- # local mem_f mem 00:02:35.579 12:30:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:35.579 12:30:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:35.579 12:30:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:35.579 12:30:08 -- setup/common.sh@28 -- # mapfile -t mem 00:02:35.579 12:30:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:35.579 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.579 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.579 12:30:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44571908 kB' 'MemAvailable: 48883600 kB' 'Buffers: 2708 kB' 'Cached: 10989104 kB' 'SwapCached: 0 kB' 'Active: 7396764 kB' 'Inactive: 4089812 kB' 'Active(anon): 6995644 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 498028 kB' 'Mapped: 192320 kB' 'Shmem: 6500880 kB' 'KReclaimable: 465392 kB' 'Slab: 1044312 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578920 kB' 'KernelStack: 12976 kB' 'PageTables: 8360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8085644 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:35.579 12:30:08 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.579 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.579 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.579 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.579 12:30:08 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.579 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.580 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.580 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:35.581 12:30:08 -- setup/common.sh@33 -- # echo 0 00:02:35.581 12:30:08 -- setup/common.sh@33 -- # return 0 00:02:35.581 12:30:08 -- setup/hugepages.sh@97 -- # anon=0 00:02:35.581 12:30:08 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:35.581 12:30:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:35.581 12:30:08 -- setup/common.sh@18 -- # local node= 00:02:35.581 12:30:08 -- setup/common.sh@19 -- # local var val 00:02:35.581 12:30:08 -- setup/common.sh@20 -- # local mem_f mem 00:02:35.581 12:30:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:35.581 12:30:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:35.581 12:30:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:35.581 12:30:08 -- setup/common.sh@28 -- # mapfile -t mem 00:02:35.581 12:30:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44571228 kB' 'MemAvailable: 48882920 kB' 'Buffers: 2708 kB' 'Cached: 10989104 kB' 'SwapCached: 0 kB' 'Active: 7398684 kB' 'Inactive: 4089812 kB' 'Active(anon): 6997564 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499960 kB' 'Mapped: 193140 kB' 'Shmem: 6500880 kB' 'KReclaimable: 465392 kB' 'Slab: 1044312 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578920 kB' 'KernelStack: 12976 kB' 'PageTables: 8392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8086592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198928 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.581 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.581 12:30:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.582 12:30:08 -- setup/common.sh@33 -- # echo 0 00:02:35.582 12:30:08 -- setup/common.sh@33 -- # return 0 00:02:35.582 12:30:08 -- setup/hugepages.sh@99 -- # surp=0 00:02:35.582 12:30:08 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:35.582 12:30:08 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:35.582 12:30:08 -- setup/common.sh@18 -- # local node= 00:02:35.582 12:30:08 -- setup/common.sh@19 -- # local var val 00:02:35.582 12:30:08 -- setup/common.sh@20 -- # local mem_f mem 00:02:35.582 12:30:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:35.582 12:30:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:35.582 12:30:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:35.582 12:30:08 -- setup/common.sh@28 -- # mapfile -t mem 00:02:35.582 12:30:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44571960 kB' 'MemAvailable: 48883652 kB' 'Buffers: 2708 kB' 'Cached: 10989104 kB' 'SwapCached: 0 kB' 'Active: 7392332 kB' 'Inactive: 4089812 kB' 'Active(anon): 6991212 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493568 kB' 'Mapped: 193048 kB' 'Shmem: 6500880 kB' 'KReclaimable: 465392 kB' 'Slab: 1044284 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578892 kB' 'KernelStack: 12960 kB' 'PageTables: 8288 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8081716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.582 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.582 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.583 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.583 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:35.584 12:30:08 -- setup/common.sh@33 -- # echo 0 00:02:35.584 12:30:08 -- setup/common.sh@33 -- # return 0 00:02:35.584 12:30:08 -- setup/hugepages.sh@100 -- # resv=0 00:02:35.584 12:30:08 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:35.584 nr_hugepages=1024 00:02:35.584 12:30:08 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:35.584 resv_hugepages=0 00:02:35.584 12:30:08 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:35.584 surplus_hugepages=0 00:02:35.584 12:30:08 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:35.584 anon_hugepages=0 00:02:35.584 12:30:08 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:35.584 12:30:08 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:35.584 12:30:08 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:35.584 12:30:08 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:35.584 12:30:08 -- setup/common.sh@18 -- # local node= 00:02:35.584 12:30:08 -- setup/common.sh@19 -- # local var val 00:02:35.584 12:30:08 -- setup/common.sh@20 -- # local mem_f mem 00:02:35.584 12:30:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:35.584 12:30:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:35.584 12:30:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:35.584 12:30:08 -- setup/common.sh@28 -- # mapfile -t mem 00:02:35.584 12:30:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44572392 kB' 'MemAvailable: 48884084 kB' 'Buffers: 2708 kB' 'Cached: 10989132 kB' 'SwapCached: 0 kB' 'Active: 7396256 kB' 'Inactive: 4089812 kB' 'Active(anon): 6995136 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 497904 kB' 'Mapped: 192740 kB' 'Shmem: 6500908 kB' 'KReclaimable: 465392 kB' 'Slab: 1044312 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578920 kB' 'KernelStack: 12960 kB' 'PageTables: 8272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8085164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.584 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.584 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:35.585 12:30:08 -- setup/common.sh@33 -- # echo 1024 00:02:35.585 12:30:08 -- setup/common.sh@33 -- # return 0 00:02:35.585 12:30:08 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:35.585 12:30:08 -- setup/hugepages.sh@112 -- # get_nodes 00:02:35.585 12:30:08 -- setup/hugepages.sh@27 -- # local node 00:02:35.585 12:30:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:35.585 12:30:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:35.585 12:30:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:35.585 12:30:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:35.585 12:30:08 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:35.585 12:30:08 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:35.585 12:30:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:35.585 12:30:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:35.585 12:30:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:35.585 12:30:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:35.585 12:30:08 -- setup/common.sh@18 -- # local node=0 00:02:35.585 12:30:08 -- setup/common.sh@19 -- # local var val 00:02:35.585 12:30:08 -- setup/common.sh@20 -- # local mem_f mem 00:02:35.585 12:30:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:35.585 12:30:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:35.585 12:30:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:35.585 12:30:08 -- setup/common.sh@28 -- # mapfile -t mem 00:02:35.585 12:30:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21187436 kB' 'MemUsed: 11687488 kB' 'SwapCached: 0 kB' 'Active: 5490352 kB' 'Inactive: 3554096 kB' 'Active(anon): 5282844 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793304 kB' 'Mapped: 134896 kB' 'AnonPages: 254408 kB' 'Shmem: 5031700 kB' 'KernelStack: 7864 kB' 'PageTables: 5092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683544 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372368 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.585 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.585 12:30:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.586 12:30:08 -- setup/common.sh@33 -- # echo 0 00:02:35.586 12:30:08 -- setup/common.sh@33 -- # return 0 00:02:35.586 12:30:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:35.586 12:30:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:35.586 12:30:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:35.586 12:30:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:35.586 12:30:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:35.586 12:30:08 -- setup/common.sh@18 -- # local node=1 00:02:35.586 12:30:08 -- setup/common.sh@19 -- # local var val 00:02:35.586 12:30:08 -- setup/common.sh@20 -- # local mem_f mem 00:02:35.586 12:30:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:35.586 12:30:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:35.586 12:30:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:35.586 12:30:08 -- setup/common.sh@28 -- # mapfile -t mem 00:02:35.586 12:30:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.586 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.586 12:30:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23386344 kB' 'MemUsed: 4274404 kB' 'SwapCached: 0 kB' 'Active: 1902080 kB' 'Inactive: 535716 kB' 'Active(anon): 1708468 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2198556 kB' 'Mapped: 58324 kB' 'AnonPages: 239288 kB' 'Shmem: 1469228 kB' 'KernelStack: 5064 kB' 'PageTables: 3064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154216 kB' 'Slab: 360760 kB' 'SReclaimable: 154216 kB' 'SUnreclaim: 206544 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.859 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.859 12:30:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # continue 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # IFS=': ' 00:02:35.860 12:30:08 -- setup/common.sh@31 -- # read -r var val _ 00:02:35.860 12:30:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:35.860 12:30:08 -- setup/common.sh@33 -- # echo 0 00:02:35.860 12:30:08 -- setup/common.sh@33 -- # return 0 00:02:35.860 12:30:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:35.860 12:30:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:35.860 12:30:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:35.860 12:30:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:35.860 12:30:08 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:35.860 node0=512 expecting 512 00:02:35.860 12:30:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:35.860 12:30:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:35.860 12:30:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:35.860 12:30:08 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:35.860 node1=512 expecting 512 00:02:35.860 12:30:08 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:35.861 00:02:35.861 real 0m1.475s 00:02:35.861 user 0m0.618s 00:02:35.861 sys 0m0.822s 00:02:35.861 12:30:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:35.861 12:30:08 -- common/autotest_common.sh@10 -- # set +x 00:02:35.861 ************************************ 00:02:35.861 END TEST per_node_1G_alloc 00:02:35.861 ************************************ 00:02:35.861 12:30:08 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:35.861 12:30:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:35.861 12:30:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:35.861 12:30:08 -- common/autotest_common.sh@10 -- # set +x 00:02:35.861 ************************************ 00:02:35.861 START TEST even_2G_alloc 00:02:35.861 ************************************ 00:02:35.861 12:30:08 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:02:35.861 12:30:08 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:35.861 12:30:08 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:35.861 12:30:08 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:35.861 12:30:08 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:35.861 12:30:08 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:35.861 12:30:08 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:35.861 12:30:08 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:35.861 12:30:08 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:35.861 12:30:08 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:35.861 12:30:08 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:35.861 12:30:08 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:35.861 12:30:08 -- setup/hugepages.sh@83 -- # : 512 00:02:35.861 12:30:08 -- setup/hugepages.sh@84 -- # : 1 00:02:35.861 12:30:08 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:35.861 12:30:08 -- setup/hugepages.sh@83 -- # : 0 00:02:35.861 12:30:08 -- setup/hugepages.sh@84 -- # : 0 00:02:35.861 12:30:08 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:35.861 12:30:08 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:35.861 12:30:08 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:35.861 12:30:08 -- setup/hugepages.sh@153 -- # setup output 00:02:35.861 12:30:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:35.861 12:30:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:36.798 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:36.798 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:36.798 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:36.798 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:36.798 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:36.798 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:36.798 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:36.798 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:36.798 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:36.798 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:36.798 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:36.798 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:36.798 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:36.798 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:36.798 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:36.798 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:36.798 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:37.063 12:30:09 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:37.063 12:30:09 -- setup/hugepages.sh@89 -- # local node 00:02:37.063 12:30:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:37.063 12:30:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:37.063 12:30:09 -- setup/hugepages.sh@92 -- # local surp 00:02:37.063 12:30:09 -- setup/hugepages.sh@93 -- # local resv 00:02:37.063 12:30:09 -- setup/hugepages.sh@94 -- # local anon 00:02:37.063 12:30:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:37.063 12:30:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:37.063 12:30:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:37.063 12:30:09 -- setup/common.sh@18 -- # local node= 00:02:37.063 12:30:09 -- setup/common.sh@19 -- # local var val 00:02:37.063 12:30:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:37.063 12:30:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:37.063 12:30:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:37.063 12:30:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:37.063 12:30:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:37.063 12:30:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44579200 kB' 'MemAvailable: 48890892 kB' 'Buffers: 2708 kB' 'Cached: 10989196 kB' 'SwapCached: 0 kB' 'Active: 7390912 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989792 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492124 kB' 'Mapped: 191460 kB' 'Shmem: 6500972 kB' 'KReclaimable: 465392 kB' 'Slab: 1044752 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579360 kB' 'KernelStack: 12928 kB' 'PageTables: 8080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8064888 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.063 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.063 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:37.064 12:30:09 -- setup/common.sh@33 -- # echo 0 00:02:37.064 12:30:09 -- setup/common.sh@33 -- # return 0 00:02:37.064 12:30:09 -- setup/hugepages.sh@97 -- # anon=0 00:02:37.064 12:30:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:37.064 12:30:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:37.064 12:30:09 -- setup/common.sh@18 -- # local node= 00:02:37.064 12:30:09 -- setup/common.sh@19 -- # local var val 00:02:37.064 12:30:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:37.064 12:30:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:37.064 12:30:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:37.064 12:30:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:37.064 12:30:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:37.064 12:30:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44581420 kB' 'MemAvailable: 48893112 kB' 'Buffers: 2708 kB' 'Cached: 10989200 kB' 'SwapCached: 0 kB' 'Active: 7389484 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988364 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490696 kB' 'Mapped: 190980 kB' 'Shmem: 6500976 kB' 'KReclaimable: 465392 kB' 'Slab: 1044748 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579356 kB' 'KernelStack: 12880 kB' 'PageTables: 7812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8064900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.064 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.064 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:09 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.065 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.065 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.066 12:30:10 -- setup/common.sh@33 -- # echo 0 00:02:37.066 12:30:10 -- setup/common.sh@33 -- # return 0 00:02:37.066 12:30:10 -- setup/hugepages.sh@99 -- # surp=0 00:02:37.066 12:30:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:37.066 12:30:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:37.066 12:30:10 -- setup/common.sh@18 -- # local node= 00:02:37.066 12:30:10 -- setup/common.sh@19 -- # local var val 00:02:37.066 12:30:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:37.066 12:30:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:37.066 12:30:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:37.066 12:30:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:37.066 12:30:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:37.066 12:30:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44582168 kB' 'MemAvailable: 48893860 kB' 'Buffers: 2708 kB' 'Cached: 10989208 kB' 'SwapCached: 0 kB' 'Active: 7389172 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988052 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490572 kB' 'Mapped: 190864 kB' 'Shmem: 6500984 kB' 'KReclaimable: 465392 kB' 'Slab: 1044740 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579348 kB' 'KernelStack: 12864 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8064916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.066 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.066 12:30:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:37.067 12:30:10 -- setup/common.sh@33 -- # echo 0 00:02:37.067 12:30:10 -- setup/common.sh@33 -- # return 0 00:02:37.067 12:30:10 -- setup/hugepages.sh@100 -- # resv=0 00:02:37.067 12:30:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:37.067 nr_hugepages=1024 00:02:37.067 12:30:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:37.067 resv_hugepages=0 00:02:37.067 12:30:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:37.067 surplus_hugepages=0 00:02:37.067 12:30:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:37.067 anon_hugepages=0 00:02:37.067 12:30:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:37.067 12:30:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:37.067 12:30:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:37.067 12:30:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:37.067 12:30:10 -- setup/common.sh@18 -- # local node= 00:02:37.067 12:30:10 -- setup/common.sh@19 -- # local var val 00:02:37.067 12:30:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:37.067 12:30:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:37.067 12:30:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:37.067 12:30:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:37.067 12:30:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:37.067 12:30:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44582168 kB' 'MemAvailable: 48893860 kB' 'Buffers: 2708 kB' 'Cached: 10989220 kB' 'SwapCached: 0 kB' 'Active: 7389968 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988848 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491648 kB' 'Mapped: 190864 kB' 'Shmem: 6500996 kB' 'KReclaimable: 465392 kB' 'Slab: 1044740 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579348 kB' 'KernelStack: 12816 kB' 'PageTables: 7616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8064928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.067 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.067 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.068 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.068 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:37.069 12:30:10 -- setup/common.sh@33 -- # echo 1024 00:02:37.069 12:30:10 -- setup/common.sh@33 -- # return 0 00:02:37.069 12:30:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:37.069 12:30:10 -- setup/hugepages.sh@112 -- # get_nodes 00:02:37.069 12:30:10 -- setup/hugepages.sh@27 -- # local node 00:02:37.069 12:30:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:37.069 12:30:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:37.069 12:30:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:37.069 12:30:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:37.069 12:30:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:37.069 12:30:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:37.069 12:30:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:37.069 12:30:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:37.069 12:30:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:37.069 12:30:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:37.069 12:30:10 -- setup/common.sh@18 -- # local node=0 00:02:37.069 12:30:10 -- setup/common.sh@19 -- # local var val 00:02:37.069 12:30:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:37.069 12:30:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:37.069 12:30:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:37.069 12:30:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:37.069 12:30:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:37.069 12:30:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21187240 kB' 'MemUsed: 11687684 kB' 'SwapCached: 0 kB' 'Active: 5489608 kB' 'Inactive: 3554096 kB' 'Active(anon): 5282100 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793356 kB' 'Mapped: 133204 kB' 'AnonPages: 253708 kB' 'Shmem: 5031752 kB' 'KernelStack: 7816 kB' 'PageTables: 4820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683812 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372636 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.069 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.069 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@33 -- # echo 0 00:02:37.070 12:30:10 -- setup/common.sh@33 -- # return 0 00:02:37.070 12:30:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:37.070 12:30:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:37.070 12:30:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:37.070 12:30:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:37.070 12:30:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:37.070 12:30:10 -- setup/common.sh@18 -- # local node=1 00:02:37.070 12:30:10 -- setup/common.sh@19 -- # local var val 00:02:37.070 12:30:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:37.070 12:30:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:37.070 12:30:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:37.070 12:30:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:37.070 12:30:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:37.070 12:30:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23396148 kB' 'MemUsed: 4264600 kB' 'SwapCached: 0 kB' 'Active: 1901592 kB' 'Inactive: 535716 kB' 'Active(anon): 1707980 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2198572 kB' 'Mapped: 57660 kB' 'AnonPages: 239112 kB' 'Shmem: 1469244 kB' 'KernelStack: 5064 kB' 'PageTables: 2936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154216 kB' 'Slab: 360928 kB' 'SReclaimable: 154216 kB' 'SUnreclaim: 206712 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.070 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.070 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # continue 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:37.071 12:30:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:37.071 12:30:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:37.071 12:30:10 -- setup/common.sh@33 -- # echo 0 00:02:37.071 12:30:10 -- setup/common.sh@33 -- # return 0 00:02:37.071 12:30:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:37.071 12:30:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:37.071 12:30:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:37.071 12:30:10 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:37.071 node0=512 expecting 512 00:02:37.071 12:30:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:37.071 12:30:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:37.071 12:30:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:37.071 12:30:10 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:37.071 node1=512 expecting 512 00:02:37.071 12:30:10 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:37.071 00:02:37.071 real 0m1.398s 00:02:37.071 user 0m0.555s 00:02:37.071 sys 0m0.806s 00:02:37.071 12:30:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:37.071 12:30:10 -- common/autotest_common.sh@10 -- # set +x 00:02:37.071 ************************************ 00:02:37.071 END TEST even_2G_alloc 00:02:37.071 ************************************ 00:02:37.071 12:30:10 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:37.071 12:30:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:37.071 12:30:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:37.071 12:30:10 -- common/autotest_common.sh@10 -- # set +x 00:02:37.071 ************************************ 00:02:37.071 START TEST odd_alloc 00:02:37.071 ************************************ 00:02:37.071 12:30:10 -- common/autotest_common.sh@1114 -- # odd_alloc 00:02:37.071 12:30:10 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:37.071 12:30:10 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:37.071 12:30:10 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:37.071 12:30:10 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:37.071 12:30:10 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:37.071 12:30:10 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:37.071 12:30:10 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:37.071 12:30:10 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:37.071 12:30:10 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:37.071 12:30:10 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:37.071 12:30:10 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:37.071 12:30:10 -- setup/hugepages.sh@83 -- # : 513 00:02:37.071 12:30:10 -- setup/hugepages.sh@84 -- # : 1 00:02:37.071 12:30:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:37.071 12:30:10 -- setup/hugepages.sh@83 -- # : 0 00:02:37.071 12:30:10 -- setup/hugepages.sh@84 -- # : 0 00:02:37.071 12:30:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:37.071 12:30:10 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:37.071 12:30:10 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:37.071 12:30:10 -- setup/hugepages.sh@160 -- # setup output 00:02:37.071 12:30:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:37.071 12:30:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:38.456 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:38.456 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:38.456 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:38.456 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:38.456 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:38.456 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:38.456 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:38.456 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:38.456 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:38.456 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:38.456 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:38.456 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:38.456 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:38.456 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:38.456 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:38.456 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:38.456 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:38.456 12:30:11 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:38.456 12:30:11 -- setup/hugepages.sh@89 -- # local node 00:02:38.456 12:30:11 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:38.456 12:30:11 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:38.456 12:30:11 -- setup/hugepages.sh@92 -- # local surp 00:02:38.456 12:30:11 -- setup/hugepages.sh@93 -- # local resv 00:02:38.456 12:30:11 -- setup/hugepages.sh@94 -- # local anon 00:02:38.456 12:30:11 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:38.456 12:30:11 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:38.456 12:30:11 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:38.456 12:30:11 -- setup/common.sh@18 -- # local node= 00:02:38.456 12:30:11 -- setup/common.sh@19 -- # local var val 00:02:38.456 12:30:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:38.456 12:30:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:38.456 12:30:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:38.456 12:30:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:38.456 12:30:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:38.456 12:30:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:38.456 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.456 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.456 12:30:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44605356 kB' 'MemAvailable: 48917048 kB' 'Buffers: 2708 kB' 'Cached: 10989284 kB' 'SwapCached: 0 kB' 'Active: 7390636 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989516 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491580 kB' 'Mapped: 190932 kB' 'Shmem: 6501060 kB' 'KReclaimable: 465392 kB' 'Slab: 1044496 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579104 kB' 'KernelStack: 13008 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8067756 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199036 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:38.456 12:30:11 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.456 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.456 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.457 12:30:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:38.457 12:30:11 -- setup/common.sh@33 -- # echo 0 00:02:38.457 12:30:11 -- setup/common.sh@33 -- # return 0 00:02:38.457 12:30:11 -- setup/hugepages.sh@97 -- # anon=0 00:02:38.457 12:30:11 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:38.457 12:30:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:38.457 12:30:11 -- setup/common.sh@18 -- # local node= 00:02:38.457 12:30:11 -- setup/common.sh@19 -- # local var val 00:02:38.457 12:30:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:38.457 12:30:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:38.457 12:30:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:38.457 12:30:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:38.457 12:30:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:38.457 12:30:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.457 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44605924 kB' 'MemAvailable: 48917616 kB' 'Buffers: 2708 kB' 'Cached: 10989284 kB' 'SwapCached: 0 kB' 'Active: 7391888 kB' 'Inactive: 4089812 kB' 'Active(anon): 6990768 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493312 kB' 'Mapped: 191012 kB' 'Shmem: 6501060 kB' 'KReclaimable: 465392 kB' 'Slab: 1044504 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579112 kB' 'KernelStack: 13248 kB' 'PageTables: 9224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8069148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199084 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.458 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.458 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.459 12:30:11 -- setup/common.sh@33 -- # echo 0 00:02:38.459 12:30:11 -- setup/common.sh@33 -- # return 0 00:02:38.459 12:30:11 -- setup/hugepages.sh@99 -- # surp=0 00:02:38.459 12:30:11 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:38.459 12:30:11 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:38.459 12:30:11 -- setup/common.sh@18 -- # local node= 00:02:38.459 12:30:11 -- setup/common.sh@19 -- # local var val 00:02:38.459 12:30:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:38.459 12:30:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:38.459 12:30:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:38.459 12:30:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:38.459 12:30:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:38.459 12:30:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44607364 kB' 'MemAvailable: 48919056 kB' 'Buffers: 2708 kB' 'Cached: 10989300 kB' 'SwapCached: 0 kB' 'Active: 7390732 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989612 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491688 kB' 'Mapped: 190968 kB' 'Shmem: 6501076 kB' 'KReclaimable: 465392 kB' 'Slab: 1044504 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579112 kB' 'KernelStack: 13200 kB' 'PageTables: 8896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8069164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199068 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.459 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.459 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:38.460 12:30:11 -- setup/common.sh@33 -- # echo 0 00:02:38.460 12:30:11 -- setup/common.sh@33 -- # return 0 00:02:38.460 12:30:11 -- setup/hugepages.sh@100 -- # resv=0 00:02:38.460 12:30:11 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:38.460 nr_hugepages=1025 00:02:38.460 12:30:11 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:38.460 resv_hugepages=0 00:02:38.460 12:30:11 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:38.460 surplus_hugepages=0 00:02:38.460 12:30:11 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:38.460 anon_hugepages=0 00:02:38.460 12:30:11 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:38.460 12:30:11 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:38.460 12:30:11 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:38.460 12:30:11 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:38.460 12:30:11 -- setup/common.sh@18 -- # local node= 00:02:38.460 12:30:11 -- setup/common.sh@19 -- # local var val 00:02:38.460 12:30:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:38.460 12:30:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:38.460 12:30:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:38.460 12:30:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:38.460 12:30:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:38.460 12:30:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44606612 kB' 'MemAvailable: 48918304 kB' 'Buffers: 2708 kB' 'Cached: 10989316 kB' 'SwapCached: 0 kB' 'Active: 7390884 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989764 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492432 kB' 'Mapped: 190892 kB' 'Shmem: 6501092 kB' 'KReclaimable: 465392 kB' 'Slab: 1044528 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 579136 kB' 'KernelStack: 13200 kB' 'PageTables: 9444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8069180 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199228 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.460 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.460 12:30:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.461 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.461 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:38.461 12:30:11 -- setup/common.sh@33 -- # echo 1025 00:02:38.462 12:30:11 -- setup/common.sh@33 -- # return 0 00:02:38.462 12:30:11 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:38.462 12:30:11 -- setup/hugepages.sh@112 -- # get_nodes 00:02:38.462 12:30:11 -- setup/hugepages.sh@27 -- # local node 00:02:38.462 12:30:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:38.462 12:30:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:38.462 12:30:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:38.462 12:30:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:38.462 12:30:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:38.723 12:30:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:38.723 12:30:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:38.723 12:30:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:38.723 12:30:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:38.723 12:30:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:38.723 12:30:11 -- setup/common.sh@18 -- # local node=0 00:02:38.723 12:30:11 -- setup/common.sh@19 -- # local var val 00:02:38.723 12:30:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:38.723 12:30:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:38.723 12:30:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:38.723 12:30:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:38.723 12:30:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:38.723 12:30:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:38.723 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.723 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.723 12:30:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21205280 kB' 'MemUsed: 11669644 kB' 'SwapCached: 0 kB' 'Active: 5489412 kB' 'Inactive: 3554096 kB' 'Active(anon): 5281904 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793468 kB' 'Mapped: 133204 kB' 'AnonPages: 253140 kB' 'Shmem: 5031864 kB' 'KernelStack: 7784 kB' 'PageTables: 4796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683472 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372296 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:38.723 12:30:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.723 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.723 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.723 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.723 12:30:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.723 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.723 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.723 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.723 12:30:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.724 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.724 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@33 -- # echo 0 00:02:38.725 12:30:11 -- setup/common.sh@33 -- # return 0 00:02:38.725 12:30:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:38.725 12:30:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:38.725 12:30:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:38.725 12:30:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:38.725 12:30:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:38.725 12:30:11 -- setup/common.sh@18 -- # local node=1 00:02:38.725 12:30:11 -- setup/common.sh@19 -- # local var val 00:02:38.725 12:30:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:38.725 12:30:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:38.725 12:30:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:38.725 12:30:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:38.725 12:30:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:38.725 12:30:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23402272 kB' 'MemUsed: 4258476 kB' 'SwapCached: 0 kB' 'Active: 1900636 kB' 'Inactive: 535716 kB' 'Active(anon): 1707024 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2198572 kB' 'Mapped: 57688 kB' 'AnonPages: 237724 kB' 'Shmem: 1469244 kB' 'KernelStack: 5112 kB' 'PageTables: 2972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154216 kB' 'Slab: 360772 kB' 'SReclaimable: 154216 kB' 'SUnreclaim: 206556 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.725 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.725 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # continue 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:38.726 12:30:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:38.726 12:30:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:38.726 12:30:11 -- setup/common.sh@33 -- # echo 0 00:02:38.726 12:30:11 -- setup/common.sh@33 -- # return 0 00:02:38.726 12:30:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:38.726 12:30:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:38.726 12:30:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:38.726 12:30:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:38.726 12:30:11 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:38.726 node0=512 expecting 513 00:02:38.726 12:30:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:38.726 12:30:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:38.726 12:30:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:38.726 12:30:11 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:38.726 node1=513 expecting 512 00:02:38.726 12:30:11 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:38.726 00:02:38.726 real 0m1.471s 00:02:38.726 user 0m0.641s 00:02:38.726 sys 0m0.795s 00:02:38.726 12:30:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:38.726 12:30:11 -- common/autotest_common.sh@10 -- # set +x 00:02:38.726 ************************************ 00:02:38.726 END TEST odd_alloc 00:02:38.727 ************************************ 00:02:38.727 12:30:11 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:38.727 12:30:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:38.727 12:30:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:38.727 12:30:11 -- common/autotest_common.sh@10 -- # set +x 00:02:38.727 ************************************ 00:02:38.727 START TEST custom_alloc 00:02:38.727 ************************************ 00:02:38.727 12:30:11 -- common/autotest_common.sh@1114 -- # custom_alloc 00:02:38.727 12:30:11 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:38.727 12:30:11 -- setup/hugepages.sh@169 -- # local node 00:02:38.727 12:30:11 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:38.727 12:30:11 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:38.727 12:30:11 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:38.727 12:30:11 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:38.727 12:30:11 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:38.727 12:30:11 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:38.727 12:30:11 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:38.727 12:30:11 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:38.727 12:30:11 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:38.727 12:30:11 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:38.727 12:30:11 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:38.727 12:30:11 -- setup/hugepages.sh@83 -- # : 256 00:02:38.727 12:30:11 -- setup/hugepages.sh@84 -- # : 1 00:02:38.727 12:30:11 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:38.727 12:30:11 -- setup/hugepages.sh@83 -- # : 0 00:02:38.727 12:30:11 -- setup/hugepages.sh@84 -- # : 0 00:02:38.727 12:30:11 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:38.727 12:30:11 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:38.727 12:30:11 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:38.727 12:30:11 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:38.727 12:30:11 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:38.727 12:30:11 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:38.727 12:30:11 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:38.727 12:30:11 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:38.727 12:30:11 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:38.727 12:30:11 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:38.727 12:30:11 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:38.727 12:30:11 -- setup/hugepages.sh@78 -- # return 0 00:02:38.727 12:30:11 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:38.727 12:30:11 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:38.727 12:30:11 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:38.727 12:30:11 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:38.727 12:30:11 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:38.727 12:30:11 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:38.727 12:30:11 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:38.727 12:30:11 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:38.727 12:30:11 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:38.727 12:30:11 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:38.727 12:30:11 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:38.727 12:30:11 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:38.727 12:30:11 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:38.727 12:30:11 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:38.727 12:30:11 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:38.727 12:30:11 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:38.727 12:30:11 -- setup/hugepages.sh@78 -- # return 0 00:02:38.727 12:30:11 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:38.727 12:30:11 -- setup/hugepages.sh@187 -- # setup output 00:02:38.727 12:30:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:38.727 12:30:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:40.107 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:40.107 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:40.107 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:40.107 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:40.107 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:40.107 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:40.107 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:40.107 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:40.107 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:40.107 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:40.107 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:40.107 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:40.107 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:40.107 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:40.107 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:40.107 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:40.107 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:40.107 12:30:12 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:40.107 12:30:12 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:40.107 12:30:12 -- setup/hugepages.sh@89 -- # local node 00:02:40.107 12:30:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:40.108 12:30:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:40.108 12:30:12 -- setup/hugepages.sh@92 -- # local surp 00:02:40.108 12:30:12 -- setup/hugepages.sh@93 -- # local resv 00:02:40.108 12:30:12 -- setup/hugepages.sh@94 -- # local anon 00:02:40.108 12:30:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:40.108 12:30:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:40.108 12:30:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:40.108 12:30:12 -- setup/common.sh@18 -- # local node= 00:02:40.108 12:30:12 -- setup/common.sh@19 -- # local var val 00:02:40.108 12:30:12 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.108 12:30:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.108 12:30:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:40.108 12:30:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:40.108 12:30:12 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.108 12:30:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43548840 kB' 'MemAvailable: 47860532 kB' 'Buffers: 2708 kB' 'Cached: 10989380 kB' 'SwapCached: 0 kB' 'Active: 7389988 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988868 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490948 kB' 'Mapped: 191004 kB' 'Shmem: 6501156 kB' 'KReclaimable: 465392 kB' 'Slab: 1044180 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578788 kB' 'KernelStack: 12864 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8065336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.108 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.108 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:40.109 12:30:12 -- setup/common.sh@33 -- # echo 0 00:02:40.109 12:30:12 -- setup/common.sh@33 -- # return 0 00:02:40.109 12:30:12 -- setup/hugepages.sh@97 -- # anon=0 00:02:40.109 12:30:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:40.109 12:30:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:40.109 12:30:12 -- setup/common.sh@18 -- # local node= 00:02:40.109 12:30:12 -- setup/common.sh@19 -- # local var val 00:02:40.109 12:30:12 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.109 12:30:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.109 12:30:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:40.109 12:30:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:40.109 12:30:12 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.109 12:30:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43551384 kB' 'MemAvailable: 47863076 kB' 'Buffers: 2708 kB' 'Cached: 10989384 kB' 'SwapCached: 0 kB' 'Active: 7389428 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988308 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490400 kB' 'Mapped: 190956 kB' 'Shmem: 6501160 kB' 'KReclaimable: 465392 kB' 'Slab: 1044164 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578772 kB' 'KernelStack: 12880 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8065348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.109 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.109 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:12 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.110 12:30:13 -- setup/common.sh@33 -- # echo 0 00:02:40.110 12:30:13 -- setup/common.sh@33 -- # return 0 00:02:40.110 12:30:13 -- setup/hugepages.sh@99 -- # surp=0 00:02:40.110 12:30:13 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:40.110 12:30:13 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:40.110 12:30:13 -- setup/common.sh@18 -- # local node= 00:02:40.110 12:30:13 -- setup/common.sh@19 -- # local var val 00:02:40.110 12:30:13 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.110 12:30:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.110 12:30:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:40.110 12:30:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:40.110 12:30:13 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.110 12:30:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43553468 kB' 'MemAvailable: 47865160 kB' 'Buffers: 2708 kB' 'Cached: 10989396 kB' 'SwapCached: 0 kB' 'Active: 7389452 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988332 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490300 kB' 'Mapped: 190880 kB' 'Shmem: 6501172 kB' 'KReclaimable: 465392 kB' 'Slab: 1044108 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578716 kB' 'KernelStack: 12896 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8065232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.110 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.110 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.111 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.111 12:30:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:40.112 12:30:13 -- setup/common.sh@33 -- # echo 0 00:02:40.112 12:30:13 -- setup/common.sh@33 -- # return 0 00:02:40.112 12:30:13 -- setup/hugepages.sh@100 -- # resv=0 00:02:40.112 12:30:13 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:40.112 nr_hugepages=1536 00:02:40.112 12:30:13 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:40.112 resv_hugepages=0 00:02:40.112 12:30:13 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:40.112 surplus_hugepages=0 00:02:40.112 12:30:13 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:40.112 anon_hugepages=0 00:02:40.112 12:30:13 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:40.112 12:30:13 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:40.112 12:30:13 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:40.112 12:30:13 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:40.112 12:30:13 -- setup/common.sh@18 -- # local node= 00:02:40.112 12:30:13 -- setup/common.sh@19 -- # local var val 00:02:40.112 12:30:13 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.112 12:30:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.112 12:30:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:40.112 12:30:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:40.112 12:30:13 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.112 12:30:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43554332 kB' 'MemAvailable: 47866024 kB' 'Buffers: 2708 kB' 'Cached: 10989408 kB' 'SwapCached: 0 kB' 'Active: 7389160 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988040 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490012 kB' 'Mapped: 190880 kB' 'Shmem: 6501184 kB' 'KReclaimable: 465392 kB' 'Slab: 1044100 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578708 kB' 'KernelStack: 12864 kB' 'PageTables: 7752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8065376 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.112 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.112 12:30:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.113 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:40.113 12:30:13 -- setup/common.sh@33 -- # echo 1536 00:02:40.113 12:30:13 -- setup/common.sh@33 -- # return 0 00:02:40.113 12:30:13 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:40.113 12:30:13 -- setup/hugepages.sh@112 -- # get_nodes 00:02:40.113 12:30:13 -- setup/hugepages.sh@27 -- # local node 00:02:40.113 12:30:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:40.113 12:30:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:40.113 12:30:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:40.113 12:30:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:40.113 12:30:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:40.113 12:30:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:40.113 12:30:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:40.113 12:30:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:40.113 12:30:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:40.113 12:30:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:40.113 12:30:13 -- setup/common.sh@18 -- # local node=0 00:02:40.113 12:30:13 -- setup/common.sh@19 -- # local var val 00:02:40.113 12:30:13 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.113 12:30:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.113 12:30:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:40.113 12:30:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:40.113 12:30:13 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.113 12:30:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.113 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21209180 kB' 'MemUsed: 11665744 kB' 'SwapCached: 0 kB' 'Active: 5488664 kB' 'Inactive: 3554096 kB' 'Active(anon): 5281156 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793552 kB' 'Mapped: 133204 kB' 'AnonPages: 252356 kB' 'Shmem: 5031948 kB' 'KernelStack: 7816 kB' 'PageTables: 4824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683336 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372160 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.114 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.114 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.114 12:30:13 -- setup/common.sh@33 -- # echo 0 00:02:40.114 12:30:13 -- setup/common.sh@33 -- # return 0 00:02:40.114 12:30:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:40.114 12:30:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:40.114 12:30:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:40.114 12:30:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:40.114 12:30:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:40.114 12:30:13 -- setup/common.sh@18 -- # local node=1 00:02:40.114 12:30:13 -- setup/common.sh@19 -- # local var val 00:02:40.114 12:30:13 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.114 12:30:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.114 12:30:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:40.114 12:30:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:40.115 12:30:13 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.115 12:30:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22345556 kB' 'MemUsed: 5315192 kB' 'SwapCached: 0 kB' 'Active: 1900708 kB' 'Inactive: 535716 kB' 'Active(anon): 1707096 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2198580 kB' 'Mapped: 57676 kB' 'AnonPages: 237892 kB' 'Shmem: 1469252 kB' 'KernelStack: 5064 kB' 'PageTables: 2980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154216 kB' 'Slab: 360764 kB' 'SReclaimable: 154216 kB' 'SUnreclaim: 206548 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # continue 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.115 12:30:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.115 12:30:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:40.115 12:30:13 -- setup/common.sh@33 -- # echo 0 00:02:40.115 12:30:13 -- setup/common.sh@33 -- # return 0 00:02:40.116 12:30:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:40.116 12:30:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:40.116 12:30:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:40.116 12:30:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:40.116 12:30:13 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:40.116 node0=512 expecting 512 00:02:40.116 12:30:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:40.116 12:30:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:40.116 12:30:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:40.116 12:30:13 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:40.116 node1=1024 expecting 1024 00:02:40.116 12:30:13 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:40.116 00:02:40.116 real 0m1.489s 00:02:40.116 user 0m0.616s 00:02:40.116 sys 0m0.840s 00:02:40.116 12:30:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:40.116 12:30:13 -- common/autotest_common.sh@10 -- # set +x 00:02:40.116 ************************************ 00:02:40.116 END TEST custom_alloc 00:02:40.116 ************************************ 00:02:40.116 12:30:13 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:40.116 12:30:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:40.116 12:30:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:40.116 12:30:13 -- common/autotest_common.sh@10 -- # set +x 00:02:40.116 ************************************ 00:02:40.116 START TEST no_shrink_alloc 00:02:40.116 ************************************ 00:02:40.116 12:30:13 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:02:40.116 12:30:13 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:40.116 12:30:13 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:40.116 12:30:13 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:40.116 12:30:13 -- setup/hugepages.sh@51 -- # shift 00:02:40.116 12:30:13 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:40.116 12:30:13 -- setup/hugepages.sh@52 -- # local node_ids 00:02:40.116 12:30:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:40.116 12:30:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:40.116 12:30:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:40.116 12:30:13 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:40.116 12:30:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:40.116 12:30:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:40.116 12:30:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:40.116 12:30:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:40.116 12:30:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:40.116 12:30:13 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:40.116 12:30:13 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:40.116 12:30:13 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:40.116 12:30:13 -- setup/hugepages.sh@73 -- # return 0 00:02:40.116 12:30:13 -- setup/hugepages.sh@198 -- # setup output 00:02:40.116 12:30:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:40.116 12:30:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:41.499 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:41.499 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:41.499 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:41.499 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:41.499 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:41.499 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:41.499 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:41.499 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:41.499 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:41.499 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:41.499 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:41.499 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:41.499 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:41.499 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:41.499 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:41.499 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:41.499 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:41.499 12:30:14 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:02:41.499 12:30:14 -- setup/hugepages.sh@89 -- # local node 00:02:41.499 12:30:14 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:41.499 12:30:14 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:41.499 12:30:14 -- setup/hugepages.sh@92 -- # local surp 00:02:41.499 12:30:14 -- setup/hugepages.sh@93 -- # local resv 00:02:41.499 12:30:14 -- setup/hugepages.sh@94 -- # local anon 00:02:41.499 12:30:14 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:41.499 12:30:14 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:41.499 12:30:14 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:41.499 12:30:14 -- setup/common.sh@18 -- # local node= 00:02:41.499 12:30:14 -- setup/common.sh@19 -- # local var val 00:02:41.499 12:30:14 -- setup/common.sh@20 -- # local mem_f mem 00:02:41.499 12:30:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:41.499 12:30:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:41.499 12:30:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:41.499 12:30:14 -- setup/common.sh@28 -- # mapfile -t mem 00:02:41.499 12:30:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44582168 kB' 'MemAvailable: 48893860 kB' 'Buffers: 2708 kB' 'Cached: 10989480 kB' 'SwapCached: 0 kB' 'Active: 7396248 kB' 'Inactive: 4089812 kB' 'Active(anon): 6995128 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 497080 kB' 'Mapped: 191760 kB' 'Shmem: 6501256 kB' 'KReclaimable: 465392 kB' 'Slab: 1044320 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578928 kB' 'KernelStack: 12848 kB' 'PageTables: 7696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8071684 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198992 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.499 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.499 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.500 12:30:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:41.500 12:30:14 -- setup/common.sh@33 -- # echo 0 00:02:41.500 12:30:14 -- setup/common.sh@33 -- # return 0 00:02:41.500 12:30:14 -- setup/hugepages.sh@97 -- # anon=0 00:02:41.500 12:30:14 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:41.500 12:30:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:41.500 12:30:14 -- setup/common.sh@18 -- # local node= 00:02:41.500 12:30:14 -- setup/common.sh@19 -- # local var val 00:02:41.500 12:30:14 -- setup/common.sh@20 -- # local mem_f mem 00:02:41.500 12:30:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:41.500 12:30:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:41.500 12:30:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:41.500 12:30:14 -- setup/common.sh@28 -- # mapfile -t mem 00:02:41.500 12:30:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.500 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44588836 kB' 'MemAvailable: 48900528 kB' 'Buffers: 2708 kB' 'Cached: 10989480 kB' 'SwapCached: 0 kB' 'Active: 7391176 kB' 'Inactive: 4089812 kB' 'Active(anon): 6990056 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492076 kB' 'Mapped: 191324 kB' 'Shmem: 6501256 kB' 'KReclaimable: 465392 kB' 'Slab: 1044316 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578924 kB' 'KernelStack: 12832 kB' 'PageTables: 7632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065576 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.501 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.501 12:30:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.502 12:30:14 -- setup/common.sh@33 -- # echo 0 00:02:41.502 12:30:14 -- setup/common.sh@33 -- # return 0 00:02:41.502 12:30:14 -- setup/hugepages.sh@99 -- # surp=0 00:02:41.502 12:30:14 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:41.502 12:30:14 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:41.502 12:30:14 -- setup/common.sh@18 -- # local node= 00:02:41.502 12:30:14 -- setup/common.sh@19 -- # local var val 00:02:41.502 12:30:14 -- setup/common.sh@20 -- # local mem_f mem 00:02:41.502 12:30:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:41.502 12:30:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:41.502 12:30:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:41.502 12:30:14 -- setup/common.sh@28 -- # mapfile -t mem 00:02:41.502 12:30:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44589008 kB' 'MemAvailable: 48900700 kB' 'Buffers: 2708 kB' 'Cached: 10989500 kB' 'SwapCached: 0 kB' 'Active: 7390120 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989000 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490928 kB' 'Mapped: 190884 kB' 'Shmem: 6501276 kB' 'KReclaimable: 465392 kB' 'Slab: 1044348 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578956 kB' 'KernelStack: 12864 kB' 'PageTables: 7712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.502 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.502 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:41.503 12:30:14 -- setup/common.sh@33 -- # echo 0 00:02:41.503 12:30:14 -- setup/common.sh@33 -- # return 0 00:02:41.503 12:30:14 -- setup/hugepages.sh@100 -- # resv=0 00:02:41.503 12:30:14 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:41.503 nr_hugepages=1024 00:02:41.503 12:30:14 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:41.503 resv_hugepages=0 00:02:41.503 12:30:14 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:41.503 surplus_hugepages=0 00:02:41.503 12:30:14 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:41.503 anon_hugepages=0 00:02:41.503 12:30:14 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:41.503 12:30:14 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:41.503 12:30:14 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:41.503 12:30:14 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:41.503 12:30:14 -- setup/common.sh@18 -- # local node= 00:02:41.503 12:30:14 -- setup/common.sh@19 -- # local var val 00:02:41.503 12:30:14 -- setup/common.sh@20 -- # local mem_f mem 00:02:41.503 12:30:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:41.503 12:30:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:41.503 12:30:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:41.503 12:30:14 -- setup/common.sh@28 -- # mapfile -t mem 00:02:41.503 12:30:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.503 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.503 12:30:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44588756 kB' 'MemAvailable: 48900448 kB' 'Buffers: 2708 kB' 'Cached: 10989508 kB' 'SwapCached: 0 kB' 'Active: 7390068 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988948 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490868 kB' 'Mapped: 190884 kB' 'Shmem: 6501284 kB' 'KReclaimable: 465392 kB' 'Slab: 1044348 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578956 kB' 'KernelStack: 12848 kB' 'PageTables: 7664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:41.503 12:30:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.504 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.504 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:41.505 12:30:14 -- setup/common.sh@33 -- # echo 1024 00:02:41.505 12:30:14 -- setup/common.sh@33 -- # return 0 00:02:41.505 12:30:14 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:41.505 12:30:14 -- setup/hugepages.sh@112 -- # get_nodes 00:02:41.505 12:30:14 -- setup/hugepages.sh@27 -- # local node 00:02:41.505 12:30:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:41.505 12:30:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:41.505 12:30:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:41.505 12:30:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:41.505 12:30:14 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:41.505 12:30:14 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:41.505 12:30:14 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:41.505 12:30:14 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:41.505 12:30:14 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:41.505 12:30:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:41.505 12:30:14 -- setup/common.sh@18 -- # local node=0 00:02:41.505 12:30:14 -- setup/common.sh@19 -- # local var val 00:02:41.505 12:30:14 -- setup/common.sh@20 -- # local mem_f mem 00:02:41.505 12:30:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:41.505 12:30:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:41.505 12:30:14 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:41.505 12:30:14 -- setup/common.sh@28 -- # mapfile -t mem 00:02:41.505 12:30:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20147496 kB' 'MemUsed: 12727428 kB' 'SwapCached: 0 kB' 'Active: 5488784 kB' 'Inactive: 3554096 kB' 'Active(anon): 5281276 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793648 kB' 'Mapped: 133204 kB' 'AnonPages: 252456 kB' 'Shmem: 5032044 kB' 'KernelStack: 7832 kB' 'PageTables: 4828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683536 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372360 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.505 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.505 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # continue 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.506 12:30:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.506 12:30:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:41.506 12:30:14 -- setup/common.sh@33 -- # echo 0 00:02:41.506 12:30:14 -- setup/common.sh@33 -- # return 0 00:02:41.506 12:30:14 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:41.506 12:30:14 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:41.506 12:30:14 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:41.506 12:30:14 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:41.506 12:30:14 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:41.506 node0=1024 expecting 1024 00:02:41.506 12:30:14 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:41.506 12:30:14 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:02:41.506 12:30:14 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:02:41.506 12:30:14 -- setup/hugepages.sh@202 -- # setup output 00:02:41.506 12:30:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:41.506 12:30:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:42.886 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:42.886 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:42.886 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:42.886 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:42.886 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:42.886 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:42.886 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:42.886 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:42.886 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:42.886 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:42.886 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:42.886 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:42.886 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:42.886 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:42.886 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:42.886 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:42.886 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:42.886 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:02:42.886 12:30:15 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:02:42.886 12:30:15 -- setup/hugepages.sh@89 -- # local node 00:02:42.886 12:30:15 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:42.886 12:30:15 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:42.886 12:30:15 -- setup/hugepages.sh@92 -- # local surp 00:02:42.886 12:30:15 -- setup/hugepages.sh@93 -- # local resv 00:02:42.886 12:30:15 -- setup/hugepages.sh@94 -- # local anon 00:02:42.886 12:30:15 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:42.886 12:30:15 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:42.886 12:30:15 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:42.886 12:30:15 -- setup/common.sh@18 -- # local node= 00:02:42.886 12:30:15 -- setup/common.sh@19 -- # local var val 00:02:42.886 12:30:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:42.886 12:30:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:42.886 12:30:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:42.886 12:30:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:42.886 12:30:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:42.886 12:30:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44582908 kB' 'MemAvailable: 48894600 kB' 'Buffers: 2708 kB' 'Cached: 10989552 kB' 'SwapCached: 0 kB' 'Active: 7390412 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989292 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491252 kB' 'Mapped: 190900 kB' 'Shmem: 6501328 kB' 'KReclaimable: 465392 kB' 'Slab: 1044212 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578820 kB' 'KernelStack: 12912 kB' 'PageTables: 7832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065636 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.886 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.886 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:42.887 12:30:15 -- setup/common.sh@33 -- # echo 0 00:02:42.887 12:30:15 -- setup/common.sh@33 -- # return 0 00:02:42.887 12:30:15 -- setup/hugepages.sh@97 -- # anon=0 00:02:42.887 12:30:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:42.887 12:30:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:42.887 12:30:15 -- setup/common.sh@18 -- # local node= 00:02:42.887 12:30:15 -- setup/common.sh@19 -- # local var val 00:02:42.887 12:30:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:42.887 12:30:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:42.887 12:30:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:42.887 12:30:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:42.887 12:30:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:42.887 12:30:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44584388 kB' 'MemAvailable: 48896080 kB' 'Buffers: 2708 kB' 'Cached: 10989552 kB' 'SwapCached: 0 kB' 'Active: 7391036 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989916 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491896 kB' 'Mapped: 190980 kB' 'Shmem: 6501328 kB' 'KReclaimable: 465392 kB' 'Slab: 1044260 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578868 kB' 'KernelStack: 12928 kB' 'PageTables: 7884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.887 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.887 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.888 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.888 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.889 12:30:15 -- setup/common.sh@33 -- # echo 0 00:02:42.889 12:30:15 -- setup/common.sh@33 -- # return 0 00:02:42.889 12:30:15 -- setup/hugepages.sh@99 -- # surp=0 00:02:42.889 12:30:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:42.889 12:30:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:42.889 12:30:15 -- setup/common.sh@18 -- # local node= 00:02:42.889 12:30:15 -- setup/common.sh@19 -- # local var val 00:02:42.889 12:30:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:42.889 12:30:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:42.889 12:30:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:42.889 12:30:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:42.889 12:30:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:42.889 12:30:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44584576 kB' 'MemAvailable: 48896268 kB' 'Buffers: 2708 kB' 'Cached: 10989556 kB' 'SwapCached: 0 kB' 'Active: 7390592 kB' 'Inactive: 4089812 kB' 'Active(anon): 6989472 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491428 kB' 'Mapped: 190964 kB' 'Shmem: 6501332 kB' 'KReclaimable: 465392 kB' 'Slab: 1044236 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578844 kB' 'KernelStack: 12912 kB' 'PageTables: 7828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.889 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.889 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:42.890 12:30:15 -- setup/common.sh@33 -- # echo 0 00:02:42.890 12:30:15 -- setup/common.sh@33 -- # return 0 00:02:42.890 12:30:15 -- setup/hugepages.sh@100 -- # resv=0 00:02:42.890 12:30:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:42.890 nr_hugepages=1024 00:02:42.890 12:30:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:42.890 resv_hugepages=0 00:02:42.890 12:30:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:42.890 surplus_hugepages=0 00:02:42.890 12:30:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:42.890 anon_hugepages=0 00:02:42.890 12:30:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:42.890 12:30:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:42.890 12:30:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:42.890 12:30:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:42.890 12:30:15 -- setup/common.sh@18 -- # local node= 00:02:42.890 12:30:15 -- setup/common.sh@19 -- # local var val 00:02:42.890 12:30:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:42.890 12:30:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:42.890 12:30:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:42.890 12:30:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:42.890 12:30:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:42.890 12:30:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44584740 kB' 'MemAvailable: 48896432 kB' 'Buffers: 2708 kB' 'Cached: 10989568 kB' 'SwapCached: 0 kB' 'Active: 7389896 kB' 'Inactive: 4089812 kB' 'Active(anon): 6988776 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490676 kB' 'Mapped: 190888 kB' 'Shmem: 6501344 kB' 'KReclaimable: 465392 kB' 'Slab: 1044204 kB' 'SReclaimable: 465392 kB' 'SUnreclaim: 578812 kB' 'KernelStack: 12864 kB' 'PageTables: 7672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065680 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 40704 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2451036 kB' 'DirectMap2M: 17391616 kB' 'DirectMap1G: 50331648 kB' 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.890 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.890 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.891 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.891 12:30:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:42.892 12:30:15 -- setup/common.sh@33 -- # echo 1024 00:02:42.892 12:30:15 -- setup/common.sh@33 -- # return 0 00:02:42.892 12:30:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:42.892 12:30:15 -- setup/hugepages.sh@112 -- # get_nodes 00:02:42.892 12:30:15 -- setup/hugepages.sh@27 -- # local node 00:02:42.892 12:30:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:42.892 12:30:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:42.892 12:30:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:42.892 12:30:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:42.892 12:30:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:42.892 12:30:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:42.892 12:30:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:42.892 12:30:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:42.892 12:30:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:42.892 12:30:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:42.892 12:30:15 -- setup/common.sh@18 -- # local node=0 00:02:42.892 12:30:15 -- setup/common.sh@19 -- # local var val 00:02:42.892 12:30:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:42.892 12:30:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:42.892 12:30:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:42.892 12:30:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:42.892 12:30:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:42.892 12:30:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20141612 kB' 'MemUsed: 12733312 kB' 'SwapCached: 0 kB' 'Active: 5488712 kB' 'Inactive: 3554096 kB' 'Active(anon): 5281204 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8793704 kB' 'Mapped: 133204 kB' 'AnonPages: 252300 kB' 'Shmem: 5032100 kB' 'KernelStack: 7848 kB' 'PageTables: 4828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 311176 kB' 'Slab: 683368 kB' 'SReclaimable: 311176 kB' 'SUnreclaim: 372192 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.892 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.892 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # continue 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.893 12:30:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.893 12:30:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:42.893 12:30:15 -- setup/common.sh@33 -- # echo 0 00:02:42.893 12:30:15 -- setup/common.sh@33 -- # return 0 00:02:42.893 12:30:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:42.893 12:30:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:42.893 12:30:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:42.893 12:30:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:42.893 12:30:15 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:42.893 node0=1024 expecting 1024 00:02:42.893 12:30:15 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:42.893 00:02:42.893 real 0m2.771s 00:02:42.893 user 0m1.116s 00:02:42.893 sys 0m1.584s 00:02:42.893 12:30:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:42.893 12:30:15 -- common/autotest_common.sh@10 -- # set +x 00:02:42.893 ************************************ 00:02:42.893 END TEST no_shrink_alloc 00:02:42.893 ************************************ 00:02:42.893 12:30:15 -- setup/hugepages.sh@217 -- # clear_hp 00:02:42.893 12:30:15 -- setup/hugepages.sh@37 -- # local node hp 00:02:42.893 12:30:15 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:42.893 12:30:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.893 12:30:15 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.893 12:30:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.893 12:30:15 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.893 12:30:15 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:42.893 12:30:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.893 12:30:15 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.893 12:30:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.893 12:30:15 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.893 12:30:15 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:42.893 12:30:15 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:42.893 00:02:42.893 real 0m11.358s 00:02:42.893 user 0m4.334s 00:02:42.893 sys 0m5.933s 00:02:42.893 12:30:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:42.893 12:30:15 -- common/autotest_common.sh@10 -- # set +x 00:02:42.893 ************************************ 00:02:42.893 END TEST hugepages 00:02:42.893 ************************************ 00:02:42.893 12:30:15 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:42.893 12:30:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:42.893 12:30:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:42.893 12:30:15 -- common/autotest_common.sh@10 -- # set +x 00:02:42.893 ************************************ 00:02:42.893 START TEST driver 00:02:42.893 ************************************ 00:02:42.893 12:30:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:43.152 * Looking for test storage... 00:02:43.152 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:43.152 12:30:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:43.152 12:30:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:43.152 12:30:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:43.152 12:30:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:43.152 12:30:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:43.152 12:30:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:43.152 12:30:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:43.152 12:30:16 -- scripts/common.sh@335 -- # IFS=.-: 00:02:43.152 12:30:16 -- scripts/common.sh@335 -- # read -ra ver1 00:02:43.152 12:30:16 -- scripts/common.sh@336 -- # IFS=.-: 00:02:43.152 12:30:16 -- scripts/common.sh@336 -- # read -ra ver2 00:02:43.152 12:30:16 -- scripts/common.sh@337 -- # local 'op=<' 00:02:43.152 12:30:16 -- scripts/common.sh@339 -- # ver1_l=2 00:02:43.152 12:30:16 -- scripts/common.sh@340 -- # ver2_l=1 00:02:43.152 12:30:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:43.152 12:30:16 -- scripts/common.sh@343 -- # case "$op" in 00:02:43.152 12:30:16 -- scripts/common.sh@344 -- # : 1 00:02:43.152 12:30:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:43.152 12:30:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:43.152 12:30:16 -- scripts/common.sh@364 -- # decimal 1 00:02:43.152 12:30:16 -- scripts/common.sh@352 -- # local d=1 00:02:43.152 12:30:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:43.152 12:30:16 -- scripts/common.sh@354 -- # echo 1 00:02:43.152 12:30:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:43.152 12:30:16 -- scripts/common.sh@365 -- # decimal 2 00:02:43.152 12:30:16 -- scripts/common.sh@352 -- # local d=2 00:02:43.152 12:30:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:43.152 12:30:16 -- scripts/common.sh@354 -- # echo 2 00:02:43.152 12:30:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:43.152 12:30:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:43.152 12:30:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:43.152 12:30:16 -- scripts/common.sh@367 -- # return 0 00:02:43.152 12:30:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:43.152 12:30:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:43.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:43.152 --rc genhtml_branch_coverage=1 00:02:43.152 --rc genhtml_function_coverage=1 00:02:43.152 --rc genhtml_legend=1 00:02:43.152 --rc geninfo_all_blocks=1 00:02:43.152 --rc geninfo_unexecuted_blocks=1 00:02:43.152 00:02:43.152 ' 00:02:43.152 12:30:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:43.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:43.152 --rc genhtml_branch_coverage=1 00:02:43.152 --rc genhtml_function_coverage=1 00:02:43.152 --rc genhtml_legend=1 00:02:43.152 --rc geninfo_all_blocks=1 00:02:43.152 --rc geninfo_unexecuted_blocks=1 00:02:43.152 00:02:43.152 ' 00:02:43.152 12:30:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:43.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:43.152 --rc genhtml_branch_coverage=1 00:02:43.152 --rc genhtml_function_coverage=1 00:02:43.152 --rc genhtml_legend=1 00:02:43.152 --rc geninfo_all_blocks=1 00:02:43.152 --rc geninfo_unexecuted_blocks=1 00:02:43.152 00:02:43.152 ' 00:02:43.152 12:30:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:43.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:43.152 --rc genhtml_branch_coverage=1 00:02:43.152 --rc genhtml_function_coverage=1 00:02:43.152 --rc genhtml_legend=1 00:02:43.152 --rc geninfo_all_blocks=1 00:02:43.152 --rc geninfo_unexecuted_blocks=1 00:02:43.152 00:02:43.152 ' 00:02:43.152 12:30:16 -- setup/driver.sh@68 -- # setup reset 00:02:43.152 12:30:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:43.152 12:30:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:45.688 12:30:18 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:02:45.688 12:30:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.688 12:30:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.688 12:30:18 -- common/autotest_common.sh@10 -- # set +x 00:02:45.688 ************************************ 00:02:45.688 START TEST guess_driver 00:02:45.688 ************************************ 00:02:45.688 12:30:18 -- common/autotest_common.sh@1114 -- # guess_driver 00:02:45.688 12:30:18 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:02:45.688 12:30:18 -- setup/driver.sh@47 -- # local fail=0 00:02:45.688 12:30:18 -- setup/driver.sh@49 -- # pick_driver 00:02:45.688 12:30:18 -- setup/driver.sh@36 -- # vfio 00:02:45.688 12:30:18 -- setup/driver.sh@21 -- # local iommu_grups 00:02:45.688 12:30:18 -- setup/driver.sh@22 -- # local unsafe_vfio 00:02:45.688 12:30:18 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:02:45.688 12:30:18 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:02:45.688 12:30:18 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:02:45.688 12:30:18 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:02:45.688 12:30:18 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:02:45.688 12:30:18 -- setup/driver.sh@14 -- # mod vfio_pci 00:02:45.688 12:30:18 -- setup/driver.sh@12 -- # dep vfio_pci 00:02:45.688 12:30:18 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:02:45.688 12:30:18 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:02:45.688 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:02:45.688 12:30:18 -- setup/driver.sh@30 -- # return 0 00:02:45.688 12:30:18 -- setup/driver.sh@37 -- # echo vfio-pci 00:02:45.688 12:30:18 -- setup/driver.sh@49 -- # driver=vfio-pci 00:02:45.688 12:30:18 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:02:45.688 12:30:18 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:02:45.688 Looking for driver=vfio-pci 00:02:45.688 12:30:18 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:45.688 12:30:18 -- setup/driver.sh@45 -- # setup output config 00:02:45.688 12:30:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:45.688 12:30:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.630 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.630 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.630 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:46.895 12:30:19 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:46.895 12:30:19 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:46.895 12:30:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:47.838 12:30:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:47.838 12:30:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:47.838 12:30:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:47.838 12:30:20 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:02:47.838 12:30:20 -- setup/driver.sh@65 -- # setup reset 00:02:47.838 12:30:20 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:47.838 12:30:20 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:50.371 00:02:50.371 real 0m4.881s 00:02:50.371 user 0m1.141s 00:02:50.371 sys 0m1.925s 00:02:50.371 12:30:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:50.371 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:02:50.371 ************************************ 00:02:50.371 END TEST guess_driver 00:02:50.371 ************************************ 00:02:50.371 00:02:50.371 real 0m7.458s 00:02:50.371 user 0m1.756s 00:02:50.371 sys 0m2.969s 00:02:50.371 12:30:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:50.371 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:02:50.371 ************************************ 00:02:50.371 END TEST driver 00:02:50.371 ************************************ 00:02:50.371 12:30:23 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:02:50.371 12:30:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:50.371 12:30:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:50.371 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:02:50.371 ************************************ 00:02:50.371 START TEST devices 00:02:50.371 ************************************ 00:02:50.371 12:30:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:02:50.630 * Looking for test storage... 00:02:50.630 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:50.630 12:30:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:50.630 12:30:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:50.630 12:30:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:50.630 12:30:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:50.630 12:30:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:50.630 12:30:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:50.630 12:30:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:50.630 12:30:23 -- scripts/common.sh@335 -- # IFS=.-: 00:02:50.630 12:30:23 -- scripts/common.sh@335 -- # read -ra ver1 00:02:50.630 12:30:23 -- scripts/common.sh@336 -- # IFS=.-: 00:02:50.630 12:30:23 -- scripts/common.sh@336 -- # read -ra ver2 00:02:50.630 12:30:23 -- scripts/common.sh@337 -- # local 'op=<' 00:02:50.630 12:30:23 -- scripts/common.sh@339 -- # ver1_l=2 00:02:50.630 12:30:23 -- scripts/common.sh@340 -- # ver2_l=1 00:02:50.630 12:30:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:50.630 12:30:23 -- scripts/common.sh@343 -- # case "$op" in 00:02:50.630 12:30:23 -- scripts/common.sh@344 -- # : 1 00:02:50.630 12:30:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:50.630 12:30:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:50.630 12:30:23 -- scripts/common.sh@364 -- # decimal 1 00:02:50.630 12:30:23 -- scripts/common.sh@352 -- # local d=1 00:02:50.630 12:30:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:50.630 12:30:23 -- scripts/common.sh@354 -- # echo 1 00:02:50.630 12:30:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:50.630 12:30:23 -- scripts/common.sh@365 -- # decimal 2 00:02:50.630 12:30:23 -- scripts/common.sh@352 -- # local d=2 00:02:50.630 12:30:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:50.630 12:30:23 -- scripts/common.sh@354 -- # echo 2 00:02:50.630 12:30:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:50.630 12:30:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:50.630 12:30:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:50.630 12:30:23 -- scripts/common.sh@367 -- # return 0 00:02:50.630 12:30:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:50.630 12:30:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:50.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:50.630 --rc genhtml_branch_coverage=1 00:02:50.630 --rc genhtml_function_coverage=1 00:02:50.630 --rc genhtml_legend=1 00:02:50.630 --rc geninfo_all_blocks=1 00:02:50.630 --rc geninfo_unexecuted_blocks=1 00:02:50.630 00:02:50.630 ' 00:02:50.630 12:30:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:50.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:50.630 --rc genhtml_branch_coverage=1 00:02:50.630 --rc genhtml_function_coverage=1 00:02:50.630 --rc genhtml_legend=1 00:02:50.630 --rc geninfo_all_blocks=1 00:02:50.630 --rc geninfo_unexecuted_blocks=1 00:02:50.630 00:02:50.630 ' 00:02:50.630 12:30:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:50.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:50.630 --rc genhtml_branch_coverage=1 00:02:50.630 --rc genhtml_function_coverage=1 00:02:50.630 --rc genhtml_legend=1 00:02:50.630 --rc geninfo_all_blocks=1 00:02:50.630 --rc geninfo_unexecuted_blocks=1 00:02:50.630 00:02:50.630 ' 00:02:50.630 12:30:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:50.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:50.630 --rc genhtml_branch_coverage=1 00:02:50.630 --rc genhtml_function_coverage=1 00:02:50.630 --rc genhtml_legend=1 00:02:50.630 --rc geninfo_all_blocks=1 00:02:50.630 --rc geninfo_unexecuted_blocks=1 00:02:50.630 00:02:50.631 ' 00:02:50.631 12:30:23 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:02:50.631 12:30:23 -- setup/devices.sh@192 -- # setup reset 00:02:50.631 12:30:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:50.631 12:30:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:52.011 12:30:25 -- setup/devices.sh@194 -- # get_zoned_devs 00:02:52.011 12:30:25 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:52.011 12:30:25 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:52.011 12:30:25 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:52.011 12:30:25 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:52.011 12:30:25 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:52.011 12:30:25 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:52.011 12:30:25 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:52.011 12:30:25 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:52.011 12:30:25 -- setup/devices.sh@196 -- # blocks=() 00:02:52.011 12:30:25 -- setup/devices.sh@196 -- # declare -a blocks 00:02:52.011 12:30:25 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:02:52.011 12:30:25 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:02:52.011 12:30:25 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:02:52.011 12:30:25 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:02:52.011 12:30:25 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:02:52.011 12:30:25 -- setup/devices.sh@201 -- # ctrl=nvme0 00:02:52.011 12:30:25 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:02:52.011 12:30:25 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:52.011 12:30:25 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:02:52.011 12:30:25 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:02:52.011 12:30:25 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:02:52.271 No valid GPT data, bailing 00:02:52.271 12:30:25 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:52.271 12:30:25 -- scripts/common.sh@393 -- # pt= 00:02:52.271 12:30:25 -- scripts/common.sh@394 -- # return 1 00:02:52.271 12:30:25 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:02:52.271 12:30:25 -- setup/common.sh@76 -- # local dev=nvme0n1 00:02:52.271 12:30:25 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:02:52.271 12:30:25 -- setup/common.sh@80 -- # echo 1000204886016 00:02:52.271 12:30:25 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:02:52.271 12:30:25 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:02:52.271 12:30:25 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:02:52.271 12:30:25 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:02:52.271 12:30:25 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:02:52.271 12:30:25 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:02:52.271 12:30:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:52.271 12:30:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:52.271 12:30:25 -- common/autotest_common.sh@10 -- # set +x 00:02:52.271 ************************************ 00:02:52.271 START TEST nvme_mount 00:02:52.271 ************************************ 00:02:52.271 12:30:25 -- common/autotest_common.sh@1114 -- # nvme_mount 00:02:52.271 12:30:25 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:02:52.271 12:30:25 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:02:52.271 12:30:25 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:52.271 12:30:25 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:52.271 12:30:25 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:02:52.271 12:30:25 -- setup/common.sh@39 -- # local disk=nvme0n1 00:02:52.271 12:30:25 -- setup/common.sh@40 -- # local part_no=1 00:02:52.271 12:30:25 -- setup/common.sh@41 -- # local size=1073741824 00:02:52.271 12:30:25 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:02:52.271 12:30:25 -- setup/common.sh@44 -- # parts=() 00:02:52.271 12:30:25 -- setup/common.sh@44 -- # local parts 00:02:52.271 12:30:25 -- setup/common.sh@46 -- # (( part = 1 )) 00:02:52.271 12:30:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:02:52.271 12:30:25 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:02:52.271 12:30:25 -- setup/common.sh@46 -- # (( part++ )) 00:02:52.271 12:30:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:02:52.271 12:30:25 -- setup/common.sh@51 -- # (( size /= 512 )) 00:02:52.271 12:30:25 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:02:52.271 12:30:25 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:02:53.211 Creating new GPT entries in memory. 00:02:53.211 GPT data structures destroyed! You may now partition the disk using fdisk or 00:02:53.211 other utilities. 00:02:53.211 12:30:26 -- setup/common.sh@57 -- # (( part = 1 )) 00:02:53.211 12:30:26 -- setup/common.sh@57 -- # (( part <= part_no )) 00:02:53.211 12:30:26 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:02:53.211 12:30:26 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:02:53.212 12:30:26 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:02:54.150 Creating new GPT entries in memory. 00:02:54.150 The operation has completed successfully. 00:02:54.150 12:30:27 -- setup/common.sh@57 -- # (( part++ )) 00:02:54.150 12:30:27 -- setup/common.sh@57 -- # (( part <= part_no )) 00:02:54.150 12:30:27 -- setup/common.sh@62 -- # wait 3387354 00:02:54.150 12:30:27 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:54.150 12:30:27 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:02:54.150 12:30:27 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:54.150 12:30:27 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:02:54.150 12:30:27 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:02:54.150 12:30:27 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:54.409 12:30:27 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:54.409 12:30:27 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:02:54.409 12:30:27 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:02:54.409 12:30:27 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:54.409 12:30:27 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:54.409 12:30:27 -- setup/devices.sh@53 -- # local found=0 00:02:54.409 12:30:27 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:02:54.409 12:30:27 -- setup/devices.sh@56 -- # : 00:02:54.409 12:30:27 -- setup/devices.sh@59 -- # local pci status 00:02:54.409 12:30:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:54.409 12:30:27 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:02:54.409 12:30:27 -- setup/devices.sh@47 -- # setup output config 00:02:54.409 12:30:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:54.409 12:30:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:02:55.346 12:30:28 -- setup/devices.sh@63 -- # found=1 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.346 12:30:28 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:55.346 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.607 12:30:28 -- setup/devices.sh@66 -- # (( found == 1 )) 00:02:55.607 12:30:28 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:02:55.607 12:30:28 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:55.607 12:30:28 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:02:55.607 12:30:28 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:55.607 12:30:28 -- setup/devices.sh@110 -- # cleanup_nvme 00:02:55.607 12:30:28 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:55.607 12:30:28 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:55.607 12:30:28 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:02:55.607 12:30:28 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:02:55.607 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:02:55.607 12:30:28 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:02:55.607 12:30:28 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:02:55.865 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:02:55.865 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:02:55.865 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:02:55.865 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:02:55.865 12:30:28 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:02:55.865 12:30:28 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:02:55.865 12:30:28 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:55.865 12:30:28 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:02:55.866 12:30:28 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:02:55.866 12:30:28 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:55.866 12:30:28 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:55.866 12:30:28 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:02:55.866 12:30:28 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:02:55.866 12:30:28 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:55.866 12:30:28 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:55.866 12:30:28 -- setup/devices.sh@53 -- # local found=0 00:02:55.866 12:30:28 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:02:55.866 12:30:28 -- setup/devices.sh@56 -- # : 00:02:55.866 12:30:28 -- setup/devices.sh@59 -- # local pci status 00:02:55.866 12:30:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:55.866 12:30:28 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:02:55.866 12:30:28 -- setup/devices.sh@47 -- # setup output config 00:02:55.866 12:30:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:55.866 12:30:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:02:57.244 12:30:29 -- setup/devices.sh@63 -- # found=1 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@66 -- # (( found == 1 )) 00:02:57.244 12:30:30 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:02:57.244 12:30:30 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:57.244 12:30:30 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:02:57.244 12:30:30 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:02:57.244 12:30:30 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:57.244 12:30:30 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:02:57.244 12:30:30 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:02:57.244 12:30:30 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:02:57.244 12:30:30 -- setup/devices.sh@50 -- # local mount_point= 00:02:57.244 12:30:30 -- setup/devices.sh@51 -- # local test_file= 00:02:57.244 12:30:30 -- setup/devices.sh@53 -- # local found=0 00:02:57.244 12:30:30 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:02:57.244 12:30:30 -- setup/devices.sh@59 -- # local pci status 00:02:57.244 12:30:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:57.244 12:30:30 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:02:57.244 12:30:30 -- setup/devices.sh@47 -- # setup output config 00:02:57.245 12:30:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:57.245 12:30:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:02:58.624 12:30:31 -- setup/devices.sh@63 -- # found=1 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:02:58.624 12:30:31 -- setup/devices.sh@66 -- # (( found == 1 )) 00:02:58.624 12:30:31 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:02:58.624 12:30:31 -- setup/devices.sh@68 -- # return 0 00:02:58.624 12:30:31 -- setup/devices.sh@128 -- # cleanup_nvme 00:02:58.624 12:30:31 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:02:58.624 12:30:31 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:02:58.624 12:30:31 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:02:58.624 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:02:58.624 00:02:58.624 real 0m6.411s 00:02:58.624 user 0m1.489s 00:02:58.624 sys 0m2.504s 00:02:58.624 12:30:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:58.624 12:30:31 -- common/autotest_common.sh@10 -- # set +x 00:02:58.624 ************************************ 00:02:58.624 END TEST nvme_mount 00:02:58.624 ************************************ 00:02:58.624 12:30:31 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:02:58.624 12:30:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:58.624 12:30:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:58.624 12:30:31 -- common/autotest_common.sh@10 -- # set +x 00:02:58.624 ************************************ 00:02:58.624 START TEST dm_mount 00:02:58.624 ************************************ 00:02:58.624 12:30:31 -- common/autotest_common.sh@1114 -- # dm_mount 00:02:58.624 12:30:31 -- setup/devices.sh@144 -- # pv=nvme0n1 00:02:58.624 12:30:31 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:02:58.624 12:30:31 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:02:58.624 12:30:31 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:02:58.624 12:30:31 -- setup/common.sh@39 -- # local disk=nvme0n1 00:02:58.624 12:30:31 -- setup/common.sh@40 -- # local part_no=2 00:02:58.624 12:30:31 -- setup/common.sh@41 -- # local size=1073741824 00:02:58.624 12:30:31 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:02:58.624 12:30:31 -- setup/common.sh@44 -- # parts=() 00:02:58.624 12:30:31 -- setup/common.sh@44 -- # local parts 00:02:58.624 12:30:31 -- setup/common.sh@46 -- # (( part = 1 )) 00:02:58.624 12:30:31 -- setup/common.sh@46 -- # (( part <= part_no )) 00:02:58.624 12:30:31 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:02:58.624 12:30:31 -- setup/common.sh@46 -- # (( part++ )) 00:02:58.624 12:30:31 -- setup/common.sh@46 -- # (( part <= part_no )) 00:02:58.624 12:30:31 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:02:58.624 12:30:31 -- setup/common.sh@46 -- # (( part++ )) 00:02:58.624 12:30:31 -- setup/common.sh@46 -- # (( part <= part_no )) 00:02:58.624 12:30:31 -- setup/common.sh@51 -- # (( size /= 512 )) 00:02:58.624 12:30:31 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:02:58.624 12:30:31 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:02:59.564 Creating new GPT entries in memory. 00:02:59.564 GPT data structures destroyed! You may now partition the disk using fdisk or 00:02:59.564 other utilities. 00:02:59.564 12:30:32 -- setup/common.sh@57 -- # (( part = 1 )) 00:02:59.564 12:30:32 -- setup/common.sh@57 -- # (( part <= part_no )) 00:02:59.564 12:30:32 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:02:59.564 12:30:32 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:02:59.564 12:30:32 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:00.504 Creating new GPT entries in memory. 00:03:00.504 The operation has completed successfully. 00:03:00.504 12:30:33 -- setup/common.sh@57 -- # (( part++ )) 00:03:00.504 12:30:33 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:00.504 12:30:33 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:00.504 12:30:33 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:00.504 12:30:33 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:01.885 The operation has completed successfully. 00:03:01.885 12:30:34 -- setup/common.sh@57 -- # (( part++ )) 00:03:01.885 12:30:34 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:01.885 12:30:34 -- setup/common.sh@62 -- # wait 3389814 00:03:01.885 12:30:34 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:01.885 12:30:34 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:01.885 12:30:34 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:01.885 12:30:34 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:01.885 12:30:34 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:01.885 12:30:34 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:01.885 12:30:34 -- setup/devices.sh@161 -- # break 00:03:01.885 12:30:34 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:01.885 12:30:34 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:01.885 12:30:34 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:01.885 12:30:34 -- setup/devices.sh@166 -- # dm=dm-0 00:03:01.885 12:30:34 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:01.885 12:30:34 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:01.885 12:30:34 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:01.885 12:30:34 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:01.885 12:30:34 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:01.885 12:30:34 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:01.885 12:30:34 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:01.885 12:30:34 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:01.885 12:30:34 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:01.885 12:30:34 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:01.885 12:30:34 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:01.885 12:30:34 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:01.885 12:30:34 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:01.885 12:30:34 -- setup/devices.sh@53 -- # local found=0 00:03:01.885 12:30:34 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:01.885 12:30:34 -- setup/devices.sh@56 -- # : 00:03:01.885 12:30:34 -- setup/devices.sh@59 -- # local pci status 00:03:01.885 12:30:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:01.885 12:30:34 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:01.885 12:30:34 -- setup/devices.sh@47 -- # setup output config 00:03:01.885 12:30:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:01.886 12:30:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:02.820 12:30:35 -- setup/devices.sh@63 -- # found=1 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.820 12:30:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:02.820 12:30:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.079 12:30:36 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:03.079 12:30:36 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:03.079 12:30:36 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:03.079 12:30:36 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:03.079 12:30:36 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:03.079 12:30:36 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:03.079 12:30:36 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:03.079 12:30:36 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:03.079 12:30:36 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:03.079 12:30:36 -- setup/devices.sh@50 -- # local mount_point= 00:03:03.079 12:30:36 -- setup/devices.sh@51 -- # local test_file= 00:03:03.079 12:30:36 -- setup/devices.sh@53 -- # local found=0 00:03:03.079 12:30:36 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:03.079 12:30:36 -- setup/devices.sh@59 -- # local pci status 00:03:03.079 12:30:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.079 12:30:36 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:03.079 12:30:36 -- setup/devices.sh@47 -- # setup output config 00:03:03.079 12:30:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.079 12:30:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:04.016 12:30:37 -- setup/devices.sh@63 -- # found=1 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.016 12:30:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.016 12:30:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.276 12:30:37 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:04.276 12:30:37 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:04.276 12:30:37 -- setup/devices.sh@68 -- # return 0 00:03:04.276 12:30:37 -- setup/devices.sh@187 -- # cleanup_dm 00:03:04.276 12:30:37 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:04.276 12:30:37 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:04.276 12:30:37 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:04.276 12:30:37 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:04.276 12:30:37 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:04.276 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:04.276 12:30:37 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:04.276 12:30:37 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:04.276 00:03:04.276 real 0m5.757s 00:03:04.276 user 0m0.962s 00:03:04.276 sys 0m1.646s 00:03:04.276 12:30:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:04.276 12:30:37 -- common/autotest_common.sh@10 -- # set +x 00:03:04.276 ************************************ 00:03:04.276 END TEST dm_mount 00:03:04.276 ************************************ 00:03:04.276 12:30:37 -- setup/devices.sh@1 -- # cleanup 00:03:04.276 12:30:37 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:04.276 12:30:37 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.276 12:30:37 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:04.276 12:30:37 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:04.276 12:30:37 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:04.276 12:30:37 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:04.535 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:04.535 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:04.535 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:04.535 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:04.535 12:30:37 -- setup/devices.sh@12 -- # cleanup_dm 00:03:04.535 12:30:37 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:04.535 12:30:37 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:04.535 12:30:37 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:04.535 12:30:37 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:04.535 12:30:37 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:04.535 12:30:37 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:04.535 00:03:04.535 real 0m14.187s 00:03:04.535 user 0m3.165s 00:03:04.535 sys 0m5.227s 00:03:04.535 12:30:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:04.535 12:30:37 -- common/autotest_common.sh@10 -- # set +x 00:03:04.535 ************************************ 00:03:04.535 END TEST devices 00:03:04.535 ************************************ 00:03:04.796 00:03:04.796 real 0m43.764s 00:03:04.796 user 0m12.669s 00:03:04.796 sys 0m19.600s 00:03:04.796 12:30:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:04.796 12:30:37 -- common/autotest_common.sh@10 -- # set +x 00:03:04.796 ************************************ 00:03:04.796 END TEST setup.sh 00:03:04.796 ************************************ 00:03:04.796 12:30:37 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:05.798 Hugepages 00:03:05.798 node hugesize free / total 00:03:05.798 node0 1048576kB 0 / 0 00:03:05.798 node0 2048kB 2048 / 2048 00:03:05.798 node1 1048576kB 0 / 0 00:03:05.798 node1 2048kB 0 / 0 00:03:05.798 00:03:05.798 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:05.798 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:05.798 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:05.798 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:05.798 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:05.798 12:30:38 -- spdk/autotest.sh@128 -- # uname -s 00:03:05.798 12:30:38 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:05.798 12:30:38 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:05.798 12:30:38 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:07.180 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:07.180 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:07.180 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:08.119 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:08.119 12:30:41 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:09.500 12:30:42 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:09.500 12:30:42 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:09.500 12:30:42 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:09.500 12:30:42 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:09.500 12:30:42 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:09.500 12:30:42 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:09.500 12:30:42 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:09.500 12:30:42 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:09.500 12:30:42 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:09.500 12:30:42 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:09.500 12:30:42 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:09.500 12:30:42 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.483 Waiting for block devices as requested 00:03:10.483 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:10.483 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:10.483 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:10.743 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:10.743 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:10.743 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:11.002 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:11.003 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:11.003 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:11.003 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:11.003 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:11.262 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:11.262 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:11.262 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:11.521 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:11.521 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:11.521 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:11.781 12:30:44 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:11.781 12:30:44 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:11.781 12:30:44 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:11.781 12:30:44 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:11.781 12:30:44 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:11.781 12:30:44 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:11.781 12:30:44 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:11.781 12:30:44 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:11.781 12:30:44 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:11.781 12:30:44 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:11.781 12:30:44 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:11.781 12:30:44 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:11.781 12:30:44 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:11.781 12:30:44 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:11.781 12:30:44 -- common/autotest_common.sh@1552 -- # continue 00:03:11.781 12:30:44 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:11.781 12:30:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:11.781 12:30:44 -- common/autotest_common.sh@10 -- # set +x 00:03:11.782 12:30:44 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:11.782 12:30:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:11.782 12:30:44 -- common/autotest_common.sh@10 -- # set +x 00:03:11.782 12:30:44 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:13.160 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:13.160 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:13.160 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:14.098 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:14.099 12:30:47 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:14.099 12:30:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:14.099 12:30:47 -- common/autotest_common.sh@10 -- # set +x 00:03:14.099 12:30:47 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:14.099 12:30:47 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:14.099 12:30:47 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:14.099 12:30:47 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:14.099 12:30:47 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:14.099 12:30:47 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:14.099 12:30:47 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:14.099 12:30:47 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:14.099 12:30:47 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:14.099 12:30:47 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:14.099 12:30:47 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:14.099 12:30:47 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:14.099 12:30:47 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:14.099 12:30:47 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:14.099 12:30:47 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:14.099 12:30:47 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:14.099 12:30:47 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:14.099 12:30:47 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:14.099 12:30:47 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:14.099 12:30:47 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:14.099 12:30:47 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3395232 00:03:14.099 12:30:47 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:14.099 12:30:47 -- common/autotest_common.sh@1593 -- # waitforlisten 3395232 00:03:14.099 12:30:47 -- common/autotest_common.sh@829 -- # '[' -z 3395232 ']' 00:03:14.099 12:30:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:14.099 12:30:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:14.099 12:30:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:14.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:14.099 12:30:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:14.099 12:30:47 -- common/autotest_common.sh@10 -- # set +x 00:03:14.099 [2024-11-20 12:30:47.188775] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:14.099 [2024-11-20 12:30:47.188867] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3395232 ] 00:03:14.357 EAL: No free 2048 kB hugepages reported on node 1 00:03:14.357 [2024-11-20 12:30:47.246644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:14.357 [2024-11-20 12:30:47.355710] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:14.357 [2024-11-20 12:30:47.355870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:15.296 12:30:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:15.296 12:30:48 -- common/autotest_common.sh@862 -- # return 0 00:03:15.296 12:30:48 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:15.296 12:30:48 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:15.296 12:30:48 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:18.586 nvme0n1 00:03:18.586 12:30:51 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:18.586 [2024-11-20 12:30:51.471393] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:18.586 [2024-11-20 12:30:51.471441] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:18.586 request: 00:03:18.586 { 00:03:18.586 "nvme_ctrlr_name": "nvme0", 00:03:18.586 "password": "test", 00:03:18.586 "method": "bdev_nvme_opal_revert", 00:03:18.586 "req_id": 1 00:03:18.586 } 00:03:18.586 Got JSON-RPC error response 00:03:18.586 response: 00:03:18.586 { 00:03:18.586 "code": -32603, 00:03:18.586 "message": "Internal error" 00:03:18.586 } 00:03:18.586 12:30:51 -- common/autotest_common.sh@1599 -- # true 00:03:18.586 12:30:51 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:18.586 12:30:51 -- common/autotest_common.sh@1603 -- # killprocess 3395232 00:03:18.586 12:30:51 -- common/autotest_common.sh@936 -- # '[' -z 3395232 ']' 00:03:18.586 12:30:51 -- common/autotest_common.sh@940 -- # kill -0 3395232 00:03:18.586 12:30:51 -- common/autotest_common.sh@941 -- # uname 00:03:18.586 12:30:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:18.586 12:30:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3395232 00:03:18.586 12:30:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:18.586 12:30:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:18.586 12:30:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3395232' 00:03:18.586 killing process with pid 3395232 00:03:18.586 12:30:51 -- common/autotest_common.sh@955 -- # kill 3395232 00:03:18.586 12:30:51 -- common/autotest_common.sh@960 -- # wait 3395232 00:03:20.490 12:30:53 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:20.490 12:30:53 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:20.490 12:30:53 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:20.490 12:30:53 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:20.490 12:30:53 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:20.490 12:30:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:20.490 12:30:53 -- common/autotest_common.sh@10 -- # set +x 00:03:20.490 12:30:53 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:20.490 12:30:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.490 12:30:53 -- common/autotest_common.sh@10 -- # set +x 00:03:20.490 ************************************ 00:03:20.490 START TEST env 00:03:20.490 ************************************ 00:03:20.490 12:30:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:20.490 * Looking for test storage... 00:03:20.490 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:20.490 12:30:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:20.490 12:30:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:20.490 12:30:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:20.490 12:30:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:20.490 12:30:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:20.490 12:30:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:20.490 12:30:53 -- scripts/common.sh@335 -- # IFS=.-: 00:03:20.490 12:30:53 -- scripts/common.sh@335 -- # read -ra ver1 00:03:20.490 12:30:53 -- scripts/common.sh@336 -- # IFS=.-: 00:03:20.490 12:30:53 -- scripts/common.sh@336 -- # read -ra ver2 00:03:20.490 12:30:53 -- scripts/common.sh@337 -- # local 'op=<' 00:03:20.490 12:30:53 -- scripts/common.sh@339 -- # ver1_l=2 00:03:20.490 12:30:53 -- scripts/common.sh@340 -- # ver2_l=1 00:03:20.490 12:30:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:20.490 12:30:53 -- scripts/common.sh@343 -- # case "$op" in 00:03:20.490 12:30:53 -- scripts/common.sh@344 -- # : 1 00:03:20.490 12:30:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:20.490 12:30:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:20.490 12:30:53 -- scripts/common.sh@364 -- # decimal 1 00:03:20.490 12:30:53 -- scripts/common.sh@352 -- # local d=1 00:03:20.490 12:30:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:20.490 12:30:53 -- scripts/common.sh@354 -- # echo 1 00:03:20.490 12:30:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:20.490 12:30:53 -- scripts/common.sh@365 -- # decimal 2 00:03:20.490 12:30:53 -- scripts/common.sh@352 -- # local d=2 00:03:20.490 12:30:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:20.490 12:30:53 -- scripts/common.sh@354 -- # echo 2 00:03:20.490 12:30:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:20.490 12:30:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:20.490 12:30:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:20.490 12:30:53 -- scripts/common.sh@367 -- # return 0 00:03:20.490 12:30:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:20.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:20.490 --rc genhtml_branch_coverage=1 00:03:20.490 --rc genhtml_function_coverage=1 00:03:20.490 --rc genhtml_legend=1 00:03:20.490 --rc geninfo_all_blocks=1 00:03:20.490 --rc geninfo_unexecuted_blocks=1 00:03:20.490 00:03:20.490 ' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:20.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:20.490 --rc genhtml_branch_coverage=1 00:03:20.490 --rc genhtml_function_coverage=1 00:03:20.490 --rc genhtml_legend=1 00:03:20.490 --rc geninfo_all_blocks=1 00:03:20.490 --rc geninfo_unexecuted_blocks=1 00:03:20.490 00:03:20.490 ' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:20.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:20.490 --rc genhtml_branch_coverage=1 00:03:20.490 --rc genhtml_function_coverage=1 00:03:20.490 --rc genhtml_legend=1 00:03:20.490 --rc geninfo_all_blocks=1 00:03:20.490 --rc geninfo_unexecuted_blocks=1 00:03:20.490 00:03:20.490 ' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:20.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:20.490 --rc genhtml_branch_coverage=1 00:03:20.490 --rc genhtml_function_coverage=1 00:03:20.490 --rc genhtml_legend=1 00:03:20.490 --rc geninfo_all_blocks=1 00:03:20.490 --rc geninfo_unexecuted_blocks=1 00:03:20.490 00:03:20.490 ' 00:03:20.490 12:30:53 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:20.490 12:30:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.490 12:30:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.490 12:30:53 -- common/autotest_common.sh@10 -- # set +x 00:03:20.490 ************************************ 00:03:20.490 START TEST env_memory 00:03:20.490 ************************************ 00:03:20.490 12:30:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:20.490 00:03:20.490 00:03:20.490 CUnit - A unit testing framework for C - Version 2.1-3 00:03:20.490 http://cunit.sourceforge.net/ 00:03:20.490 00:03:20.490 00:03:20.490 Suite: memory 00:03:20.490 Test: alloc and free memory map ...[2024-11-20 12:30:53.519511] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:20.490 passed 00:03:20.490 Test: mem map translation ...[2024-11-20 12:30:53.539326] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:20.490 [2024-11-20 12:30:53.539349] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:20.490 [2024-11-20 12:30:53.539404] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:20.490 [2024-11-20 12:30:53.539416] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:20.490 passed 00:03:20.490 Test: mem map registration ...[2024-11-20 12:30:53.580211] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:20.490 [2024-11-20 12:30:53.580232] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:20.490 passed 00:03:20.751 Test: mem map adjacent registrations ...passed 00:03:20.751 00:03:20.751 Run Summary: Type Total Ran Passed Failed Inactive 00:03:20.751 suites 1 1 n/a 0 0 00:03:20.751 tests 4 4 4 0 0 00:03:20.751 asserts 152 152 152 0 n/a 00:03:20.751 00:03:20.751 Elapsed time = 0.141 seconds 00:03:20.751 00:03:20.751 real 0m0.149s 00:03:20.751 user 0m0.145s 00:03:20.751 sys 0m0.004s 00:03:20.751 12:30:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:20.751 12:30:53 -- common/autotest_common.sh@10 -- # set +x 00:03:20.751 ************************************ 00:03:20.751 END TEST env_memory 00:03:20.751 ************************************ 00:03:20.751 12:30:53 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:20.751 12:30:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.751 12:30:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.751 12:30:53 -- common/autotest_common.sh@10 -- # set +x 00:03:20.751 ************************************ 00:03:20.751 START TEST env_vtophys 00:03:20.751 ************************************ 00:03:20.751 12:30:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:20.751 EAL: lib.eal log level changed from notice to debug 00:03:20.751 EAL: Detected lcore 0 as core 0 on socket 0 00:03:20.751 EAL: Detected lcore 1 as core 1 on socket 0 00:03:20.751 EAL: Detected lcore 2 as core 2 on socket 0 00:03:20.751 EAL: Detected lcore 3 as core 3 on socket 0 00:03:20.751 EAL: Detected lcore 4 as core 4 on socket 0 00:03:20.751 EAL: Detected lcore 5 as core 5 on socket 0 00:03:20.751 EAL: Detected lcore 6 as core 8 on socket 0 00:03:20.751 EAL: Detected lcore 7 as core 9 on socket 0 00:03:20.751 EAL: Detected lcore 8 as core 10 on socket 0 00:03:20.751 EAL: Detected lcore 9 as core 11 on socket 0 00:03:20.751 EAL: Detected lcore 10 as core 12 on socket 0 00:03:20.751 EAL: Detected lcore 11 as core 13 on socket 0 00:03:20.751 EAL: Detected lcore 12 as core 0 on socket 1 00:03:20.751 EAL: Detected lcore 13 as core 1 on socket 1 00:03:20.751 EAL: Detected lcore 14 as core 2 on socket 1 00:03:20.751 EAL: Detected lcore 15 as core 3 on socket 1 00:03:20.751 EAL: Detected lcore 16 as core 4 on socket 1 00:03:20.751 EAL: Detected lcore 17 as core 5 on socket 1 00:03:20.751 EAL: Detected lcore 18 as core 8 on socket 1 00:03:20.751 EAL: Detected lcore 19 as core 9 on socket 1 00:03:20.751 EAL: Detected lcore 20 as core 10 on socket 1 00:03:20.751 EAL: Detected lcore 21 as core 11 on socket 1 00:03:20.751 EAL: Detected lcore 22 as core 12 on socket 1 00:03:20.751 EAL: Detected lcore 23 as core 13 on socket 1 00:03:20.751 EAL: Detected lcore 24 as core 0 on socket 0 00:03:20.751 EAL: Detected lcore 25 as core 1 on socket 0 00:03:20.751 EAL: Detected lcore 26 as core 2 on socket 0 00:03:20.751 EAL: Detected lcore 27 as core 3 on socket 0 00:03:20.751 EAL: Detected lcore 28 as core 4 on socket 0 00:03:20.751 EAL: Detected lcore 29 as core 5 on socket 0 00:03:20.751 EAL: Detected lcore 30 as core 8 on socket 0 00:03:20.751 EAL: Detected lcore 31 as core 9 on socket 0 00:03:20.751 EAL: Detected lcore 32 as core 10 on socket 0 00:03:20.751 EAL: Detected lcore 33 as core 11 on socket 0 00:03:20.751 EAL: Detected lcore 34 as core 12 on socket 0 00:03:20.751 EAL: Detected lcore 35 as core 13 on socket 0 00:03:20.751 EAL: Detected lcore 36 as core 0 on socket 1 00:03:20.751 EAL: Detected lcore 37 as core 1 on socket 1 00:03:20.751 EAL: Detected lcore 38 as core 2 on socket 1 00:03:20.751 EAL: Detected lcore 39 as core 3 on socket 1 00:03:20.751 EAL: Detected lcore 40 as core 4 on socket 1 00:03:20.751 EAL: Detected lcore 41 as core 5 on socket 1 00:03:20.751 EAL: Detected lcore 42 as core 8 on socket 1 00:03:20.751 EAL: Detected lcore 43 as core 9 on socket 1 00:03:20.751 EAL: Detected lcore 44 as core 10 on socket 1 00:03:20.751 EAL: Detected lcore 45 as core 11 on socket 1 00:03:20.751 EAL: Detected lcore 46 as core 12 on socket 1 00:03:20.751 EAL: Detected lcore 47 as core 13 on socket 1 00:03:20.751 EAL: Maximum logical cores by configuration: 128 00:03:20.751 EAL: Detected CPU lcores: 48 00:03:20.751 EAL: Detected NUMA nodes: 2 00:03:20.751 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:20.751 EAL: Detected shared linkage of DPDK 00:03:20.751 EAL: No shared files mode enabled, IPC will be disabled 00:03:20.751 EAL: Bus pci wants IOVA as 'DC' 00:03:20.751 EAL: Buses did not request a specific IOVA mode. 00:03:20.751 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:20.751 EAL: Selected IOVA mode 'VA' 00:03:20.751 EAL: No free 2048 kB hugepages reported on node 1 00:03:20.751 EAL: Probing VFIO support... 00:03:20.751 EAL: IOMMU type 1 (Type 1) is supported 00:03:20.751 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:20.751 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:20.751 EAL: VFIO support initialized 00:03:20.751 EAL: Ask a virtual area of 0x2e000 bytes 00:03:20.751 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:20.751 EAL: Setting up physically contiguous memory... 00:03:20.751 EAL: Setting maximum number of open files to 524288 00:03:20.751 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:20.751 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:20.751 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:20.751 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:20.751 EAL: Ask a virtual area of 0x61000 bytes 00:03:20.751 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:20.751 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:20.751 EAL: Ask a virtual area of 0x400000000 bytes 00:03:20.751 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:20.751 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:20.751 EAL: Hugepages will be freed exactly as allocated. 00:03:20.751 EAL: No shared files mode enabled, IPC is disabled 00:03:20.751 EAL: No shared files mode enabled, IPC is disabled 00:03:20.751 EAL: TSC frequency is ~2700000 KHz 00:03:20.751 EAL: Main lcore 0 is ready (tid=7f1dba111a00;cpuset=[0]) 00:03:20.751 EAL: Trying to obtain current memory policy. 00:03:20.751 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.751 EAL: Restoring previous memory policy: 0 00:03:20.751 EAL: request: mp_malloc_sync 00:03:20.751 EAL: No shared files mode enabled, IPC is disabled 00:03:20.751 EAL: Heap on socket 0 was expanded by 2MB 00:03:20.751 EAL: No shared files mode enabled, IPC is disabled 00:03:20.751 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:20.751 EAL: Mem event callback 'spdk:(nil)' registered 00:03:20.751 00:03:20.751 00:03:20.751 CUnit - A unit testing framework for C - Version 2.1-3 00:03:20.751 http://cunit.sourceforge.net/ 00:03:20.751 00:03:20.751 00:03:20.751 Suite: components_suite 00:03:20.751 Test: vtophys_malloc_test ...passed 00:03:20.751 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:20.751 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.751 EAL: Restoring previous memory policy: 4 00:03:20.751 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.751 EAL: request: mp_malloc_sync 00:03:20.751 EAL: No shared files mode enabled, IPC is disabled 00:03:20.751 EAL: Heap on socket 0 was expanded by 4MB 00:03:20.751 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.751 EAL: request: mp_malloc_sync 00:03:20.751 EAL: No shared files mode enabled, IPC is disabled 00:03:20.751 EAL: Heap on socket 0 was shrunk by 4MB 00:03:20.751 EAL: Trying to obtain current memory policy. 00:03:20.751 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.751 EAL: Restoring previous memory policy: 4 00:03:20.751 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.751 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was expanded by 6MB 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was shrunk by 6MB 00:03:20.752 EAL: Trying to obtain current memory policy. 00:03:20.752 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.752 EAL: Restoring previous memory policy: 4 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was expanded by 10MB 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was shrunk by 10MB 00:03:20.752 EAL: Trying to obtain current memory policy. 00:03:20.752 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.752 EAL: Restoring previous memory policy: 4 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was expanded by 18MB 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was shrunk by 18MB 00:03:20.752 EAL: Trying to obtain current memory policy. 00:03:20.752 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.752 EAL: Restoring previous memory policy: 4 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was expanded by 34MB 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was shrunk by 34MB 00:03:20.752 EAL: Trying to obtain current memory policy. 00:03:20.752 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.752 EAL: Restoring previous memory policy: 4 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was expanded by 66MB 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was shrunk by 66MB 00:03:20.752 EAL: Trying to obtain current memory policy. 00:03:20.752 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:20.752 EAL: Restoring previous memory policy: 4 00:03:20.752 EAL: Calling mem event callback 'spdk:(nil)' 00:03:20.752 EAL: request: mp_malloc_sync 00:03:20.752 EAL: No shared files mode enabled, IPC is disabled 00:03:20.752 EAL: Heap on socket 0 was expanded by 130MB 00:03:21.012 EAL: Calling mem event callback 'spdk:(nil)' 00:03:21.012 EAL: request: mp_malloc_sync 00:03:21.012 EAL: No shared files mode enabled, IPC is disabled 00:03:21.012 EAL: Heap on socket 0 was shrunk by 130MB 00:03:21.012 EAL: Trying to obtain current memory policy. 00:03:21.012 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:21.012 EAL: Restoring previous memory policy: 4 00:03:21.012 EAL: Calling mem event callback 'spdk:(nil)' 00:03:21.012 EAL: request: mp_malloc_sync 00:03:21.012 EAL: No shared files mode enabled, IPC is disabled 00:03:21.012 EAL: Heap on socket 0 was expanded by 258MB 00:03:21.012 EAL: Calling mem event callback 'spdk:(nil)' 00:03:21.013 EAL: request: mp_malloc_sync 00:03:21.013 EAL: No shared files mode enabled, IPC is disabled 00:03:21.013 EAL: Heap on socket 0 was shrunk by 258MB 00:03:21.013 EAL: Trying to obtain current memory policy. 00:03:21.013 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:21.272 EAL: Restoring previous memory policy: 4 00:03:21.272 EAL: Calling mem event callback 'spdk:(nil)' 00:03:21.272 EAL: request: mp_malloc_sync 00:03:21.272 EAL: No shared files mode enabled, IPC is disabled 00:03:21.272 EAL: Heap on socket 0 was expanded by 514MB 00:03:21.272 EAL: Calling mem event callback 'spdk:(nil)' 00:03:21.532 EAL: request: mp_malloc_sync 00:03:21.532 EAL: No shared files mode enabled, IPC is disabled 00:03:21.532 EAL: Heap on socket 0 was shrunk by 514MB 00:03:21.532 EAL: Trying to obtain current memory policy. 00:03:21.532 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:21.791 EAL: Restoring previous memory policy: 4 00:03:21.791 EAL: Calling mem event callback 'spdk:(nil)' 00:03:21.791 EAL: request: mp_malloc_sync 00:03:21.791 EAL: No shared files mode enabled, IPC is disabled 00:03:21.791 EAL: Heap on socket 0 was expanded by 1026MB 00:03:22.051 EAL: Calling mem event callback 'spdk:(nil)' 00:03:22.311 EAL: request: mp_malloc_sync 00:03:22.311 EAL: No shared files mode enabled, IPC is disabled 00:03:22.311 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:22.311 passed 00:03:22.311 00:03:22.311 Run Summary: Type Total Ran Passed Failed Inactive 00:03:22.311 suites 1 1 n/a 0 0 00:03:22.311 tests 2 2 2 0 0 00:03:22.311 asserts 497 497 497 0 n/a 00:03:22.311 00:03:22.311 Elapsed time = 1.383 seconds 00:03:22.311 EAL: Calling mem event callback 'spdk:(nil)' 00:03:22.311 EAL: request: mp_malloc_sync 00:03:22.311 EAL: No shared files mode enabled, IPC is disabled 00:03:22.311 EAL: Heap on socket 0 was shrunk by 2MB 00:03:22.311 EAL: No shared files mode enabled, IPC is disabled 00:03:22.311 EAL: No shared files mode enabled, IPC is disabled 00:03:22.311 EAL: No shared files mode enabled, IPC is disabled 00:03:22.311 00:03:22.311 real 0m1.506s 00:03:22.311 user 0m0.863s 00:03:22.311 sys 0m0.606s 00:03:22.311 12:30:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.311 12:30:55 -- common/autotest_common.sh@10 -- # set +x 00:03:22.311 ************************************ 00:03:22.311 END TEST env_vtophys 00:03:22.311 ************************************ 00:03:22.311 12:30:55 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:22.311 12:30:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.311 12:30:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.311 12:30:55 -- common/autotest_common.sh@10 -- # set +x 00:03:22.311 ************************************ 00:03:22.311 START TEST env_pci 00:03:22.311 ************************************ 00:03:22.311 12:30:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:22.311 00:03:22.311 00:03:22.312 CUnit - A unit testing framework for C - Version 2.1-3 00:03:22.312 http://cunit.sourceforge.net/ 00:03:22.312 00:03:22.312 00:03:22.312 Suite: pci 00:03:22.312 Test: pci_hook ...[2024-11-20 12:30:55.208008] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3396275 has claimed it 00:03:22.312 EAL: Cannot find device (10000:00:01.0) 00:03:22.312 EAL: Failed to attach device on primary process 00:03:22.312 passed 00:03:22.312 00:03:22.312 Run Summary: Type Total Ran Passed Failed Inactive 00:03:22.312 suites 1 1 n/a 0 0 00:03:22.312 tests 1 1 1 0 0 00:03:22.312 asserts 25 25 25 0 n/a 00:03:22.312 00:03:22.312 Elapsed time = 0.021 seconds 00:03:22.312 00:03:22.312 real 0m0.035s 00:03:22.312 user 0m0.011s 00:03:22.312 sys 0m0.024s 00:03:22.312 12:30:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.312 12:30:55 -- common/autotest_common.sh@10 -- # set +x 00:03:22.312 ************************************ 00:03:22.312 END TEST env_pci 00:03:22.312 ************************************ 00:03:22.312 12:30:55 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:22.312 12:30:55 -- env/env.sh@15 -- # uname 00:03:22.312 12:30:55 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:22.312 12:30:55 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:22.312 12:30:55 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:22.312 12:30:55 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:22.312 12:30:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.312 12:30:55 -- common/autotest_common.sh@10 -- # set +x 00:03:22.312 ************************************ 00:03:22.312 START TEST env_dpdk_post_init 00:03:22.312 ************************************ 00:03:22.312 12:30:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:22.312 EAL: Detected CPU lcores: 48 00:03:22.312 EAL: Detected NUMA nodes: 2 00:03:22.312 EAL: Detected shared linkage of DPDK 00:03:22.312 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:22.312 EAL: Selected IOVA mode 'VA' 00:03:22.312 EAL: No free 2048 kB hugepages reported on node 1 00:03:22.312 EAL: VFIO support initialized 00:03:22.312 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:22.312 EAL: Using IOMMU type 1 (Type 1) 00:03:22.312 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:22.312 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:22.312 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:22.312 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:22.572 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:23.510 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:03:26.805 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:03:26.805 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:03:26.805 Starting DPDK initialization... 00:03:26.805 Starting SPDK post initialization... 00:03:26.805 SPDK NVMe probe 00:03:26.805 Attaching to 0000:88:00.0 00:03:26.805 Attached to 0000:88:00.0 00:03:26.805 Cleaning up... 00:03:26.805 00:03:26.805 real 0m4.411s 00:03:26.805 user 0m3.299s 00:03:26.805 sys 0m0.167s 00:03:26.805 12:30:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.805 12:30:59 -- common/autotest_common.sh@10 -- # set +x 00:03:26.805 ************************************ 00:03:26.805 END TEST env_dpdk_post_init 00:03:26.805 ************************************ 00:03:26.805 12:30:59 -- env/env.sh@26 -- # uname 00:03:26.805 12:30:59 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:03:26.805 12:30:59 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:26.805 12:30:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.805 12:30:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.805 12:30:59 -- common/autotest_common.sh@10 -- # set +x 00:03:26.805 ************************************ 00:03:26.805 START TEST env_mem_callbacks 00:03:26.805 ************************************ 00:03:26.805 12:30:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:26.805 EAL: Detected CPU lcores: 48 00:03:26.805 EAL: Detected NUMA nodes: 2 00:03:26.805 EAL: Detected shared linkage of DPDK 00:03:26.805 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:26.805 EAL: Selected IOVA mode 'VA' 00:03:26.805 EAL: No free 2048 kB hugepages reported on node 1 00:03:26.805 EAL: VFIO support initialized 00:03:26.805 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:26.805 00:03:26.805 00:03:26.805 CUnit - A unit testing framework for C - Version 2.1-3 00:03:26.805 http://cunit.sourceforge.net/ 00:03:26.805 00:03:26.805 00:03:26.805 Suite: memory 00:03:26.805 Test: test ... 00:03:26.805 register 0x200000200000 2097152 00:03:26.805 malloc 3145728 00:03:26.805 register 0x200000400000 4194304 00:03:26.805 buf 0x200000500000 len 3145728 PASSED 00:03:26.805 malloc 64 00:03:26.805 buf 0x2000004fff40 len 64 PASSED 00:03:26.805 malloc 4194304 00:03:26.805 register 0x200000800000 6291456 00:03:26.805 buf 0x200000a00000 len 4194304 PASSED 00:03:26.805 free 0x200000500000 3145728 00:03:26.805 free 0x2000004fff40 64 00:03:26.805 unregister 0x200000400000 4194304 PASSED 00:03:26.805 free 0x200000a00000 4194304 00:03:26.805 unregister 0x200000800000 6291456 PASSED 00:03:26.805 malloc 8388608 00:03:26.805 register 0x200000400000 10485760 00:03:26.805 buf 0x200000600000 len 8388608 PASSED 00:03:26.805 free 0x200000600000 8388608 00:03:26.805 unregister 0x200000400000 10485760 PASSED 00:03:26.805 passed 00:03:26.805 00:03:26.805 Run Summary: Type Total Ran Passed Failed Inactive 00:03:26.805 suites 1 1 n/a 0 0 00:03:26.805 tests 1 1 1 0 0 00:03:26.805 asserts 15 15 15 0 n/a 00:03:26.805 00:03:26.805 Elapsed time = 0.005 seconds 00:03:26.805 00:03:26.805 real 0m0.048s 00:03:26.805 user 0m0.012s 00:03:26.805 sys 0m0.035s 00:03:26.805 12:30:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.805 12:30:59 -- common/autotest_common.sh@10 -- # set +x 00:03:26.805 ************************************ 00:03:26.805 END TEST env_mem_callbacks 00:03:26.805 ************************************ 00:03:26.805 00:03:26.805 real 0m6.424s 00:03:26.805 user 0m4.479s 00:03:26.805 sys 0m0.989s 00:03:26.805 12:30:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.805 12:30:59 -- common/autotest_common.sh@10 -- # set +x 00:03:26.805 ************************************ 00:03:26.805 END TEST env 00:03:26.805 ************************************ 00:03:26.805 12:30:59 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:26.805 12:30:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.805 12:30:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.805 12:30:59 -- common/autotest_common.sh@10 -- # set +x 00:03:26.805 ************************************ 00:03:26.805 START TEST rpc 00:03:26.805 ************************************ 00:03:26.805 12:30:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:26.805 * Looking for test storage... 00:03:26.805 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:26.805 12:30:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:26.806 12:30:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:26.806 12:30:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:27.066 12:30:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:27.066 12:30:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:27.066 12:30:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:27.066 12:30:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:27.066 12:30:59 -- scripts/common.sh@335 -- # IFS=.-: 00:03:27.066 12:30:59 -- scripts/common.sh@335 -- # read -ra ver1 00:03:27.066 12:30:59 -- scripts/common.sh@336 -- # IFS=.-: 00:03:27.066 12:30:59 -- scripts/common.sh@336 -- # read -ra ver2 00:03:27.066 12:30:59 -- scripts/common.sh@337 -- # local 'op=<' 00:03:27.066 12:30:59 -- scripts/common.sh@339 -- # ver1_l=2 00:03:27.066 12:30:59 -- scripts/common.sh@340 -- # ver2_l=1 00:03:27.066 12:30:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:27.066 12:30:59 -- scripts/common.sh@343 -- # case "$op" in 00:03:27.066 12:30:59 -- scripts/common.sh@344 -- # : 1 00:03:27.066 12:30:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:27.066 12:30:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:27.066 12:30:59 -- scripts/common.sh@364 -- # decimal 1 00:03:27.066 12:30:59 -- scripts/common.sh@352 -- # local d=1 00:03:27.066 12:30:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:27.066 12:30:59 -- scripts/common.sh@354 -- # echo 1 00:03:27.066 12:30:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:27.066 12:30:59 -- scripts/common.sh@365 -- # decimal 2 00:03:27.066 12:30:59 -- scripts/common.sh@352 -- # local d=2 00:03:27.066 12:30:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:27.066 12:30:59 -- scripts/common.sh@354 -- # echo 2 00:03:27.066 12:30:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:27.066 12:30:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:27.066 12:30:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:27.066 12:30:59 -- scripts/common.sh@367 -- # return 0 00:03:27.066 12:30:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:27.066 12:30:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:27.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.066 --rc genhtml_branch_coverage=1 00:03:27.066 --rc genhtml_function_coverage=1 00:03:27.066 --rc genhtml_legend=1 00:03:27.066 --rc geninfo_all_blocks=1 00:03:27.066 --rc geninfo_unexecuted_blocks=1 00:03:27.066 00:03:27.066 ' 00:03:27.066 12:30:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:27.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.066 --rc genhtml_branch_coverage=1 00:03:27.066 --rc genhtml_function_coverage=1 00:03:27.066 --rc genhtml_legend=1 00:03:27.066 --rc geninfo_all_blocks=1 00:03:27.066 --rc geninfo_unexecuted_blocks=1 00:03:27.066 00:03:27.066 ' 00:03:27.066 12:30:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:27.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.066 --rc genhtml_branch_coverage=1 00:03:27.066 --rc genhtml_function_coverage=1 00:03:27.066 --rc genhtml_legend=1 00:03:27.066 --rc geninfo_all_blocks=1 00:03:27.066 --rc geninfo_unexecuted_blocks=1 00:03:27.066 00:03:27.066 ' 00:03:27.066 12:30:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:27.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.066 --rc genhtml_branch_coverage=1 00:03:27.066 --rc genhtml_function_coverage=1 00:03:27.066 --rc genhtml_legend=1 00:03:27.066 --rc geninfo_all_blocks=1 00:03:27.066 --rc geninfo_unexecuted_blocks=1 00:03:27.066 00:03:27.066 ' 00:03:27.066 12:30:59 -- rpc/rpc.sh@65 -- # spdk_pid=3396952 00:03:27.066 12:30:59 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:03:27.066 12:30:59 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:03:27.066 12:30:59 -- rpc/rpc.sh@67 -- # waitforlisten 3396952 00:03:27.066 12:30:59 -- common/autotest_common.sh@829 -- # '[' -z 3396952 ']' 00:03:27.066 12:30:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:27.066 12:30:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:27.066 12:30:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:27.066 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:27.066 12:30:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:27.066 12:30:59 -- common/autotest_common.sh@10 -- # set +x 00:03:27.066 [2024-11-20 12:30:59.985366] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:27.066 [2024-11-20 12:30:59.985460] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3396952 ] 00:03:27.066 EAL: No free 2048 kB hugepages reported on node 1 00:03:27.066 [2024-11-20 12:31:00.047486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:27.066 [2024-11-20 12:31:00.155952] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:27.066 [2024-11-20 12:31:00.156125] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:03:27.066 [2024-11-20 12:31:00.156148] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3396952' to capture a snapshot of events at runtime. 00:03:27.066 [2024-11-20 12:31:00.156162] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3396952 for offline analysis/debug. 00:03:27.066 [2024-11-20 12:31:00.156190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:28.007 12:31:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:28.007 12:31:00 -- common/autotest_common.sh@862 -- # return 0 00:03:28.007 12:31:00 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:28.007 12:31:00 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:28.007 12:31:00 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:03:28.007 12:31:00 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:03:28.007 12:31:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.007 12:31:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.007 12:31:00 -- common/autotest_common.sh@10 -- # set +x 00:03:28.007 ************************************ 00:03:28.007 START TEST rpc_integrity 00:03:28.007 ************************************ 00:03:28.007 12:31:00 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:28.007 12:31:00 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:28.007 12:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.007 12:31:00 -- common/autotest_common.sh@10 -- # set +x 00:03:28.007 12:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.007 12:31:00 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:28.007 12:31:00 -- rpc/rpc.sh@13 -- # jq length 00:03:28.007 12:31:01 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:28.007 12:31:01 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:28.007 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.007 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.007 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.007 12:31:01 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:03:28.007 12:31:01 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:28.007 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.007 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.007 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.007 12:31:01 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:28.007 { 00:03:28.007 "name": "Malloc0", 00:03:28.007 "aliases": [ 00:03:28.007 "d8ed42b0-532b-4197-af2f-395cea512aa5" 00:03:28.007 ], 00:03:28.007 "product_name": "Malloc disk", 00:03:28.007 "block_size": 512, 00:03:28.007 "num_blocks": 16384, 00:03:28.007 "uuid": "d8ed42b0-532b-4197-af2f-395cea512aa5", 00:03:28.007 "assigned_rate_limits": { 00:03:28.007 "rw_ios_per_sec": 0, 00:03:28.007 "rw_mbytes_per_sec": 0, 00:03:28.007 "r_mbytes_per_sec": 0, 00:03:28.007 "w_mbytes_per_sec": 0 00:03:28.007 }, 00:03:28.007 "claimed": false, 00:03:28.007 "zoned": false, 00:03:28.007 "supported_io_types": { 00:03:28.007 "read": true, 00:03:28.007 "write": true, 00:03:28.007 "unmap": true, 00:03:28.007 "write_zeroes": true, 00:03:28.007 "flush": true, 00:03:28.007 "reset": true, 00:03:28.007 "compare": false, 00:03:28.007 "compare_and_write": false, 00:03:28.007 "abort": true, 00:03:28.007 "nvme_admin": false, 00:03:28.007 "nvme_io": false 00:03:28.007 }, 00:03:28.007 "memory_domains": [ 00:03:28.007 { 00:03:28.007 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.007 "dma_device_type": 2 00:03:28.007 } 00:03:28.007 ], 00:03:28.007 "driver_specific": {} 00:03:28.007 } 00:03:28.007 ]' 00:03:28.007 12:31:01 -- rpc/rpc.sh@17 -- # jq length 00:03:28.007 12:31:01 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:28.007 12:31:01 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:03:28.007 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.007 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.007 [2024-11-20 12:31:01.063437] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:03:28.007 [2024-11-20 12:31:01.063485] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:28.007 [2024-11-20 12:31:01.063509] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x18b1cb0 00:03:28.007 [2024-11-20 12:31:01.063523] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:28.007 [2024-11-20 12:31:01.064980] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:28.007 [2024-11-20 12:31:01.065010] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:28.007 Passthru0 00:03:28.007 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.007 12:31:01 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:28.007 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.007 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.007 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.007 12:31:01 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:28.007 { 00:03:28.007 "name": "Malloc0", 00:03:28.007 "aliases": [ 00:03:28.007 "d8ed42b0-532b-4197-af2f-395cea512aa5" 00:03:28.007 ], 00:03:28.007 "product_name": "Malloc disk", 00:03:28.007 "block_size": 512, 00:03:28.007 "num_blocks": 16384, 00:03:28.007 "uuid": "d8ed42b0-532b-4197-af2f-395cea512aa5", 00:03:28.007 "assigned_rate_limits": { 00:03:28.007 "rw_ios_per_sec": 0, 00:03:28.007 "rw_mbytes_per_sec": 0, 00:03:28.007 "r_mbytes_per_sec": 0, 00:03:28.007 "w_mbytes_per_sec": 0 00:03:28.007 }, 00:03:28.007 "claimed": true, 00:03:28.007 "claim_type": "exclusive_write", 00:03:28.007 "zoned": false, 00:03:28.007 "supported_io_types": { 00:03:28.007 "read": true, 00:03:28.007 "write": true, 00:03:28.007 "unmap": true, 00:03:28.007 "write_zeroes": true, 00:03:28.007 "flush": true, 00:03:28.007 "reset": true, 00:03:28.007 "compare": false, 00:03:28.007 "compare_and_write": false, 00:03:28.007 "abort": true, 00:03:28.007 "nvme_admin": false, 00:03:28.007 "nvme_io": false 00:03:28.007 }, 00:03:28.007 "memory_domains": [ 00:03:28.007 { 00:03:28.007 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.007 "dma_device_type": 2 00:03:28.007 } 00:03:28.007 ], 00:03:28.007 "driver_specific": {} 00:03:28.007 }, 00:03:28.007 { 00:03:28.007 "name": "Passthru0", 00:03:28.007 "aliases": [ 00:03:28.007 "7d0677be-2bae-568f-85f3-d8af7507d431" 00:03:28.007 ], 00:03:28.007 "product_name": "passthru", 00:03:28.007 "block_size": 512, 00:03:28.007 "num_blocks": 16384, 00:03:28.007 "uuid": "7d0677be-2bae-568f-85f3-d8af7507d431", 00:03:28.007 "assigned_rate_limits": { 00:03:28.007 "rw_ios_per_sec": 0, 00:03:28.007 "rw_mbytes_per_sec": 0, 00:03:28.007 "r_mbytes_per_sec": 0, 00:03:28.007 "w_mbytes_per_sec": 0 00:03:28.007 }, 00:03:28.007 "claimed": false, 00:03:28.007 "zoned": false, 00:03:28.007 "supported_io_types": { 00:03:28.007 "read": true, 00:03:28.007 "write": true, 00:03:28.007 "unmap": true, 00:03:28.007 "write_zeroes": true, 00:03:28.007 "flush": true, 00:03:28.007 "reset": true, 00:03:28.007 "compare": false, 00:03:28.007 "compare_and_write": false, 00:03:28.007 "abort": true, 00:03:28.007 "nvme_admin": false, 00:03:28.007 "nvme_io": false 00:03:28.007 }, 00:03:28.007 "memory_domains": [ 00:03:28.007 { 00:03:28.007 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.007 "dma_device_type": 2 00:03:28.007 } 00:03:28.007 ], 00:03:28.007 "driver_specific": { 00:03:28.007 "passthru": { 00:03:28.007 "name": "Passthru0", 00:03:28.007 "base_bdev_name": "Malloc0" 00:03:28.007 } 00:03:28.007 } 00:03:28.007 } 00:03:28.007 ]' 00:03:28.007 12:31:01 -- rpc/rpc.sh@21 -- # jq length 00:03:28.267 12:31:01 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:28.267 12:31:01 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:28.267 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.267 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.267 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.267 12:31:01 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:03:28.267 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.267 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.267 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.267 12:31:01 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:28.267 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.267 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.267 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.267 12:31:01 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:28.267 12:31:01 -- rpc/rpc.sh@26 -- # jq length 00:03:28.267 12:31:01 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:28.268 00:03:28.268 real 0m0.224s 00:03:28.268 user 0m0.152s 00:03:28.268 sys 0m0.017s 00:03:28.268 12:31:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 ************************************ 00:03:28.268 END TEST rpc_integrity 00:03:28.268 ************************************ 00:03:28.268 12:31:01 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:03:28.268 12:31:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.268 12:31:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 ************************************ 00:03:28.268 START TEST rpc_plugins 00:03:28.268 ************************************ 00:03:28.268 12:31:01 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:03:28.268 12:31:01 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:03:28.268 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.268 12:31:01 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:03:28.268 12:31:01 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:03:28.268 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.268 12:31:01 -- rpc/rpc.sh@31 -- # bdevs='[ 00:03:28.268 { 00:03:28.268 "name": "Malloc1", 00:03:28.268 "aliases": [ 00:03:28.268 "f6c3aea5-84bf-4cdb-b91a-5052b9e1e3c3" 00:03:28.268 ], 00:03:28.268 "product_name": "Malloc disk", 00:03:28.268 "block_size": 4096, 00:03:28.268 "num_blocks": 256, 00:03:28.268 "uuid": "f6c3aea5-84bf-4cdb-b91a-5052b9e1e3c3", 00:03:28.268 "assigned_rate_limits": { 00:03:28.268 "rw_ios_per_sec": 0, 00:03:28.268 "rw_mbytes_per_sec": 0, 00:03:28.268 "r_mbytes_per_sec": 0, 00:03:28.268 "w_mbytes_per_sec": 0 00:03:28.268 }, 00:03:28.268 "claimed": false, 00:03:28.268 "zoned": false, 00:03:28.268 "supported_io_types": { 00:03:28.268 "read": true, 00:03:28.268 "write": true, 00:03:28.268 "unmap": true, 00:03:28.268 "write_zeroes": true, 00:03:28.268 "flush": true, 00:03:28.268 "reset": true, 00:03:28.268 "compare": false, 00:03:28.268 "compare_and_write": false, 00:03:28.268 "abort": true, 00:03:28.268 "nvme_admin": false, 00:03:28.268 "nvme_io": false 00:03:28.268 }, 00:03:28.268 "memory_domains": [ 00:03:28.268 { 00:03:28.268 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.268 "dma_device_type": 2 00:03:28.268 } 00:03:28.268 ], 00:03:28.268 "driver_specific": {} 00:03:28.268 } 00:03:28.268 ]' 00:03:28.268 12:31:01 -- rpc/rpc.sh@32 -- # jq length 00:03:28.268 12:31:01 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:03:28.268 12:31:01 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:03:28.268 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.268 12:31:01 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:03:28.268 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.268 12:31:01 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:03:28.268 12:31:01 -- rpc/rpc.sh@36 -- # jq length 00:03:28.268 12:31:01 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:03:28.268 00:03:28.268 real 0m0.110s 00:03:28.268 user 0m0.073s 00:03:28.268 sys 0m0.010s 00:03:28.268 12:31:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 ************************************ 00:03:28.268 END TEST rpc_plugins 00:03:28.268 ************************************ 00:03:28.268 12:31:01 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:03:28.268 12:31:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.268 12:31:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 ************************************ 00:03:28.268 START TEST rpc_trace_cmd_test 00:03:28.268 ************************************ 00:03:28.268 12:31:01 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:03:28.268 12:31:01 -- rpc/rpc.sh@40 -- # local info 00:03:28.268 12:31:01 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:03:28.268 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.268 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.268 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.268 12:31:01 -- rpc/rpc.sh@42 -- # info='{ 00:03:28.268 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3396952", 00:03:28.268 "tpoint_group_mask": "0x8", 00:03:28.268 "iscsi_conn": { 00:03:28.268 "mask": "0x2", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "scsi": { 00:03:28.268 "mask": "0x4", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "bdev": { 00:03:28.268 "mask": "0x8", 00:03:28.268 "tpoint_mask": "0xffffffffffffffff" 00:03:28.268 }, 00:03:28.268 "nvmf_rdma": { 00:03:28.268 "mask": "0x10", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "nvmf_tcp": { 00:03:28.268 "mask": "0x20", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "ftl": { 00:03:28.268 "mask": "0x40", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "blobfs": { 00:03:28.268 "mask": "0x80", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "dsa": { 00:03:28.268 "mask": "0x200", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "thread": { 00:03:28.268 "mask": "0x400", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "nvme_pcie": { 00:03:28.268 "mask": "0x800", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "iaa": { 00:03:28.268 "mask": "0x1000", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "nvme_tcp": { 00:03:28.268 "mask": "0x2000", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 }, 00:03:28.268 "bdev_nvme": { 00:03:28.268 "mask": "0x4000", 00:03:28.268 "tpoint_mask": "0x0" 00:03:28.268 } 00:03:28.268 }' 00:03:28.268 12:31:01 -- rpc/rpc.sh@43 -- # jq length 00:03:28.527 12:31:01 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:03:28.527 12:31:01 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:03:28.527 12:31:01 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:03:28.527 12:31:01 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:03:28.527 12:31:01 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:03:28.527 12:31:01 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:03:28.527 12:31:01 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:03:28.527 12:31:01 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:03:28.527 12:31:01 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:03:28.527 00:03:28.527 real 0m0.200s 00:03:28.527 user 0m0.178s 00:03:28.527 sys 0m0.012s 00:03:28.527 12:31:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.527 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.527 ************************************ 00:03:28.527 END TEST rpc_trace_cmd_test 00:03:28.527 ************************************ 00:03:28.527 12:31:01 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:03:28.527 12:31:01 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:03:28.527 12:31:01 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:03:28.527 12:31:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.527 12:31:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.527 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.527 ************************************ 00:03:28.527 START TEST rpc_daemon_integrity 00:03:28.527 ************************************ 00:03:28.527 12:31:01 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:28.527 12:31:01 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:28.527 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.527 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.527 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.527 12:31:01 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:28.527 12:31:01 -- rpc/rpc.sh@13 -- # jq length 00:03:28.527 12:31:01 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:28.527 12:31:01 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:28.527 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.527 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.527 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.527 12:31:01 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:03:28.786 12:31:01 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:28.786 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.786 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.786 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.786 12:31:01 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:28.786 { 00:03:28.786 "name": "Malloc2", 00:03:28.786 "aliases": [ 00:03:28.786 "3c7558a2-0e00-4d93-860e-3d4c611f65e5" 00:03:28.786 ], 00:03:28.786 "product_name": "Malloc disk", 00:03:28.786 "block_size": 512, 00:03:28.786 "num_blocks": 16384, 00:03:28.787 "uuid": "3c7558a2-0e00-4d93-860e-3d4c611f65e5", 00:03:28.787 "assigned_rate_limits": { 00:03:28.787 "rw_ios_per_sec": 0, 00:03:28.787 "rw_mbytes_per_sec": 0, 00:03:28.787 "r_mbytes_per_sec": 0, 00:03:28.787 "w_mbytes_per_sec": 0 00:03:28.787 }, 00:03:28.787 "claimed": false, 00:03:28.787 "zoned": false, 00:03:28.787 "supported_io_types": { 00:03:28.787 "read": true, 00:03:28.787 "write": true, 00:03:28.787 "unmap": true, 00:03:28.787 "write_zeroes": true, 00:03:28.787 "flush": true, 00:03:28.787 "reset": true, 00:03:28.787 "compare": false, 00:03:28.787 "compare_and_write": false, 00:03:28.787 "abort": true, 00:03:28.787 "nvme_admin": false, 00:03:28.787 "nvme_io": false 00:03:28.787 }, 00:03:28.787 "memory_domains": [ 00:03:28.787 { 00:03:28.787 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.787 "dma_device_type": 2 00:03:28.787 } 00:03:28.787 ], 00:03:28.787 "driver_specific": {} 00:03:28.787 } 00:03:28.787 ]' 00:03:28.787 12:31:01 -- rpc/rpc.sh@17 -- # jq length 00:03:28.787 12:31:01 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:28.787 12:31:01 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:03:28.787 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.787 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.787 [2024-11-20 12:31:01.689224] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:03:28.787 [2024-11-20 12:31:01.689275] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:28.787 [2024-11-20 12:31:01.689297] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x18b3590 00:03:28.787 [2024-11-20 12:31:01.689311] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:28.787 [2024-11-20 12:31:01.690684] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:28.787 [2024-11-20 12:31:01.690712] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:28.787 Passthru0 00:03:28.787 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.787 12:31:01 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:28.787 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.787 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.787 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.787 12:31:01 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:28.787 { 00:03:28.787 "name": "Malloc2", 00:03:28.787 "aliases": [ 00:03:28.787 "3c7558a2-0e00-4d93-860e-3d4c611f65e5" 00:03:28.787 ], 00:03:28.787 "product_name": "Malloc disk", 00:03:28.787 "block_size": 512, 00:03:28.787 "num_blocks": 16384, 00:03:28.787 "uuid": "3c7558a2-0e00-4d93-860e-3d4c611f65e5", 00:03:28.787 "assigned_rate_limits": { 00:03:28.787 "rw_ios_per_sec": 0, 00:03:28.787 "rw_mbytes_per_sec": 0, 00:03:28.787 "r_mbytes_per_sec": 0, 00:03:28.787 "w_mbytes_per_sec": 0 00:03:28.787 }, 00:03:28.787 "claimed": true, 00:03:28.787 "claim_type": "exclusive_write", 00:03:28.787 "zoned": false, 00:03:28.787 "supported_io_types": { 00:03:28.787 "read": true, 00:03:28.787 "write": true, 00:03:28.787 "unmap": true, 00:03:28.787 "write_zeroes": true, 00:03:28.787 "flush": true, 00:03:28.787 "reset": true, 00:03:28.787 "compare": false, 00:03:28.787 "compare_and_write": false, 00:03:28.787 "abort": true, 00:03:28.787 "nvme_admin": false, 00:03:28.787 "nvme_io": false 00:03:28.787 }, 00:03:28.787 "memory_domains": [ 00:03:28.787 { 00:03:28.787 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.787 "dma_device_type": 2 00:03:28.787 } 00:03:28.787 ], 00:03:28.787 "driver_specific": {} 00:03:28.787 }, 00:03:28.787 { 00:03:28.787 "name": "Passthru0", 00:03:28.787 "aliases": [ 00:03:28.787 "aa390eaf-ce2b-5a78-aebc-4d6b5d4fd5e7" 00:03:28.787 ], 00:03:28.787 "product_name": "passthru", 00:03:28.787 "block_size": 512, 00:03:28.787 "num_blocks": 16384, 00:03:28.787 "uuid": "aa390eaf-ce2b-5a78-aebc-4d6b5d4fd5e7", 00:03:28.787 "assigned_rate_limits": { 00:03:28.787 "rw_ios_per_sec": 0, 00:03:28.787 "rw_mbytes_per_sec": 0, 00:03:28.787 "r_mbytes_per_sec": 0, 00:03:28.787 "w_mbytes_per_sec": 0 00:03:28.787 }, 00:03:28.787 "claimed": false, 00:03:28.787 "zoned": false, 00:03:28.787 "supported_io_types": { 00:03:28.787 "read": true, 00:03:28.787 "write": true, 00:03:28.787 "unmap": true, 00:03:28.787 "write_zeroes": true, 00:03:28.787 "flush": true, 00:03:28.787 "reset": true, 00:03:28.787 "compare": false, 00:03:28.787 "compare_and_write": false, 00:03:28.787 "abort": true, 00:03:28.787 "nvme_admin": false, 00:03:28.787 "nvme_io": false 00:03:28.787 }, 00:03:28.787 "memory_domains": [ 00:03:28.787 { 00:03:28.787 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:28.787 "dma_device_type": 2 00:03:28.787 } 00:03:28.787 ], 00:03:28.787 "driver_specific": { 00:03:28.787 "passthru": { 00:03:28.787 "name": "Passthru0", 00:03:28.787 "base_bdev_name": "Malloc2" 00:03:28.787 } 00:03:28.787 } 00:03:28.787 } 00:03:28.787 ]' 00:03:28.787 12:31:01 -- rpc/rpc.sh@21 -- # jq length 00:03:28.787 12:31:01 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:28.787 12:31:01 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:28.787 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.787 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.787 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.787 12:31:01 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:03:28.787 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.787 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.787 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.787 12:31:01 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:28.787 12:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:28.787 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.787 12:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:28.787 12:31:01 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:28.787 12:31:01 -- rpc/rpc.sh@26 -- # jq length 00:03:28.787 12:31:01 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:28.787 00:03:28.787 real 0m0.225s 00:03:28.787 user 0m0.149s 00:03:28.787 sys 0m0.018s 00:03:28.787 12:31:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.787 12:31:01 -- common/autotest_common.sh@10 -- # set +x 00:03:28.787 ************************************ 00:03:28.787 END TEST rpc_daemon_integrity 00:03:28.787 ************************************ 00:03:28.787 12:31:01 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:03:28.787 12:31:01 -- rpc/rpc.sh@84 -- # killprocess 3396952 00:03:28.787 12:31:01 -- common/autotest_common.sh@936 -- # '[' -z 3396952 ']' 00:03:28.787 12:31:01 -- common/autotest_common.sh@940 -- # kill -0 3396952 00:03:28.787 12:31:01 -- common/autotest_common.sh@941 -- # uname 00:03:28.787 12:31:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:28.787 12:31:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3396952 00:03:28.787 12:31:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:28.787 12:31:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:28.787 12:31:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3396952' 00:03:28.787 killing process with pid 3396952 00:03:28.787 12:31:01 -- common/autotest_common.sh@955 -- # kill 3396952 00:03:28.787 12:31:01 -- common/autotest_common.sh@960 -- # wait 3396952 00:03:29.356 00:03:29.356 real 0m2.523s 00:03:29.356 user 0m3.183s 00:03:29.356 sys 0m0.606s 00:03:29.356 12:31:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.356 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.356 ************************************ 00:03:29.356 END TEST rpc 00:03:29.356 ************************************ 00:03:29.356 12:31:02 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:29.356 12:31:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.356 12:31:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.356 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.356 ************************************ 00:03:29.356 START TEST rpc_client 00:03:29.356 ************************************ 00:03:29.356 12:31:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:29.356 * Looking for test storage... 00:03:29.356 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:03:29.356 12:31:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:29.356 12:31:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:29.356 12:31:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:29.615 12:31:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:29.615 12:31:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:29.615 12:31:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:29.615 12:31:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:29.615 12:31:02 -- scripts/common.sh@335 -- # IFS=.-: 00:03:29.615 12:31:02 -- scripts/common.sh@335 -- # read -ra ver1 00:03:29.615 12:31:02 -- scripts/common.sh@336 -- # IFS=.-: 00:03:29.615 12:31:02 -- scripts/common.sh@336 -- # read -ra ver2 00:03:29.615 12:31:02 -- scripts/common.sh@337 -- # local 'op=<' 00:03:29.615 12:31:02 -- scripts/common.sh@339 -- # ver1_l=2 00:03:29.615 12:31:02 -- scripts/common.sh@340 -- # ver2_l=1 00:03:29.615 12:31:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:29.615 12:31:02 -- scripts/common.sh@343 -- # case "$op" in 00:03:29.615 12:31:02 -- scripts/common.sh@344 -- # : 1 00:03:29.615 12:31:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:29.615 12:31:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:29.615 12:31:02 -- scripts/common.sh@364 -- # decimal 1 00:03:29.615 12:31:02 -- scripts/common.sh@352 -- # local d=1 00:03:29.615 12:31:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:29.615 12:31:02 -- scripts/common.sh@354 -- # echo 1 00:03:29.615 12:31:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:29.616 12:31:02 -- scripts/common.sh@365 -- # decimal 2 00:03:29.616 12:31:02 -- scripts/common.sh@352 -- # local d=2 00:03:29.616 12:31:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:29.616 12:31:02 -- scripts/common.sh@354 -- # echo 2 00:03:29.616 12:31:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:29.616 12:31:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:29.616 12:31:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:29.616 12:31:02 -- scripts/common.sh@367 -- # return 0 00:03:29.616 12:31:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:03:29.616 OK 00:03:29.616 12:31:02 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:03:29.616 00:03:29.616 real 0m0.146s 00:03:29.616 user 0m0.101s 00:03:29.616 sys 0m0.052s 00:03:29.616 12:31:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.616 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.616 ************************************ 00:03:29.616 END TEST rpc_client 00:03:29.616 ************************************ 00:03:29.616 12:31:02 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:29.616 12:31:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.616 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.616 ************************************ 00:03:29.616 START TEST json_config 00:03:29.616 ************************************ 00:03:29.616 12:31:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:29.616 12:31:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:29.616 12:31:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:29.616 12:31:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:29.616 12:31:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:29.616 12:31:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:29.616 12:31:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:29.616 12:31:02 -- scripts/common.sh@335 -- # IFS=.-: 00:03:29.616 12:31:02 -- scripts/common.sh@335 -- # read -ra ver1 00:03:29.616 12:31:02 -- scripts/common.sh@336 -- # IFS=.-: 00:03:29.616 12:31:02 -- scripts/common.sh@336 -- # read -ra ver2 00:03:29.616 12:31:02 -- scripts/common.sh@337 -- # local 'op=<' 00:03:29.616 12:31:02 -- scripts/common.sh@339 -- # ver1_l=2 00:03:29.616 12:31:02 -- scripts/common.sh@340 -- # ver2_l=1 00:03:29.616 12:31:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:29.616 12:31:02 -- scripts/common.sh@343 -- # case "$op" in 00:03:29.616 12:31:02 -- scripts/common.sh@344 -- # : 1 00:03:29.616 12:31:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:29.616 12:31:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:29.616 12:31:02 -- scripts/common.sh@364 -- # decimal 1 00:03:29.616 12:31:02 -- scripts/common.sh@352 -- # local d=1 00:03:29.616 12:31:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:29.616 12:31:02 -- scripts/common.sh@354 -- # echo 1 00:03:29.616 12:31:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:29.616 12:31:02 -- scripts/common.sh@365 -- # decimal 2 00:03:29.616 12:31:02 -- scripts/common.sh@352 -- # local d=2 00:03:29.616 12:31:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:29.616 12:31:02 -- scripts/common.sh@354 -- # echo 2 00:03:29.616 12:31:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:29.616 12:31:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:29.616 12:31:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:29.616 12:31:02 -- scripts/common.sh@367 -- # return 0 00:03:29.616 12:31:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:29.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.616 --rc genhtml_branch_coverage=1 00:03:29.616 --rc genhtml_function_coverage=1 00:03:29.616 --rc genhtml_legend=1 00:03:29.616 --rc geninfo_all_blocks=1 00:03:29.616 --rc geninfo_unexecuted_blocks=1 00:03:29.616 00:03:29.616 ' 00:03:29.616 12:31:02 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:29.616 12:31:02 -- nvmf/common.sh@7 -- # uname -s 00:03:29.616 12:31:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:29.616 12:31:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:29.616 12:31:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:29.616 12:31:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:29.616 12:31:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:29.616 12:31:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:29.616 12:31:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:29.616 12:31:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:29.616 12:31:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:29.616 12:31:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:29.616 12:31:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:29.616 12:31:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:29.616 12:31:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:29.616 12:31:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:29.616 12:31:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:29.616 12:31:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:29.616 12:31:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:29.616 12:31:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:29.616 12:31:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:29.616 12:31:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:29.616 12:31:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:29.617 12:31:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:29.617 12:31:02 -- paths/export.sh@5 -- # export PATH 00:03:29.617 12:31:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:29.617 12:31:02 -- nvmf/common.sh@46 -- # : 0 00:03:29.617 12:31:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:29.617 12:31:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:29.617 12:31:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:29.617 12:31:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:29.617 12:31:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:29.617 12:31:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:29.617 12:31:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:29.617 12:31:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:29.617 12:31:02 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:03:29.617 12:31:02 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:03:29.617 12:31:02 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:03:29.617 12:31:02 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:03:29.617 12:31:02 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:03:29.617 12:31:02 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:03:29.617 12:31:02 -- json_config/json_config.sh@32 -- # declare -A app_params 00:03:29.617 12:31:02 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:03:29.617 12:31:02 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:03:29.617 12:31:02 -- json_config/json_config.sh@43 -- # last_event_id=0 00:03:29.617 12:31:02 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:29.617 12:31:02 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:03:29.617 INFO: JSON configuration test init 00:03:29.617 12:31:02 -- json_config/json_config.sh@420 -- # json_config_test_init 00:03:29.617 12:31:02 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:03:29.617 12:31:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:29.617 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.617 12:31:02 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:03:29.617 12:31:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:29.617 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.617 12:31:02 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:03:29.617 12:31:02 -- json_config/json_config.sh@98 -- # local app=target 00:03:29.617 12:31:02 -- json_config/json_config.sh@99 -- # shift 00:03:29.617 12:31:02 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:29.617 12:31:02 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:29.617 12:31:02 -- json_config/json_config.sh@111 -- # app_pid[$app]=3397455 00:03:29.617 12:31:02 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:03:29.617 12:31:02 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:29.617 Waiting for target to run... 00:03:29.617 12:31:02 -- json_config/json_config.sh@114 -- # waitforlisten 3397455 /var/tmp/spdk_tgt.sock 00:03:29.617 12:31:02 -- common/autotest_common.sh@829 -- # '[' -z 3397455 ']' 00:03:29.617 12:31:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:29.617 12:31:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:29.617 12:31:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:29.617 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:29.617 12:31:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:29.617 12:31:02 -- common/autotest_common.sh@10 -- # set +x 00:03:29.617 [2024-11-20 12:31:02.704571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:29.617 [2024-11-20 12:31:02.704662] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3397455 ] 00:03:29.877 EAL: No free 2048 kB hugepages reported on node 1 00:03:30.136 [2024-11-20 12:31:03.202904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:30.395 [2024-11-20 12:31:03.307827] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:30.395 [2024-11-20 12:31:03.308039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:30.653 12:31:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:30.653 12:31:03 -- common/autotest_common.sh@862 -- # return 0 00:03:30.653 12:31:03 -- json_config/json_config.sh@115 -- # echo '' 00:03:30.653 00:03:30.653 12:31:03 -- json_config/json_config.sh@322 -- # create_accel_config 00:03:30.653 12:31:03 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:03:30.653 12:31:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:30.653 12:31:03 -- common/autotest_common.sh@10 -- # set +x 00:03:30.653 12:31:03 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:03:30.653 12:31:03 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:03:30.653 12:31:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:30.653 12:31:03 -- common/autotest_common.sh@10 -- # set +x 00:03:30.653 12:31:03 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:03:30.653 12:31:03 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:03:30.653 12:31:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:03:33.947 12:31:06 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:03:33.947 12:31:06 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:03:33.947 12:31:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:33.947 12:31:06 -- common/autotest_common.sh@10 -- # set +x 00:03:33.947 12:31:06 -- json_config/json_config.sh@48 -- # local ret=0 00:03:33.947 12:31:06 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:03:33.947 12:31:06 -- json_config/json_config.sh@49 -- # local enabled_types 00:03:33.947 12:31:06 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:03:33.947 12:31:06 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:03:33.947 12:31:06 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:03:34.207 12:31:07 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:03:34.207 12:31:07 -- json_config/json_config.sh@51 -- # local get_types 00:03:34.207 12:31:07 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:03:34.207 12:31:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:34.207 12:31:07 -- common/autotest_common.sh@10 -- # set +x 00:03:34.207 12:31:07 -- json_config/json_config.sh@58 -- # return 0 00:03:34.207 12:31:07 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:03:34.207 12:31:07 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:03:34.207 12:31:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:34.207 12:31:07 -- common/autotest_common.sh@10 -- # set +x 00:03:34.207 12:31:07 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:03:34.207 12:31:07 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:03:34.207 12:31:07 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:34.207 12:31:07 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:34.465 MallocForNvmf0 00:03:34.465 12:31:07 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:34.465 12:31:07 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:34.722 MallocForNvmf1 00:03:34.722 12:31:07 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:03:34.722 12:31:07 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:03:34.980 [2024-11-20 12:31:07.899300] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:34.980 12:31:07 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:34.980 12:31:07 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:35.238 12:31:08 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:35.238 12:31:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:35.497 12:31:08 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:35.497 12:31:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:35.755 12:31:08 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:35.755 12:31:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:36.012 [2024-11-20 12:31:08.898664] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:36.012 12:31:08 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:03:36.012 12:31:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:36.012 12:31:08 -- common/autotest_common.sh@10 -- # set +x 00:03:36.012 12:31:08 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:03:36.012 12:31:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:36.012 12:31:08 -- common/autotest_common.sh@10 -- # set +x 00:03:36.012 12:31:08 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:03:36.012 12:31:08 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:36.012 12:31:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:36.269 MallocBdevForConfigChangeCheck 00:03:36.269 12:31:09 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:03:36.269 12:31:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:36.269 12:31:09 -- common/autotest_common.sh@10 -- # set +x 00:03:36.269 12:31:09 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:03:36.269 12:31:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:36.527 12:31:09 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:03:36.527 INFO: shutting down applications... 00:03:36.527 12:31:09 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:03:36.527 12:31:09 -- json_config/json_config.sh@431 -- # json_config_clear target 00:03:36.527 12:31:09 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:03:36.527 12:31:09 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:03:38.432 Calling clear_iscsi_subsystem 00:03:38.432 Calling clear_nvmf_subsystem 00:03:38.432 Calling clear_nbd_subsystem 00:03:38.432 Calling clear_ublk_subsystem 00:03:38.432 Calling clear_vhost_blk_subsystem 00:03:38.432 Calling clear_vhost_scsi_subsystem 00:03:38.432 Calling clear_scheduler_subsystem 00:03:38.432 Calling clear_bdev_subsystem 00:03:38.432 Calling clear_accel_subsystem 00:03:38.432 Calling clear_vmd_subsystem 00:03:38.432 Calling clear_sock_subsystem 00:03:38.432 Calling clear_iobuf_subsystem 00:03:38.432 12:31:11 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:03:38.432 12:31:11 -- json_config/json_config.sh@396 -- # count=100 00:03:38.432 12:31:11 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:03:38.432 12:31:11 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:38.432 12:31:11 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:03:38.432 12:31:11 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:03:38.691 12:31:11 -- json_config/json_config.sh@398 -- # break 00:03:38.691 12:31:11 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:03:38.691 12:31:11 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:03:38.691 12:31:11 -- json_config/json_config.sh@120 -- # local app=target 00:03:38.691 12:31:11 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:03:38.691 12:31:11 -- json_config/json_config.sh@124 -- # [[ -n 3397455 ]] 00:03:38.691 12:31:11 -- json_config/json_config.sh@127 -- # kill -SIGINT 3397455 00:03:38.691 12:31:11 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:03:38.691 12:31:11 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:38.691 12:31:11 -- json_config/json_config.sh@130 -- # kill -0 3397455 00:03:38.691 12:31:11 -- json_config/json_config.sh@134 -- # sleep 0.5 00:03:39.260 12:31:12 -- json_config/json_config.sh@129 -- # (( i++ )) 00:03:39.260 12:31:12 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:39.260 12:31:12 -- json_config/json_config.sh@130 -- # kill -0 3397455 00:03:39.260 12:31:12 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:03:39.260 12:31:12 -- json_config/json_config.sh@132 -- # break 00:03:39.260 12:31:12 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:03:39.260 12:31:12 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:03:39.260 SPDK target shutdown done 00:03:39.260 12:31:12 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:03:39.260 INFO: relaunching applications... 00:03:39.260 12:31:12 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:39.260 12:31:12 -- json_config/json_config.sh@98 -- # local app=target 00:03:39.260 12:31:12 -- json_config/json_config.sh@99 -- # shift 00:03:39.260 12:31:12 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:39.260 12:31:12 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:39.260 12:31:12 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:39.260 12:31:12 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:39.260 12:31:12 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:39.260 12:31:12 -- json_config/json_config.sh@111 -- # app_pid[$app]=3398798 00:03:39.260 12:31:12 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:39.260 12:31:12 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:39.260 Waiting for target to run... 00:03:39.260 12:31:12 -- json_config/json_config.sh@114 -- # waitforlisten 3398798 /var/tmp/spdk_tgt.sock 00:03:39.260 12:31:12 -- common/autotest_common.sh@829 -- # '[' -z 3398798 ']' 00:03:39.260 12:31:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:39.260 12:31:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:39.260 12:31:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:39.260 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:39.260 12:31:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:39.260 12:31:12 -- common/autotest_common.sh@10 -- # set +x 00:03:39.260 [2024-11-20 12:31:12.158127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:39.260 [2024-11-20 12:31:12.158217] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3398798 ] 00:03:39.260 EAL: No free 2048 kB hugepages reported on node 1 00:03:39.519 [2024-11-20 12:31:12.514818] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:39.519 [2024-11-20 12:31:12.600821] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:39.519 [2024-11-20 12:31:12.601010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:42.805 [2024-11-20 12:31:15.636082] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:42.805 [2024-11-20 12:31:15.668617] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:43.063 12:31:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:43.063 12:31:16 -- common/autotest_common.sh@862 -- # return 0 00:03:43.063 12:31:16 -- json_config/json_config.sh@115 -- # echo '' 00:03:43.063 00:03:43.063 12:31:16 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:03:43.063 12:31:16 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:03:43.063 INFO: Checking if target configuration is the same... 00:03:43.063 12:31:16 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:43.063 12:31:16 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:03:43.063 12:31:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:43.063 + '[' 2 -ne 2 ']' 00:03:43.063 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:43.063 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:43.063 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:43.063 +++ basename /dev/fd/62 00:03:43.063 ++ mktemp /tmp/62.XXX 00:03:43.063 + tmp_file_1=/tmp/62.8re 00:03:43.063 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:43.063 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:43.063 + tmp_file_2=/tmp/spdk_tgt_config.json.jyo 00:03:43.063 + ret=0 00:03:43.063 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:43.630 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:43.630 + diff -u /tmp/62.8re /tmp/spdk_tgt_config.json.jyo 00:03:43.630 + echo 'INFO: JSON config files are the same' 00:03:43.630 INFO: JSON config files are the same 00:03:43.630 + rm /tmp/62.8re /tmp/spdk_tgt_config.json.jyo 00:03:43.630 + exit 0 00:03:43.630 12:31:16 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:03:43.630 12:31:16 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:03:43.630 INFO: changing configuration and checking if this can be detected... 00:03:43.630 12:31:16 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:43.630 12:31:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:43.887 12:31:16 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:43.887 12:31:16 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:03:43.887 12:31:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:43.887 + '[' 2 -ne 2 ']' 00:03:43.887 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:43.887 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:43.887 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:43.887 +++ basename /dev/fd/62 00:03:43.887 ++ mktemp /tmp/62.XXX 00:03:43.887 + tmp_file_1=/tmp/62.het 00:03:43.887 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:43.887 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:43.887 + tmp_file_2=/tmp/spdk_tgt_config.json.tx8 00:03:43.887 + ret=0 00:03:43.887 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:44.145 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:44.145 + diff -u /tmp/62.het /tmp/spdk_tgt_config.json.tx8 00:03:44.145 + ret=1 00:03:44.145 + echo '=== Start of file: /tmp/62.het ===' 00:03:44.145 + cat /tmp/62.het 00:03:44.145 + echo '=== End of file: /tmp/62.het ===' 00:03:44.145 + echo '' 00:03:44.145 + echo '=== Start of file: /tmp/spdk_tgt_config.json.tx8 ===' 00:03:44.145 + cat /tmp/spdk_tgt_config.json.tx8 00:03:44.145 + echo '=== End of file: /tmp/spdk_tgt_config.json.tx8 ===' 00:03:44.145 + echo '' 00:03:44.145 + rm /tmp/62.het /tmp/spdk_tgt_config.json.tx8 00:03:44.145 + exit 1 00:03:44.145 12:31:17 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:03:44.145 INFO: configuration change detected. 00:03:44.145 12:31:17 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:03:44.145 12:31:17 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:03:44.145 12:31:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:44.145 12:31:17 -- common/autotest_common.sh@10 -- # set +x 00:03:44.145 12:31:17 -- json_config/json_config.sh@360 -- # local ret=0 00:03:44.145 12:31:17 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:03:44.145 12:31:17 -- json_config/json_config.sh@370 -- # [[ -n 3398798 ]] 00:03:44.145 12:31:17 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:03:44.145 12:31:17 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:03:44.145 12:31:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:44.145 12:31:17 -- common/autotest_common.sh@10 -- # set +x 00:03:44.145 12:31:17 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:03:44.145 12:31:17 -- json_config/json_config.sh@246 -- # uname -s 00:03:44.145 12:31:17 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:03:44.145 12:31:17 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:03:44.145 12:31:17 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:03:44.145 12:31:17 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:03:44.145 12:31:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:44.145 12:31:17 -- common/autotest_common.sh@10 -- # set +x 00:03:44.145 12:31:17 -- json_config/json_config.sh@376 -- # killprocess 3398798 00:03:44.145 12:31:17 -- common/autotest_common.sh@936 -- # '[' -z 3398798 ']' 00:03:44.145 12:31:17 -- common/autotest_common.sh@940 -- # kill -0 3398798 00:03:44.145 12:31:17 -- common/autotest_common.sh@941 -- # uname 00:03:44.145 12:31:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:44.145 12:31:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3398798 00:03:44.404 12:31:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:44.404 12:31:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:44.404 12:31:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3398798' 00:03:44.404 killing process with pid 3398798 00:03:44.404 12:31:17 -- common/autotest_common.sh@955 -- # kill 3398798 00:03:44.404 12:31:17 -- common/autotest_common.sh@960 -- # wait 3398798 00:03:46.310 12:31:18 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:46.310 12:31:18 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:03:46.310 12:31:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:46.310 12:31:18 -- common/autotest_common.sh@10 -- # set +x 00:03:46.310 12:31:18 -- json_config/json_config.sh@381 -- # return 0 00:03:46.310 12:31:18 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:03:46.310 INFO: Success 00:03:46.310 00:03:46.310 real 0m16.415s 00:03:46.310 user 0m19.007s 00:03:46.310 sys 0m2.090s 00:03:46.310 12:31:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.310 12:31:18 -- common/autotest_common.sh@10 -- # set +x 00:03:46.310 ************************************ 00:03:46.310 END TEST json_config 00:03:46.310 ************************************ 00:03:46.310 12:31:18 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:46.310 12:31:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.310 12:31:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.310 12:31:18 -- common/autotest_common.sh@10 -- # set +x 00:03:46.310 ************************************ 00:03:46.310 START TEST json_config_extra_key 00:03:46.310 ************************************ 00:03:46.310 12:31:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:46.310 12:31:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:46.310 12:31:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:46.310 12:31:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:46.310 12:31:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:46.310 12:31:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:46.310 12:31:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:46.310 12:31:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:46.310 12:31:19 -- scripts/common.sh@335 -- # IFS=.-: 00:03:46.310 12:31:19 -- scripts/common.sh@335 -- # read -ra ver1 00:03:46.310 12:31:19 -- scripts/common.sh@336 -- # IFS=.-: 00:03:46.310 12:31:19 -- scripts/common.sh@336 -- # read -ra ver2 00:03:46.310 12:31:19 -- scripts/common.sh@337 -- # local 'op=<' 00:03:46.310 12:31:19 -- scripts/common.sh@339 -- # ver1_l=2 00:03:46.310 12:31:19 -- scripts/common.sh@340 -- # ver2_l=1 00:03:46.310 12:31:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:46.310 12:31:19 -- scripts/common.sh@343 -- # case "$op" in 00:03:46.310 12:31:19 -- scripts/common.sh@344 -- # : 1 00:03:46.310 12:31:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:46.310 12:31:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:46.310 12:31:19 -- scripts/common.sh@364 -- # decimal 1 00:03:46.310 12:31:19 -- scripts/common.sh@352 -- # local d=1 00:03:46.310 12:31:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:46.310 12:31:19 -- scripts/common.sh@354 -- # echo 1 00:03:46.310 12:31:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:46.310 12:31:19 -- scripts/common.sh@365 -- # decimal 2 00:03:46.310 12:31:19 -- scripts/common.sh@352 -- # local d=2 00:03:46.310 12:31:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:46.310 12:31:19 -- scripts/common.sh@354 -- # echo 2 00:03:46.310 12:31:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:46.310 12:31:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:46.310 12:31:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:46.310 12:31:19 -- scripts/common.sh@367 -- # return 0 00:03:46.310 12:31:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:46.310 12:31:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:46.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:46.310 --rc genhtml_branch_coverage=1 00:03:46.310 --rc genhtml_function_coverage=1 00:03:46.310 --rc genhtml_legend=1 00:03:46.310 --rc geninfo_all_blocks=1 00:03:46.310 --rc geninfo_unexecuted_blocks=1 00:03:46.310 00:03:46.310 ' 00:03:46.310 12:31:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:46.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:46.310 --rc genhtml_branch_coverage=1 00:03:46.310 --rc genhtml_function_coverage=1 00:03:46.310 --rc genhtml_legend=1 00:03:46.310 --rc geninfo_all_blocks=1 00:03:46.310 --rc geninfo_unexecuted_blocks=1 00:03:46.310 00:03:46.310 ' 00:03:46.310 12:31:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:46.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:46.310 --rc genhtml_branch_coverage=1 00:03:46.310 --rc genhtml_function_coverage=1 00:03:46.310 --rc genhtml_legend=1 00:03:46.310 --rc geninfo_all_blocks=1 00:03:46.310 --rc geninfo_unexecuted_blocks=1 00:03:46.310 00:03:46.310 ' 00:03:46.310 12:31:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:46.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:46.310 --rc genhtml_branch_coverage=1 00:03:46.310 --rc genhtml_function_coverage=1 00:03:46.310 --rc genhtml_legend=1 00:03:46.310 --rc geninfo_all_blocks=1 00:03:46.310 --rc geninfo_unexecuted_blocks=1 00:03:46.310 00:03:46.310 ' 00:03:46.310 12:31:19 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:46.310 12:31:19 -- nvmf/common.sh@7 -- # uname -s 00:03:46.310 12:31:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:46.311 12:31:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:46.311 12:31:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:46.311 12:31:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:46.311 12:31:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:46.311 12:31:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:46.311 12:31:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:46.311 12:31:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:46.311 12:31:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:46.311 12:31:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:46.311 12:31:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:46.311 12:31:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:46.311 12:31:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:46.311 12:31:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:46.311 12:31:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:46.311 12:31:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:46.311 12:31:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:46.311 12:31:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:46.311 12:31:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:46.311 12:31:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:46.311 12:31:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:46.311 12:31:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:46.311 12:31:19 -- paths/export.sh@5 -- # export PATH 00:03:46.311 12:31:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:46.311 12:31:19 -- nvmf/common.sh@46 -- # : 0 00:03:46.311 12:31:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:46.311 12:31:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:46.311 12:31:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:46.311 12:31:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:46.311 12:31:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:46.311 12:31:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:46.311 12:31:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:46.311 12:31:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:03:46.311 INFO: launching applications... 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@25 -- # shift 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3399748 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:03:46.311 Waiting for target to run... 00:03:46.311 12:31:19 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3399748 /var/tmp/spdk_tgt.sock 00:03:46.311 12:31:19 -- common/autotest_common.sh@829 -- # '[' -z 3399748 ']' 00:03:46.311 12:31:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:46.311 12:31:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:46.311 12:31:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:46.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:46.311 12:31:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:46.311 12:31:19 -- common/autotest_common.sh@10 -- # set +x 00:03:46.311 [2024-11-20 12:31:19.141490] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:46.311 [2024-11-20 12:31:19.141573] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3399748 ] 00:03:46.311 EAL: No free 2048 kB hugepages reported on node 1 00:03:46.591 [2024-11-20 12:31:19.487376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:46.591 [2024-11-20 12:31:19.579108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:46.591 [2024-11-20 12:31:19.579295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:47.173 12:31:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:47.173 12:31:20 -- common/autotest_common.sh@862 -- # return 0 00:03:47.173 12:31:20 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:03:47.173 00:03:47.173 12:31:20 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:03:47.173 INFO: shutting down applications... 00:03:47.173 12:31:20 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:03:47.173 12:31:20 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:03:47.173 12:31:20 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:03:47.174 12:31:20 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3399748 ]] 00:03:47.174 12:31:20 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3399748 00:03:47.174 12:31:20 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:03:47.174 12:31:20 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:47.174 12:31:20 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3399748 00:03:47.174 12:31:20 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:47.740 12:31:20 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:47.740 12:31:20 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:47.740 12:31:20 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3399748 00:03:47.740 12:31:20 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3399748 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@52 -- # break 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:03:47.997 SPDK target shutdown done 00:03:47.997 12:31:21 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:03:47.997 Success 00:03:47.997 00:03:47.997 real 0m2.133s 00:03:47.997 user 0m1.640s 00:03:47.997 sys 0m0.437s 00:03:47.997 12:31:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.997 12:31:21 -- common/autotest_common.sh@10 -- # set +x 00:03:47.998 ************************************ 00:03:47.998 END TEST json_config_extra_key 00:03:47.998 ************************************ 00:03:48.256 12:31:21 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:48.256 12:31:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:48.256 12:31:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:48.256 12:31:21 -- common/autotest_common.sh@10 -- # set +x 00:03:48.256 ************************************ 00:03:48.256 START TEST alias_rpc 00:03:48.256 ************************************ 00:03:48.256 12:31:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:48.256 * Looking for test storage... 00:03:48.256 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:03:48.256 12:31:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:48.256 12:31:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:48.256 12:31:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:48.256 12:31:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:48.256 12:31:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:48.256 12:31:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:48.256 12:31:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:48.256 12:31:21 -- scripts/common.sh@335 -- # IFS=.-: 00:03:48.256 12:31:21 -- scripts/common.sh@335 -- # read -ra ver1 00:03:48.256 12:31:21 -- scripts/common.sh@336 -- # IFS=.-: 00:03:48.256 12:31:21 -- scripts/common.sh@336 -- # read -ra ver2 00:03:48.256 12:31:21 -- scripts/common.sh@337 -- # local 'op=<' 00:03:48.256 12:31:21 -- scripts/common.sh@339 -- # ver1_l=2 00:03:48.256 12:31:21 -- scripts/common.sh@340 -- # ver2_l=1 00:03:48.256 12:31:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:48.256 12:31:21 -- scripts/common.sh@343 -- # case "$op" in 00:03:48.256 12:31:21 -- scripts/common.sh@344 -- # : 1 00:03:48.256 12:31:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:48.256 12:31:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:48.256 12:31:21 -- scripts/common.sh@364 -- # decimal 1 00:03:48.256 12:31:21 -- scripts/common.sh@352 -- # local d=1 00:03:48.256 12:31:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:48.256 12:31:21 -- scripts/common.sh@354 -- # echo 1 00:03:48.256 12:31:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:48.256 12:31:21 -- scripts/common.sh@365 -- # decimal 2 00:03:48.256 12:31:21 -- scripts/common.sh@352 -- # local d=2 00:03:48.256 12:31:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:48.256 12:31:21 -- scripts/common.sh@354 -- # echo 2 00:03:48.256 12:31:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:48.256 12:31:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:48.256 12:31:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:48.256 12:31:21 -- scripts/common.sh@367 -- # return 0 00:03:48.256 12:31:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:48.256 12:31:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:48.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:48.256 --rc genhtml_branch_coverage=1 00:03:48.256 --rc genhtml_function_coverage=1 00:03:48.256 --rc genhtml_legend=1 00:03:48.256 --rc geninfo_all_blocks=1 00:03:48.256 --rc geninfo_unexecuted_blocks=1 00:03:48.256 00:03:48.256 ' 00:03:48.256 12:31:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:48.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:48.256 --rc genhtml_branch_coverage=1 00:03:48.256 --rc genhtml_function_coverage=1 00:03:48.256 --rc genhtml_legend=1 00:03:48.256 --rc geninfo_all_blocks=1 00:03:48.256 --rc geninfo_unexecuted_blocks=1 00:03:48.256 00:03:48.256 ' 00:03:48.256 12:31:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:48.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:48.256 --rc genhtml_branch_coverage=1 00:03:48.256 --rc genhtml_function_coverage=1 00:03:48.256 --rc genhtml_legend=1 00:03:48.256 --rc geninfo_all_blocks=1 00:03:48.256 --rc geninfo_unexecuted_blocks=1 00:03:48.256 00:03:48.256 ' 00:03:48.256 12:31:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:48.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:48.256 --rc genhtml_branch_coverage=1 00:03:48.256 --rc genhtml_function_coverage=1 00:03:48.256 --rc genhtml_legend=1 00:03:48.256 --rc geninfo_all_blocks=1 00:03:48.256 --rc geninfo_unexecuted_blocks=1 00:03:48.256 00:03:48.256 ' 00:03:48.256 12:31:21 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:03:48.256 12:31:21 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3400077 00:03:48.256 12:31:21 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:48.256 12:31:21 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3400077 00:03:48.256 12:31:21 -- common/autotest_common.sh@829 -- # '[' -z 3400077 ']' 00:03:48.256 12:31:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:48.256 12:31:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:48.256 12:31:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:48.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:48.256 12:31:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:48.256 12:31:21 -- common/autotest_common.sh@10 -- # set +x 00:03:48.256 [2024-11-20 12:31:21.301067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:48.256 [2024-11-20 12:31:21.301185] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3400077 ] 00:03:48.256 EAL: No free 2048 kB hugepages reported on node 1 00:03:48.256 [2024-11-20 12:31:21.358094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:48.514 [2024-11-20 12:31:21.469971] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:48.515 [2024-11-20 12:31:21.470175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:49.448 12:31:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:49.448 12:31:22 -- common/autotest_common.sh@862 -- # return 0 00:03:49.448 12:31:22 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:03:49.448 12:31:22 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3400077 00:03:49.448 12:31:22 -- common/autotest_common.sh@936 -- # '[' -z 3400077 ']' 00:03:49.448 12:31:22 -- common/autotest_common.sh@940 -- # kill -0 3400077 00:03:49.448 12:31:22 -- common/autotest_common.sh@941 -- # uname 00:03:49.448 12:31:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:49.448 12:31:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3400077 00:03:49.448 12:31:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:49.706 12:31:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:49.706 12:31:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3400077' 00:03:49.706 killing process with pid 3400077 00:03:49.706 12:31:22 -- common/autotest_common.sh@955 -- # kill 3400077 00:03:49.706 12:31:22 -- common/autotest_common.sh@960 -- # wait 3400077 00:03:49.963 00:03:49.963 real 0m1.886s 00:03:49.963 user 0m2.136s 00:03:49.963 sys 0m0.496s 00:03:49.963 12:31:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:49.963 12:31:23 -- common/autotest_common.sh@10 -- # set +x 00:03:49.963 ************************************ 00:03:49.963 END TEST alias_rpc 00:03:49.963 ************************************ 00:03:49.963 12:31:23 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:03:49.963 12:31:23 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:03:49.963 12:31:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:49.963 12:31:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:49.963 12:31:23 -- common/autotest_common.sh@10 -- # set +x 00:03:49.963 ************************************ 00:03:49.963 START TEST spdkcli_tcp 00:03:49.963 ************************************ 00:03:49.963 12:31:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:03:49.963 * Looking for test storage... 00:03:49.963 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:03:49.963 12:31:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:49.963 12:31:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:49.963 12:31:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:50.222 12:31:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:50.222 12:31:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:50.222 12:31:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:50.222 12:31:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:50.222 12:31:23 -- scripts/common.sh@335 -- # IFS=.-: 00:03:50.222 12:31:23 -- scripts/common.sh@335 -- # read -ra ver1 00:03:50.222 12:31:23 -- scripts/common.sh@336 -- # IFS=.-: 00:03:50.222 12:31:23 -- scripts/common.sh@336 -- # read -ra ver2 00:03:50.222 12:31:23 -- scripts/common.sh@337 -- # local 'op=<' 00:03:50.222 12:31:23 -- scripts/common.sh@339 -- # ver1_l=2 00:03:50.222 12:31:23 -- scripts/common.sh@340 -- # ver2_l=1 00:03:50.222 12:31:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:50.222 12:31:23 -- scripts/common.sh@343 -- # case "$op" in 00:03:50.222 12:31:23 -- scripts/common.sh@344 -- # : 1 00:03:50.222 12:31:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:50.222 12:31:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:50.222 12:31:23 -- scripts/common.sh@364 -- # decimal 1 00:03:50.222 12:31:23 -- scripts/common.sh@352 -- # local d=1 00:03:50.222 12:31:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:50.222 12:31:23 -- scripts/common.sh@354 -- # echo 1 00:03:50.222 12:31:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:50.222 12:31:23 -- scripts/common.sh@365 -- # decimal 2 00:03:50.222 12:31:23 -- scripts/common.sh@352 -- # local d=2 00:03:50.222 12:31:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:50.222 12:31:23 -- scripts/common.sh@354 -- # echo 2 00:03:50.222 12:31:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:50.222 12:31:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:50.222 12:31:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:50.222 12:31:23 -- scripts/common.sh@367 -- # return 0 00:03:50.222 12:31:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:50.222 12:31:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:50.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.222 --rc genhtml_branch_coverage=1 00:03:50.222 --rc genhtml_function_coverage=1 00:03:50.222 --rc genhtml_legend=1 00:03:50.222 --rc geninfo_all_blocks=1 00:03:50.222 --rc geninfo_unexecuted_blocks=1 00:03:50.222 00:03:50.222 ' 00:03:50.222 12:31:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:50.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.222 --rc genhtml_branch_coverage=1 00:03:50.222 --rc genhtml_function_coverage=1 00:03:50.222 --rc genhtml_legend=1 00:03:50.222 --rc geninfo_all_blocks=1 00:03:50.222 --rc geninfo_unexecuted_blocks=1 00:03:50.222 00:03:50.222 ' 00:03:50.222 12:31:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:50.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.222 --rc genhtml_branch_coverage=1 00:03:50.222 --rc genhtml_function_coverage=1 00:03:50.222 --rc genhtml_legend=1 00:03:50.222 --rc geninfo_all_blocks=1 00:03:50.222 --rc geninfo_unexecuted_blocks=1 00:03:50.222 00:03:50.222 ' 00:03:50.222 12:31:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:50.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.222 --rc genhtml_branch_coverage=1 00:03:50.222 --rc genhtml_function_coverage=1 00:03:50.222 --rc genhtml_legend=1 00:03:50.222 --rc geninfo_all_blocks=1 00:03:50.222 --rc geninfo_unexecuted_blocks=1 00:03:50.222 00:03:50.222 ' 00:03:50.222 12:31:23 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:03:50.222 12:31:23 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:03:50.222 12:31:23 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:03:50.222 12:31:23 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:03:50.222 12:31:23 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:03:50.222 12:31:23 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:03:50.222 12:31:23 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:03:50.222 12:31:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:50.223 12:31:23 -- common/autotest_common.sh@10 -- # set +x 00:03:50.223 12:31:23 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3400410 00:03:50.223 12:31:23 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:03:50.223 12:31:23 -- spdkcli/tcp.sh@27 -- # waitforlisten 3400410 00:03:50.223 12:31:23 -- common/autotest_common.sh@829 -- # '[' -z 3400410 ']' 00:03:50.223 12:31:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:50.223 12:31:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:50.223 12:31:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:50.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:50.223 12:31:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:50.223 12:31:23 -- common/autotest_common.sh@10 -- # set +x 00:03:50.223 [2024-11-20 12:31:23.208248] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:50.223 [2024-11-20 12:31:23.208343] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3400410 ] 00:03:50.223 EAL: No free 2048 kB hugepages reported on node 1 00:03:50.223 [2024-11-20 12:31:23.269894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:03:50.481 [2024-11-20 12:31:23.384503] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:50.481 [2024-11-20 12:31:23.384746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:03:50.481 [2024-11-20 12:31:23.384753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:51.416 12:31:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:51.416 12:31:24 -- common/autotest_common.sh@862 -- # return 0 00:03:51.416 12:31:24 -- spdkcli/tcp.sh@31 -- # socat_pid=3400511 00:03:51.416 12:31:24 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:03:51.416 12:31:24 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:03:51.416 [ 00:03:51.416 "bdev_malloc_delete", 00:03:51.416 "bdev_malloc_create", 00:03:51.416 "bdev_null_resize", 00:03:51.416 "bdev_null_delete", 00:03:51.416 "bdev_null_create", 00:03:51.416 "bdev_nvme_cuse_unregister", 00:03:51.416 "bdev_nvme_cuse_register", 00:03:51.417 "bdev_opal_new_user", 00:03:51.417 "bdev_opal_set_lock_state", 00:03:51.417 "bdev_opal_delete", 00:03:51.417 "bdev_opal_get_info", 00:03:51.417 "bdev_opal_create", 00:03:51.417 "bdev_nvme_opal_revert", 00:03:51.417 "bdev_nvme_opal_init", 00:03:51.417 "bdev_nvme_send_cmd", 00:03:51.417 "bdev_nvme_get_path_iostat", 00:03:51.417 "bdev_nvme_get_mdns_discovery_info", 00:03:51.417 "bdev_nvme_stop_mdns_discovery", 00:03:51.417 "bdev_nvme_start_mdns_discovery", 00:03:51.417 "bdev_nvme_set_multipath_policy", 00:03:51.417 "bdev_nvme_set_preferred_path", 00:03:51.417 "bdev_nvme_get_io_paths", 00:03:51.417 "bdev_nvme_remove_error_injection", 00:03:51.417 "bdev_nvme_add_error_injection", 00:03:51.417 "bdev_nvme_get_discovery_info", 00:03:51.417 "bdev_nvme_stop_discovery", 00:03:51.417 "bdev_nvme_start_discovery", 00:03:51.417 "bdev_nvme_get_controller_health_info", 00:03:51.417 "bdev_nvme_disable_controller", 00:03:51.417 "bdev_nvme_enable_controller", 00:03:51.417 "bdev_nvme_reset_controller", 00:03:51.417 "bdev_nvme_get_transport_statistics", 00:03:51.417 "bdev_nvme_apply_firmware", 00:03:51.417 "bdev_nvme_detach_controller", 00:03:51.417 "bdev_nvme_get_controllers", 00:03:51.417 "bdev_nvme_attach_controller", 00:03:51.417 "bdev_nvme_set_hotplug", 00:03:51.417 "bdev_nvme_set_options", 00:03:51.417 "bdev_passthru_delete", 00:03:51.417 "bdev_passthru_create", 00:03:51.417 "bdev_lvol_grow_lvstore", 00:03:51.417 "bdev_lvol_get_lvols", 00:03:51.417 "bdev_lvol_get_lvstores", 00:03:51.417 "bdev_lvol_delete", 00:03:51.417 "bdev_lvol_set_read_only", 00:03:51.417 "bdev_lvol_resize", 00:03:51.417 "bdev_lvol_decouple_parent", 00:03:51.417 "bdev_lvol_inflate", 00:03:51.417 "bdev_lvol_rename", 00:03:51.417 "bdev_lvol_clone_bdev", 00:03:51.417 "bdev_lvol_clone", 00:03:51.417 "bdev_lvol_snapshot", 00:03:51.417 "bdev_lvol_create", 00:03:51.417 "bdev_lvol_delete_lvstore", 00:03:51.417 "bdev_lvol_rename_lvstore", 00:03:51.417 "bdev_lvol_create_lvstore", 00:03:51.417 "bdev_raid_set_options", 00:03:51.417 "bdev_raid_remove_base_bdev", 00:03:51.417 "bdev_raid_add_base_bdev", 00:03:51.417 "bdev_raid_delete", 00:03:51.417 "bdev_raid_create", 00:03:51.417 "bdev_raid_get_bdevs", 00:03:51.417 "bdev_error_inject_error", 00:03:51.417 "bdev_error_delete", 00:03:51.417 "bdev_error_create", 00:03:51.417 "bdev_split_delete", 00:03:51.417 "bdev_split_create", 00:03:51.417 "bdev_delay_delete", 00:03:51.417 "bdev_delay_create", 00:03:51.417 "bdev_delay_update_latency", 00:03:51.417 "bdev_zone_block_delete", 00:03:51.417 "bdev_zone_block_create", 00:03:51.417 "blobfs_create", 00:03:51.417 "blobfs_detect", 00:03:51.417 "blobfs_set_cache_size", 00:03:51.417 "bdev_aio_delete", 00:03:51.417 "bdev_aio_rescan", 00:03:51.417 "bdev_aio_create", 00:03:51.417 "bdev_ftl_set_property", 00:03:51.417 "bdev_ftl_get_properties", 00:03:51.417 "bdev_ftl_get_stats", 00:03:51.417 "bdev_ftl_unmap", 00:03:51.417 "bdev_ftl_unload", 00:03:51.417 "bdev_ftl_delete", 00:03:51.417 "bdev_ftl_load", 00:03:51.417 "bdev_ftl_create", 00:03:51.417 "bdev_virtio_attach_controller", 00:03:51.417 "bdev_virtio_scsi_get_devices", 00:03:51.417 "bdev_virtio_detach_controller", 00:03:51.417 "bdev_virtio_blk_set_hotplug", 00:03:51.417 "bdev_iscsi_delete", 00:03:51.417 "bdev_iscsi_create", 00:03:51.417 "bdev_iscsi_set_options", 00:03:51.417 "accel_error_inject_error", 00:03:51.417 "ioat_scan_accel_module", 00:03:51.417 "dsa_scan_accel_module", 00:03:51.417 "iaa_scan_accel_module", 00:03:51.417 "iscsi_set_options", 00:03:51.417 "iscsi_get_auth_groups", 00:03:51.417 "iscsi_auth_group_remove_secret", 00:03:51.417 "iscsi_auth_group_add_secret", 00:03:51.417 "iscsi_delete_auth_group", 00:03:51.417 "iscsi_create_auth_group", 00:03:51.417 "iscsi_set_discovery_auth", 00:03:51.417 "iscsi_get_options", 00:03:51.417 "iscsi_target_node_request_logout", 00:03:51.417 "iscsi_target_node_set_redirect", 00:03:51.417 "iscsi_target_node_set_auth", 00:03:51.417 "iscsi_target_node_add_lun", 00:03:51.417 "iscsi_get_connections", 00:03:51.417 "iscsi_portal_group_set_auth", 00:03:51.417 "iscsi_start_portal_group", 00:03:51.417 "iscsi_delete_portal_group", 00:03:51.417 "iscsi_create_portal_group", 00:03:51.417 "iscsi_get_portal_groups", 00:03:51.417 "iscsi_delete_target_node", 00:03:51.417 "iscsi_target_node_remove_pg_ig_maps", 00:03:51.417 "iscsi_target_node_add_pg_ig_maps", 00:03:51.417 "iscsi_create_target_node", 00:03:51.417 "iscsi_get_target_nodes", 00:03:51.417 "iscsi_delete_initiator_group", 00:03:51.417 "iscsi_initiator_group_remove_initiators", 00:03:51.417 "iscsi_initiator_group_add_initiators", 00:03:51.417 "iscsi_create_initiator_group", 00:03:51.417 "iscsi_get_initiator_groups", 00:03:51.417 "nvmf_set_crdt", 00:03:51.417 "nvmf_set_config", 00:03:51.417 "nvmf_set_max_subsystems", 00:03:51.417 "nvmf_subsystem_get_listeners", 00:03:51.417 "nvmf_subsystem_get_qpairs", 00:03:51.417 "nvmf_subsystem_get_controllers", 00:03:51.417 "nvmf_get_stats", 00:03:51.417 "nvmf_get_transports", 00:03:51.417 "nvmf_create_transport", 00:03:51.417 "nvmf_get_targets", 00:03:51.417 "nvmf_delete_target", 00:03:51.417 "nvmf_create_target", 00:03:51.417 "nvmf_subsystem_allow_any_host", 00:03:51.417 "nvmf_subsystem_remove_host", 00:03:51.417 "nvmf_subsystem_add_host", 00:03:51.417 "nvmf_subsystem_remove_ns", 00:03:51.417 "nvmf_subsystem_add_ns", 00:03:51.417 "nvmf_subsystem_listener_set_ana_state", 00:03:51.417 "nvmf_discovery_get_referrals", 00:03:51.417 "nvmf_discovery_remove_referral", 00:03:51.417 "nvmf_discovery_add_referral", 00:03:51.417 "nvmf_subsystem_remove_listener", 00:03:51.417 "nvmf_subsystem_add_listener", 00:03:51.417 "nvmf_delete_subsystem", 00:03:51.417 "nvmf_create_subsystem", 00:03:51.417 "nvmf_get_subsystems", 00:03:51.417 "env_dpdk_get_mem_stats", 00:03:51.417 "nbd_get_disks", 00:03:51.417 "nbd_stop_disk", 00:03:51.417 "nbd_start_disk", 00:03:51.417 "ublk_recover_disk", 00:03:51.417 "ublk_get_disks", 00:03:51.417 "ublk_stop_disk", 00:03:51.417 "ublk_start_disk", 00:03:51.417 "ublk_destroy_target", 00:03:51.417 "ublk_create_target", 00:03:51.417 "virtio_blk_create_transport", 00:03:51.417 "virtio_blk_get_transports", 00:03:51.417 "vhost_controller_set_coalescing", 00:03:51.417 "vhost_get_controllers", 00:03:51.417 "vhost_delete_controller", 00:03:51.417 "vhost_create_blk_controller", 00:03:51.417 "vhost_scsi_controller_remove_target", 00:03:51.417 "vhost_scsi_controller_add_target", 00:03:51.417 "vhost_start_scsi_controller", 00:03:51.417 "vhost_create_scsi_controller", 00:03:51.417 "thread_set_cpumask", 00:03:51.418 "framework_get_scheduler", 00:03:51.418 "framework_set_scheduler", 00:03:51.418 "framework_get_reactors", 00:03:51.418 "thread_get_io_channels", 00:03:51.418 "thread_get_pollers", 00:03:51.418 "thread_get_stats", 00:03:51.418 "framework_monitor_context_switch", 00:03:51.418 "spdk_kill_instance", 00:03:51.418 "log_enable_timestamps", 00:03:51.418 "log_get_flags", 00:03:51.418 "log_clear_flag", 00:03:51.418 "log_set_flag", 00:03:51.418 "log_get_level", 00:03:51.418 "log_set_level", 00:03:51.418 "log_get_print_level", 00:03:51.418 "log_set_print_level", 00:03:51.418 "framework_enable_cpumask_locks", 00:03:51.418 "framework_disable_cpumask_locks", 00:03:51.418 "framework_wait_init", 00:03:51.418 "framework_start_init", 00:03:51.418 "scsi_get_devices", 00:03:51.418 "bdev_get_histogram", 00:03:51.418 "bdev_enable_histogram", 00:03:51.418 "bdev_set_qos_limit", 00:03:51.418 "bdev_set_qd_sampling_period", 00:03:51.418 "bdev_get_bdevs", 00:03:51.418 "bdev_reset_iostat", 00:03:51.418 "bdev_get_iostat", 00:03:51.418 "bdev_examine", 00:03:51.418 "bdev_wait_for_examine", 00:03:51.418 "bdev_set_options", 00:03:51.418 "notify_get_notifications", 00:03:51.418 "notify_get_types", 00:03:51.418 "accel_get_stats", 00:03:51.418 "accel_set_options", 00:03:51.418 "accel_set_driver", 00:03:51.418 "accel_crypto_key_destroy", 00:03:51.418 "accel_crypto_keys_get", 00:03:51.418 "accel_crypto_key_create", 00:03:51.418 "accel_assign_opc", 00:03:51.418 "accel_get_module_info", 00:03:51.418 "accel_get_opc_assignments", 00:03:51.418 "vmd_rescan", 00:03:51.418 "vmd_remove_device", 00:03:51.418 "vmd_enable", 00:03:51.418 "sock_set_default_impl", 00:03:51.418 "sock_impl_set_options", 00:03:51.418 "sock_impl_get_options", 00:03:51.418 "iobuf_get_stats", 00:03:51.418 "iobuf_set_options", 00:03:51.418 "framework_get_pci_devices", 00:03:51.418 "framework_get_config", 00:03:51.418 "framework_get_subsystems", 00:03:51.418 "trace_get_info", 00:03:51.418 "trace_get_tpoint_group_mask", 00:03:51.418 "trace_disable_tpoint_group", 00:03:51.418 "trace_enable_tpoint_group", 00:03:51.418 "trace_clear_tpoint_mask", 00:03:51.418 "trace_set_tpoint_mask", 00:03:51.418 "spdk_get_version", 00:03:51.418 "rpc_get_methods" 00:03:51.418 ] 00:03:51.418 12:31:24 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:03:51.418 12:31:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:51.418 12:31:24 -- common/autotest_common.sh@10 -- # set +x 00:03:51.418 12:31:24 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:03:51.418 12:31:24 -- spdkcli/tcp.sh@38 -- # killprocess 3400410 00:03:51.418 12:31:24 -- common/autotest_common.sh@936 -- # '[' -z 3400410 ']' 00:03:51.418 12:31:24 -- common/autotest_common.sh@940 -- # kill -0 3400410 00:03:51.418 12:31:24 -- common/autotest_common.sh@941 -- # uname 00:03:51.418 12:31:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:51.418 12:31:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3400410 00:03:51.418 12:31:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:51.418 12:31:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:51.418 12:31:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3400410' 00:03:51.418 killing process with pid 3400410 00:03:51.418 12:31:24 -- common/autotest_common.sh@955 -- # kill 3400410 00:03:51.418 12:31:24 -- common/autotest_common.sh@960 -- # wait 3400410 00:03:51.982 00:03:51.982 real 0m1.914s 00:03:51.982 user 0m3.623s 00:03:51.982 sys 0m0.496s 00:03:51.982 12:31:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:51.982 12:31:24 -- common/autotest_common.sh@10 -- # set +x 00:03:51.982 ************************************ 00:03:51.982 END TEST spdkcli_tcp 00:03:51.982 ************************************ 00:03:51.982 12:31:24 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:03:51.982 12:31:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:51.982 12:31:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:51.982 12:31:24 -- common/autotest_common.sh@10 -- # set +x 00:03:51.982 ************************************ 00:03:51.982 START TEST dpdk_mem_utility 00:03:51.982 ************************************ 00:03:51.982 12:31:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:03:51.982 * Looking for test storage... 00:03:51.982 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:03:51.982 12:31:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:51.982 12:31:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:51.982 12:31:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:52.241 12:31:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:52.241 12:31:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:52.241 12:31:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:52.242 12:31:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:52.242 12:31:25 -- scripts/common.sh@335 -- # IFS=.-: 00:03:52.242 12:31:25 -- scripts/common.sh@335 -- # read -ra ver1 00:03:52.242 12:31:25 -- scripts/common.sh@336 -- # IFS=.-: 00:03:52.242 12:31:25 -- scripts/common.sh@336 -- # read -ra ver2 00:03:52.242 12:31:25 -- scripts/common.sh@337 -- # local 'op=<' 00:03:52.242 12:31:25 -- scripts/common.sh@339 -- # ver1_l=2 00:03:52.242 12:31:25 -- scripts/common.sh@340 -- # ver2_l=1 00:03:52.242 12:31:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:52.242 12:31:25 -- scripts/common.sh@343 -- # case "$op" in 00:03:52.242 12:31:25 -- scripts/common.sh@344 -- # : 1 00:03:52.242 12:31:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:52.242 12:31:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:52.242 12:31:25 -- scripts/common.sh@364 -- # decimal 1 00:03:52.242 12:31:25 -- scripts/common.sh@352 -- # local d=1 00:03:52.242 12:31:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:52.242 12:31:25 -- scripts/common.sh@354 -- # echo 1 00:03:52.242 12:31:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:52.242 12:31:25 -- scripts/common.sh@365 -- # decimal 2 00:03:52.242 12:31:25 -- scripts/common.sh@352 -- # local d=2 00:03:52.242 12:31:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:52.242 12:31:25 -- scripts/common.sh@354 -- # echo 2 00:03:52.242 12:31:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:52.242 12:31:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:52.242 12:31:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:52.242 12:31:25 -- scripts/common.sh@367 -- # return 0 00:03:52.242 12:31:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:52.242 12:31:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:52.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:52.242 --rc genhtml_branch_coverage=1 00:03:52.242 --rc genhtml_function_coverage=1 00:03:52.242 --rc genhtml_legend=1 00:03:52.242 --rc geninfo_all_blocks=1 00:03:52.242 --rc geninfo_unexecuted_blocks=1 00:03:52.242 00:03:52.242 ' 00:03:52.242 12:31:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:52.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:52.242 --rc genhtml_branch_coverage=1 00:03:52.242 --rc genhtml_function_coverage=1 00:03:52.242 --rc genhtml_legend=1 00:03:52.242 --rc geninfo_all_blocks=1 00:03:52.242 --rc geninfo_unexecuted_blocks=1 00:03:52.242 00:03:52.242 ' 00:03:52.242 12:31:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:52.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:52.242 --rc genhtml_branch_coverage=1 00:03:52.242 --rc genhtml_function_coverage=1 00:03:52.242 --rc genhtml_legend=1 00:03:52.242 --rc geninfo_all_blocks=1 00:03:52.242 --rc geninfo_unexecuted_blocks=1 00:03:52.242 00:03:52.242 ' 00:03:52.242 12:31:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:52.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:52.242 --rc genhtml_branch_coverage=1 00:03:52.242 --rc genhtml_function_coverage=1 00:03:52.242 --rc genhtml_legend=1 00:03:52.242 --rc geninfo_all_blocks=1 00:03:52.242 --rc geninfo_unexecuted_blocks=1 00:03:52.242 00:03:52.242 ' 00:03:52.242 12:31:25 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:03:52.242 12:31:25 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3400629 00:03:52.242 12:31:25 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:52.242 12:31:25 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3400629 00:03:52.242 12:31:25 -- common/autotest_common.sh@829 -- # '[' -z 3400629 ']' 00:03:52.242 12:31:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:52.242 12:31:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:52.242 12:31:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:52.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:52.242 12:31:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:52.242 12:31:25 -- common/autotest_common.sh@10 -- # set +x 00:03:52.242 [2024-11-20 12:31:25.156564] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:52.242 [2024-11-20 12:31:25.156647] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3400629 ] 00:03:52.242 EAL: No free 2048 kB hugepages reported on node 1 00:03:52.242 [2024-11-20 12:31:25.219894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:52.242 [2024-11-20 12:31:25.339170] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:52.242 [2024-11-20 12:31:25.339331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:53.179 12:31:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:53.179 12:31:26 -- common/autotest_common.sh@862 -- # return 0 00:03:53.179 12:31:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:03:53.179 12:31:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:03:53.179 12:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:53.179 12:31:26 -- common/autotest_common.sh@10 -- # set +x 00:03:53.179 { 00:03:53.179 "filename": "/tmp/spdk_mem_dump.txt" 00:03:53.179 } 00:03:53.179 12:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:53.179 12:31:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:03:53.179 DPDK memory size 814.000000 MiB in 1 heap(s) 00:03:53.179 1 heaps totaling size 814.000000 MiB 00:03:53.179 size: 814.000000 MiB heap id: 0 00:03:53.179 end heaps---------- 00:03:53.179 8 mempools totaling size 598.116089 MiB 00:03:53.179 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:03:53.179 size: 158.602051 MiB name: PDU_data_out_Pool 00:03:53.179 size: 84.521057 MiB name: bdev_io_3400629 00:03:53.179 size: 51.011292 MiB name: evtpool_3400629 00:03:53.179 size: 50.003479 MiB name: msgpool_3400629 00:03:53.179 size: 21.763794 MiB name: PDU_Pool 00:03:53.179 size: 19.513306 MiB name: SCSI_TASK_Pool 00:03:53.179 size: 0.026123 MiB name: Session_Pool 00:03:53.179 end mempools------- 00:03:53.179 6 memzones totaling size 4.142822 MiB 00:03:53.179 size: 1.000366 MiB name: RG_ring_0_3400629 00:03:53.179 size: 1.000366 MiB name: RG_ring_1_3400629 00:03:53.179 size: 1.000366 MiB name: RG_ring_4_3400629 00:03:53.179 size: 1.000366 MiB name: RG_ring_5_3400629 00:03:53.179 size: 0.125366 MiB name: RG_ring_2_3400629 00:03:53.179 size: 0.015991 MiB name: RG_ring_3_3400629 00:03:53.179 end memzones------- 00:03:53.179 12:31:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:03:53.179 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:03:53.179 list of free elements. size: 12.519348 MiB 00:03:53.179 element at address: 0x200000400000 with size: 1.999512 MiB 00:03:53.179 element at address: 0x200018e00000 with size: 0.999878 MiB 00:03:53.179 element at address: 0x200019000000 with size: 0.999878 MiB 00:03:53.179 element at address: 0x200003e00000 with size: 0.996277 MiB 00:03:53.179 element at address: 0x200031c00000 with size: 0.994446 MiB 00:03:53.179 element at address: 0x200013800000 with size: 0.978699 MiB 00:03:53.179 element at address: 0x200007000000 with size: 0.959839 MiB 00:03:53.179 element at address: 0x200019200000 with size: 0.936584 MiB 00:03:53.179 element at address: 0x200000200000 with size: 0.841614 MiB 00:03:53.179 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:03:53.179 element at address: 0x20000b200000 with size: 0.490723 MiB 00:03:53.179 element at address: 0x200000800000 with size: 0.487793 MiB 00:03:53.179 element at address: 0x200019400000 with size: 0.485657 MiB 00:03:53.179 element at address: 0x200027e00000 with size: 0.410034 MiB 00:03:53.179 element at address: 0x200003a00000 with size: 0.355530 MiB 00:03:53.179 list of standard malloc elements. size: 199.218079 MiB 00:03:53.179 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:03:53.179 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:03:53.179 element at address: 0x200018efff80 with size: 1.000122 MiB 00:03:53.179 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:03:53.179 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:03:53.179 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:03:53.179 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:03:53.179 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:03:53.179 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:03:53.179 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:03:53.179 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:03:53.179 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:03:53.179 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:03:53.179 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:03:53.179 element at address: 0x200003adb300 with size: 0.000183 MiB 00:03:53.179 element at address: 0x200003adb500 with size: 0.000183 MiB 00:03:53.179 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:03:53.179 element at address: 0x200003affa80 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200003affb40 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:03:53.180 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:03:53.180 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:03:53.180 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:03:53.180 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:03:53.180 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:03:53.180 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:03:53.180 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:03:53.180 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:03:53.180 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:03:53.180 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200027e69040 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:03:53.180 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:03:53.180 list of memzone associated elements. size: 602.262573 MiB 00:03:53.180 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:03:53.180 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:03:53.180 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:03:53.180 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:03:53.180 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:03:53.180 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3400629_0 00:03:53.180 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:03:53.180 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3400629_0 00:03:53.180 element at address: 0x200003fff380 with size: 48.003052 MiB 00:03:53.180 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3400629_0 00:03:53.180 element at address: 0x2000195be940 with size: 20.255554 MiB 00:03:53.180 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:03:53.180 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:03:53.180 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:03:53.180 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:03:53.180 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3400629 00:03:53.180 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:03:53.180 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3400629 00:03:53.180 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:03:53.180 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3400629 00:03:53.180 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:03:53.180 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:03:53.180 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:03:53.180 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:03:53.180 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:03:53.180 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:03:53.180 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:03:53.180 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:03:53.180 element at address: 0x200003eff180 with size: 1.000488 MiB 00:03:53.180 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3400629 00:03:53.180 element at address: 0x200003affc00 with size: 1.000488 MiB 00:03:53.180 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3400629 00:03:53.180 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:03:53.180 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3400629 00:03:53.180 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:03:53.180 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3400629 00:03:53.180 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:03:53.180 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3400629 00:03:53.180 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:03:53.180 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:03:53.180 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:03:53.180 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:03:53.180 element at address: 0x20001947c540 with size: 0.250488 MiB 00:03:53.180 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:03:53.180 element at address: 0x200003adf880 with size: 0.125488 MiB 00:03:53.180 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3400629 00:03:53.180 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:03:53.180 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:03:53.180 element at address: 0x200027e69100 with size: 0.023743 MiB 00:03:53.180 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:03:53.180 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:03:53.180 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3400629 00:03:53.180 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:03:53.180 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:03:53.180 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:03:53.180 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3400629 00:03:53.180 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:03:53.180 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3400629 00:03:53.180 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:03:53.180 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:03:53.180 12:31:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:03:53.180 12:31:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3400629 00:03:53.180 12:31:26 -- common/autotest_common.sh@936 -- # '[' -z 3400629 ']' 00:03:53.180 12:31:26 -- common/autotest_common.sh@940 -- # kill -0 3400629 00:03:53.180 12:31:26 -- common/autotest_common.sh@941 -- # uname 00:03:53.180 12:31:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:53.180 12:31:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3400629 00:03:53.438 12:31:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:53.438 12:31:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:53.438 12:31:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3400629' 00:03:53.438 killing process with pid 3400629 00:03:53.438 12:31:26 -- common/autotest_common.sh@955 -- # kill 3400629 00:03:53.438 12:31:26 -- common/autotest_common.sh@960 -- # wait 3400629 00:03:53.697 00:03:53.697 real 0m1.777s 00:03:53.697 user 0m1.945s 00:03:53.697 sys 0m0.480s 00:03:53.697 12:31:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:53.697 12:31:26 -- common/autotest_common.sh@10 -- # set +x 00:03:53.697 ************************************ 00:03:53.697 END TEST dpdk_mem_utility 00:03:53.697 ************************************ 00:03:53.697 12:31:26 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:03:53.697 12:31:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:53.697 12:31:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:53.697 12:31:26 -- common/autotest_common.sh@10 -- # set +x 00:03:53.697 ************************************ 00:03:53.697 START TEST event 00:03:53.697 ************************************ 00:03:53.697 12:31:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:03:53.956 * Looking for test storage... 00:03:53.956 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:03:53.956 12:31:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:53.956 12:31:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:53.956 12:31:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:53.956 12:31:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:53.956 12:31:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:53.956 12:31:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:53.956 12:31:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:53.956 12:31:26 -- scripts/common.sh@335 -- # IFS=.-: 00:03:53.956 12:31:26 -- scripts/common.sh@335 -- # read -ra ver1 00:03:53.956 12:31:26 -- scripts/common.sh@336 -- # IFS=.-: 00:03:53.956 12:31:26 -- scripts/common.sh@336 -- # read -ra ver2 00:03:53.956 12:31:26 -- scripts/common.sh@337 -- # local 'op=<' 00:03:53.956 12:31:26 -- scripts/common.sh@339 -- # ver1_l=2 00:03:53.956 12:31:26 -- scripts/common.sh@340 -- # ver2_l=1 00:03:53.956 12:31:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:53.956 12:31:26 -- scripts/common.sh@343 -- # case "$op" in 00:03:53.956 12:31:26 -- scripts/common.sh@344 -- # : 1 00:03:53.956 12:31:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:53.956 12:31:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:53.956 12:31:26 -- scripts/common.sh@364 -- # decimal 1 00:03:53.956 12:31:26 -- scripts/common.sh@352 -- # local d=1 00:03:53.956 12:31:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:53.956 12:31:26 -- scripts/common.sh@354 -- # echo 1 00:03:53.956 12:31:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:53.956 12:31:26 -- scripts/common.sh@365 -- # decimal 2 00:03:53.956 12:31:26 -- scripts/common.sh@352 -- # local d=2 00:03:53.956 12:31:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:53.956 12:31:26 -- scripts/common.sh@354 -- # echo 2 00:03:53.956 12:31:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:53.956 12:31:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:53.957 12:31:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:53.957 12:31:26 -- scripts/common.sh@367 -- # return 0 00:03:53.957 12:31:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:53.957 12:31:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:53.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:53.957 --rc genhtml_branch_coverage=1 00:03:53.957 --rc genhtml_function_coverage=1 00:03:53.957 --rc genhtml_legend=1 00:03:53.957 --rc geninfo_all_blocks=1 00:03:53.957 --rc geninfo_unexecuted_blocks=1 00:03:53.957 00:03:53.957 ' 00:03:53.957 12:31:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:53.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:53.957 --rc genhtml_branch_coverage=1 00:03:53.957 --rc genhtml_function_coverage=1 00:03:53.957 --rc genhtml_legend=1 00:03:53.957 --rc geninfo_all_blocks=1 00:03:53.957 --rc geninfo_unexecuted_blocks=1 00:03:53.957 00:03:53.957 ' 00:03:53.957 12:31:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:53.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:53.957 --rc genhtml_branch_coverage=1 00:03:53.957 --rc genhtml_function_coverage=1 00:03:53.957 --rc genhtml_legend=1 00:03:53.957 --rc geninfo_all_blocks=1 00:03:53.957 --rc geninfo_unexecuted_blocks=1 00:03:53.957 00:03:53.957 ' 00:03:53.957 12:31:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:53.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:53.957 --rc genhtml_branch_coverage=1 00:03:53.957 --rc genhtml_function_coverage=1 00:03:53.957 --rc genhtml_legend=1 00:03:53.957 --rc geninfo_all_blocks=1 00:03:53.957 --rc geninfo_unexecuted_blocks=1 00:03:53.957 00:03:53.957 ' 00:03:53.957 12:31:26 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:03:53.957 12:31:26 -- bdev/nbd_common.sh@6 -- # set -e 00:03:53.957 12:31:26 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:03:53.957 12:31:26 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:03:53.957 12:31:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:53.957 12:31:26 -- common/autotest_common.sh@10 -- # set +x 00:03:53.957 ************************************ 00:03:53.957 START TEST event_perf 00:03:53.957 ************************************ 00:03:53.957 12:31:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:03:53.957 Running I/O for 1 seconds...[2024-11-20 12:31:26.928195] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:53.957 [2024-11-20 12:31:26.928272] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3400961 ] 00:03:53.957 EAL: No free 2048 kB hugepages reported on node 1 00:03:53.957 [2024-11-20 12:31:26.990533] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:03:54.215 [2024-11-20 12:31:27.109159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:03:54.215 [2024-11-20 12:31:27.109217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:03:54.215 [2024-11-20 12:31:27.109338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:03:54.215 [2024-11-20 12:31:27.109341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:55.145 Running I/O for 1 seconds... 00:03:55.145 lcore 0: 225654 00:03:55.145 lcore 1: 225650 00:03:55.145 lcore 2: 225652 00:03:55.145 lcore 3: 225653 00:03:55.145 done. 00:03:55.145 00:03:55.145 real 0m1.320s 00:03:55.145 user 0m4.238s 00:03:55.145 sys 0m0.077s 00:03:55.146 12:31:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:55.146 12:31:28 -- common/autotest_common.sh@10 -- # set +x 00:03:55.146 ************************************ 00:03:55.146 END TEST event_perf 00:03:55.146 ************************************ 00:03:55.402 12:31:28 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:03:55.402 12:31:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:03:55.402 12:31:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:55.402 12:31:28 -- common/autotest_common.sh@10 -- # set +x 00:03:55.402 ************************************ 00:03:55.402 START TEST event_reactor 00:03:55.402 ************************************ 00:03:55.402 12:31:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:03:55.402 [2024-11-20 12:31:28.276916] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:55.402 [2024-11-20 12:31:28.277000] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3401120 ] 00:03:55.402 EAL: No free 2048 kB hugepages reported on node 1 00:03:55.402 [2024-11-20 12:31:28.340776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:55.402 [2024-11-20 12:31:28.456022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:56.768 test_start 00:03:56.768 oneshot 00:03:56.768 tick 100 00:03:56.768 tick 100 00:03:56.768 tick 250 00:03:56.768 tick 100 00:03:56.768 tick 100 00:03:56.768 tick 100 00:03:56.768 tick 250 00:03:56.768 tick 500 00:03:56.768 tick 100 00:03:56.768 tick 100 00:03:56.768 tick 250 00:03:56.768 tick 100 00:03:56.768 tick 100 00:03:56.768 test_end 00:03:56.768 00:03:56.768 real 0m1.318s 00:03:56.768 user 0m1.233s 00:03:56.768 sys 0m0.080s 00:03:56.768 12:31:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:56.768 12:31:29 -- common/autotest_common.sh@10 -- # set +x 00:03:56.768 ************************************ 00:03:56.768 END TEST event_reactor 00:03:56.768 ************************************ 00:03:56.768 12:31:29 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:03:56.768 12:31:29 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:03:56.768 12:31:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:56.768 12:31:29 -- common/autotest_common.sh@10 -- # set +x 00:03:56.768 ************************************ 00:03:56.768 START TEST event_reactor_perf 00:03:56.768 ************************************ 00:03:56.768 12:31:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:03:56.768 [2024-11-20 12:31:29.624845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:56.768 [2024-11-20 12:31:29.624925] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3401274 ] 00:03:56.768 EAL: No free 2048 kB hugepages reported on node 1 00:03:56.768 [2024-11-20 12:31:29.688194] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:56.768 [2024-11-20 12:31:29.810288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:58.139 test_start 00:03:58.139 test_end 00:03:58.139 Performance: 352008 events per second 00:03:58.139 00:03:58.139 real 0m1.321s 00:03:58.139 user 0m1.234s 00:03:58.139 sys 0m0.080s 00:03:58.139 12:31:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.139 12:31:30 -- common/autotest_common.sh@10 -- # set +x 00:03:58.139 ************************************ 00:03:58.139 END TEST event_reactor_perf 00:03:58.139 ************************************ 00:03:58.139 12:31:30 -- event/event.sh@49 -- # uname -s 00:03:58.139 12:31:30 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:03:58.139 12:31:30 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:03:58.139 12:31:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:58.139 12:31:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.139 12:31:30 -- common/autotest_common.sh@10 -- # set +x 00:03:58.139 ************************************ 00:03:58.139 START TEST event_scheduler 00:03:58.139 ************************************ 00:03:58.139 12:31:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:03:58.139 * Looking for test storage... 00:03:58.139 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:03:58.139 12:31:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:58.139 12:31:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:58.139 12:31:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:58.139 12:31:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:58.139 12:31:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:58.139 12:31:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:58.139 12:31:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:58.139 12:31:31 -- scripts/common.sh@335 -- # IFS=.-: 00:03:58.139 12:31:31 -- scripts/common.sh@335 -- # read -ra ver1 00:03:58.139 12:31:31 -- scripts/common.sh@336 -- # IFS=.-: 00:03:58.139 12:31:31 -- scripts/common.sh@336 -- # read -ra ver2 00:03:58.139 12:31:31 -- scripts/common.sh@337 -- # local 'op=<' 00:03:58.139 12:31:31 -- scripts/common.sh@339 -- # ver1_l=2 00:03:58.139 12:31:31 -- scripts/common.sh@340 -- # ver2_l=1 00:03:58.139 12:31:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:58.139 12:31:31 -- scripts/common.sh@343 -- # case "$op" in 00:03:58.139 12:31:31 -- scripts/common.sh@344 -- # : 1 00:03:58.139 12:31:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:58.139 12:31:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:58.139 12:31:31 -- scripts/common.sh@364 -- # decimal 1 00:03:58.139 12:31:31 -- scripts/common.sh@352 -- # local d=1 00:03:58.139 12:31:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:58.139 12:31:31 -- scripts/common.sh@354 -- # echo 1 00:03:58.139 12:31:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:58.139 12:31:31 -- scripts/common.sh@365 -- # decimal 2 00:03:58.139 12:31:31 -- scripts/common.sh@352 -- # local d=2 00:03:58.139 12:31:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:58.139 12:31:31 -- scripts/common.sh@354 -- # echo 2 00:03:58.139 12:31:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:58.139 12:31:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:58.139 12:31:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:58.139 12:31:31 -- scripts/common.sh@367 -- # return 0 00:03:58.139 12:31:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:58.139 12:31:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:58.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.139 --rc genhtml_branch_coverage=1 00:03:58.139 --rc genhtml_function_coverage=1 00:03:58.139 --rc genhtml_legend=1 00:03:58.139 --rc geninfo_all_blocks=1 00:03:58.139 --rc geninfo_unexecuted_blocks=1 00:03:58.139 00:03:58.139 ' 00:03:58.139 12:31:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:58.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.139 --rc genhtml_branch_coverage=1 00:03:58.139 --rc genhtml_function_coverage=1 00:03:58.139 --rc genhtml_legend=1 00:03:58.139 --rc geninfo_all_blocks=1 00:03:58.139 --rc geninfo_unexecuted_blocks=1 00:03:58.139 00:03:58.139 ' 00:03:58.139 12:31:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:58.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.139 --rc genhtml_branch_coverage=1 00:03:58.139 --rc genhtml_function_coverage=1 00:03:58.139 --rc genhtml_legend=1 00:03:58.139 --rc geninfo_all_blocks=1 00:03:58.139 --rc geninfo_unexecuted_blocks=1 00:03:58.139 00:03:58.139 ' 00:03:58.139 12:31:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:58.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.139 --rc genhtml_branch_coverage=1 00:03:58.139 --rc genhtml_function_coverage=1 00:03:58.139 --rc genhtml_legend=1 00:03:58.139 --rc geninfo_all_blocks=1 00:03:58.139 --rc geninfo_unexecuted_blocks=1 00:03:58.139 00:03:58.139 ' 00:03:58.139 12:31:31 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:03:58.140 12:31:31 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3401596 00:03:58.140 12:31:31 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:03:58.140 12:31:31 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:03:58.140 12:31:31 -- scheduler/scheduler.sh@37 -- # waitforlisten 3401596 00:03:58.140 12:31:31 -- common/autotest_common.sh@829 -- # '[' -z 3401596 ']' 00:03:58.140 12:31:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:58.140 12:31:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:58.140 12:31:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:58.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:58.140 12:31:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:58.140 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.140 [2024-11-20 12:31:31.135442] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:58.140 [2024-11-20 12:31:31.135533] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3401596 ] 00:03:58.140 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.140 [2024-11-20 12:31:31.191732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:03:58.398 [2024-11-20 12:31:31.295528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:58.398 [2024-11-20 12:31:31.295592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:03:58.398 [2024-11-20 12:31:31.295656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:03:58.398 [2024-11-20 12:31:31.295659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:03:58.398 12:31:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:58.398 12:31:31 -- common/autotest_common.sh@862 -- # return 0 00:03:58.398 12:31:31 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:03:58.398 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.398 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.398 POWER: Env isn't set yet! 00:03:58.398 POWER: Attempting to initialise ACPI cpufreq power management... 00:03:58.398 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:03:58.398 POWER: Cannot get available frequencies of lcore 0 00:03:58.398 POWER: Attempting to initialise PSTAT power management... 00:03:58.398 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:03:58.398 POWER: Initialized successfully for lcore 0 power management 00:03:58.398 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:03:58.398 POWER: Initialized successfully for lcore 1 power management 00:03:58.398 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:03:58.398 POWER: Initialized successfully for lcore 2 power management 00:03:58.398 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:03:58.398 POWER: Initialized successfully for lcore 3 power management 00:03:58.398 [2024-11-20 12:31:31.399271] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:03:58.398 [2024-11-20 12:31:31.399288] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:03:58.398 [2024-11-20 12:31:31.399299] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:03:58.398 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.398 12:31:31 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:03:58.398 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.398 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.398 [2024-11-20 12:31:31.503832] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:03:58.398 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.398 12:31:31 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:03:58.657 12:31:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:58.657 12:31:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 ************************************ 00:03:58.657 START TEST scheduler_create_thread 00:03:58.657 ************************************ 00:03:58.657 12:31:31 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 2 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 3 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 4 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 5 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 6 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 7 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 8 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 9 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 10 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:03:58.657 12:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:58.657 12:31:31 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:03:58.657 12:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:58.657 12:31:31 -- common/autotest_common.sh@10 -- # set +x 00:04:00.030 12:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:00.030 12:31:33 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:00.030 12:31:33 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:00.030 12:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:00.030 12:31:33 -- common/autotest_common.sh@10 -- # set +x 00:04:01.403 12:31:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:01.403 00:04:01.403 real 0m2.616s 00:04:01.403 user 0m0.009s 00:04:01.403 sys 0m0.005s 00:04:01.403 12:31:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.403 12:31:34 -- common/autotest_common.sh@10 -- # set +x 00:04:01.403 ************************************ 00:04:01.403 END TEST scheduler_create_thread 00:04:01.403 ************************************ 00:04:01.403 12:31:34 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:01.403 12:31:34 -- scheduler/scheduler.sh@46 -- # killprocess 3401596 00:04:01.403 12:31:34 -- common/autotest_common.sh@936 -- # '[' -z 3401596 ']' 00:04:01.403 12:31:34 -- common/autotest_common.sh@940 -- # kill -0 3401596 00:04:01.403 12:31:34 -- common/autotest_common.sh@941 -- # uname 00:04:01.403 12:31:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:01.403 12:31:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3401596 00:04:01.403 12:31:34 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:01.403 12:31:34 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:01.403 12:31:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3401596' 00:04:01.403 killing process with pid 3401596 00:04:01.403 12:31:34 -- common/autotest_common.sh@955 -- # kill 3401596 00:04:01.403 12:31:34 -- common/autotest_common.sh@960 -- # wait 3401596 00:04:01.661 [2024-11-20 12:31:34.606988] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:01.661 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:01.661 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:01.661 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:01.661 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:01.661 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:01.661 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:01.661 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:01.661 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:01.920 00:04:01.920 real 0m3.923s 00:04:01.920 user 0m5.902s 00:04:01.920 sys 0m0.328s 00:04:01.920 12:31:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.920 12:31:34 -- common/autotest_common.sh@10 -- # set +x 00:04:01.920 ************************************ 00:04:01.920 END TEST event_scheduler 00:04:01.920 ************************************ 00:04:01.920 12:31:34 -- event/event.sh@51 -- # modprobe -n nbd 00:04:01.920 12:31:34 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:01.920 12:31:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:01.920 12:31:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:01.920 12:31:34 -- common/autotest_common.sh@10 -- # set +x 00:04:01.920 ************************************ 00:04:01.920 START TEST app_repeat 00:04:01.920 ************************************ 00:04:01.920 12:31:34 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:01.920 12:31:34 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:01.920 12:31:34 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:01.920 12:31:34 -- event/event.sh@13 -- # local nbd_list 00:04:01.920 12:31:34 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:01.920 12:31:34 -- event/event.sh@14 -- # local bdev_list 00:04:01.920 12:31:34 -- event/event.sh@15 -- # local repeat_times=4 00:04:01.920 12:31:34 -- event/event.sh@17 -- # modprobe nbd 00:04:01.920 12:31:34 -- event/event.sh@19 -- # repeat_pid=3402059 00:04:01.920 12:31:34 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:01.920 12:31:34 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:01.920 12:31:34 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3402059' 00:04:01.920 Process app_repeat pid: 3402059 00:04:01.920 12:31:34 -- event/event.sh@23 -- # for i in {0..2} 00:04:01.920 12:31:34 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:01.920 spdk_app_start Round 0 00:04:01.920 12:31:34 -- event/event.sh@25 -- # waitforlisten 3402059 /var/tmp/spdk-nbd.sock 00:04:01.920 12:31:34 -- common/autotest_common.sh@829 -- # '[' -z 3402059 ']' 00:04:01.920 12:31:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:01.920 12:31:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:01.920 12:31:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:01.920 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:01.920 12:31:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:01.920 12:31:34 -- common/autotest_common.sh@10 -- # set +x 00:04:01.920 [2024-11-20 12:31:34.938045] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:01.920 [2024-11-20 12:31:34.938130] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3402059 ] 00:04:01.920 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.920 [2024-11-20 12:31:34.998673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:02.178 [2024-11-20 12:31:35.109308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:02.178 [2024-11-20 12:31:35.109312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.111 12:31:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:03.111 12:31:35 -- common/autotest_common.sh@862 -- # return 0 00:04:03.111 12:31:35 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:03.111 Malloc0 00:04:03.111 12:31:36 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:03.370 Malloc1 00:04:03.370 12:31:36 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@12 -- # local i 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:03.370 12:31:36 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:03.627 /dev/nbd0 00:04:03.886 12:31:36 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:03.886 12:31:36 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:03.886 12:31:36 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:03.886 12:31:36 -- common/autotest_common.sh@867 -- # local i 00:04:03.886 12:31:36 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:03.886 12:31:36 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:03.886 12:31:36 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:03.886 12:31:36 -- common/autotest_common.sh@871 -- # break 00:04:03.886 12:31:36 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:03.886 12:31:36 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:03.886 12:31:36 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:03.886 1+0 records in 00:04:03.886 1+0 records out 00:04:03.886 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000239098 s, 17.1 MB/s 00:04:03.886 12:31:36 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:03.886 12:31:36 -- common/autotest_common.sh@884 -- # size=4096 00:04:03.886 12:31:36 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:03.886 12:31:36 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:03.886 12:31:36 -- common/autotest_common.sh@887 -- # return 0 00:04:03.886 12:31:36 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:03.886 12:31:36 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:03.886 12:31:36 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:04.144 /dev/nbd1 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:04.144 12:31:37 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:04.144 12:31:37 -- common/autotest_common.sh@867 -- # local i 00:04:04.144 12:31:37 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:04.144 12:31:37 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:04.144 12:31:37 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:04.144 12:31:37 -- common/autotest_common.sh@871 -- # break 00:04:04.144 12:31:37 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:04.144 12:31:37 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:04.144 12:31:37 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:04.144 1+0 records in 00:04:04.144 1+0 records out 00:04:04.144 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000222109 s, 18.4 MB/s 00:04:04.144 12:31:37 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:04.144 12:31:37 -- common/autotest_common.sh@884 -- # size=4096 00:04:04.144 12:31:37 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:04.144 12:31:37 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:04.144 12:31:37 -- common/autotest_common.sh@887 -- # return 0 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:04.144 12:31:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:04.403 { 00:04:04.403 "nbd_device": "/dev/nbd0", 00:04:04.403 "bdev_name": "Malloc0" 00:04:04.403 }, 00:04:04.403 { 00:04:04.403 "nbd_device": "/dev/nbd1", 00:04:04.403 "bdev_name": "Malloc1" 00:04:04.403 } 00:04:04.403 ]' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:04.403 { 00:04:04.403 "nbd_device": "/dev/nbd0", 00:04:04.403 "bdev_name": "Malloc0" 00:04:04.403 }, 00:04:04.403 { 00:04:04.403 "nbd_device": "/dev/nbd1", 00:04:04.403 "bdev_name": "Malloc1" 00:04:04.403 } 00:04:04.403 ]' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:04.403 /dev/nbd1' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:04.403 /dev/nbd1' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@65 -- # count=2 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@95 -- # count=2 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:04.403 256+0 records in 00:04:04.403 256+0 records out 00:04:04.403 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00392419 s, 267 MB/s 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:04.403 256+0 records in 00:04:04.403 256+0 records out 00:04:04.403 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224194 s, 46.8 MB/s 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:04.403 256+0 records in 00:04:04.403 256+0 records out 00:04:04.403 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238628 s, 43.9 MB/s 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@51 -- # local i 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:04.403 12:31:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@41 -- # break 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@45 -- # return 0 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:04.661 12:31:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@41 -- # break 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@45 -- # return 0 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:04.919 12:31:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@65 -- # true 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@65 -- # count=0 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@104 -- # count=0 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:05.177 12:31:38 -- bdev/nbd_common.sh@109 -- # return 0 00:04:05.177 12:31:38 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:05.743 12:31:38 -- event/event.sh@35 -- # sleep 3 00:04:05.743 [2024-11-20 12:31:38.824182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:06.002 [2024-11-20 12:31:38.937796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:06.002 [2024-11-20 12:31:38.937796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:06.002 [2024-11-20 12:31:38.995511] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:06.002 [2024-11-20 12:31:38.995614] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:08.531 12:31:41 -- event/event.sh@23 -- # for i in {0..2} 00:04:08.531 12:31:41 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:08.531 spdk_app_start Round 1 00:04:08.531 12:31:41 -- event/event.sh@25 -- # waitforlisten 3402059 /var/tmp/spdk-nbd.sock 00:04:08.531 12:31:41 -- common/autotest_common.sh@829 -- # '[' -z 3402059 ']' 00:04:08.531 12:31:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:08.531 12:31:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:08.531 12:31:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:08.531 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:08.531 12:31:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:08.531 12:31:41 -- common/autotest_common.sh@10 -- # set +x 00:04:08.790 12:31:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:08.790 12:31:41 -- common/autotest_common.sh@862 -- # return 0 00:04:08.790 12:31:41 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:09.049 Malloc0 00:04:09.049 12:31:42 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:09.307 Malloc1 00:04:09.308 12:31:42 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@12 -- # local i 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:09.308 12:31:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:09.565 /dev/nbd0 00:04:09.565 12:31:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:09.565 12:31:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:09.565 12:31:42 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:09.565 12:31:42 -- common/autotest_common.sh@867 -- # local i 00:04:09.565 12:31:42 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:09.565 12:31:42 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:09.565 12:31:42 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:09.565 12:31:42 -- common/autotest_common.sh@871 -- # break 00:04:09.565 12:31:42 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:09.565 12:31:42 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:09.565 12:31:42 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:09.565 1+0 records in 00:04:09.565 1+0 records out 00:04:09.565 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00014905 s, 27.5 MB/s 00:04:09.565 12:31:42 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.565 12:31:42 -- common/autotest_common.sh@884 -- # size=4096 00:04:09.565 12:31:42 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.565 12:31:42 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:09.565 12:31:42 -- common/autotest_common.sh@887 -- # return 0 00:04:09.565 12:31:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:09.565 12:31:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:09.565 12:31:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:09.823 /dev/nbd1 00:04:09.823 12:31:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:09.823 12:31:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:09.823 12:31:42 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:09.823 12:31:42 -- common/autotest_common.sh@867 -- # local i 00:04:09.823 12:31:42 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:09.823 12:31:42 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:09.823 12:31:42 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:09.823 12:31:42 -- common/autotest_common.sh@871 -- # break 00:04:09.823 12:31:42 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:09.823 12:31:42 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:09.823 12:31:42 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:09.823 1+0 records in 00:04:09.823 1+0 records out 00:04:09.823 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000303403 s, 13.5 MB/s 00:04:09.823 12:31:42 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.823 12:31:42 -- common/autotest_common.sh@884 -- # size=4096 00:04:09.823 12:31:42 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.823 12:31:42 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:09.823 12:31:42 -- common/autotest_common.sh@887 -- # return 0 00:04:09.823 12:31:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:09.823 12:31:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:09.824 12:31:42 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:09.824 12:31:42 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.824 12:31:42 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:10.082 { 00:04:10.082 "nbd_device": "/dev/nbd0", 00:04:10.082 "bdev_name": "Malloc0" 00:04:10.082 }, 00:04:10.082 { 00:04:10.082 "nbd_device": "/dev/nbd1", 00:04:10.082 "bdev_name": "Malloc1" 00:04:10.082 } 00:04:10.082 ]' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:10.082 { 00:04:10.082 "nbd_device": "/dev/nbd0", 00:04:10.082 "bdev_name": "Malloc0" 00:04:10.082 }, 00:04:10.082 { 00:04:10.082 "nbd_device": "/dev/nbd1", 00:04:10.082 "bdev_name": "Malloc1" 00:04:10.082 } 00:04:10.082 ]' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:10.082 /dev/nbd1' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:10.082 /dev/nbd1' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@65 -- # count=2 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@95 -- # count=2 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:10.082 256+0 records in 00:04:10.082 256+0 records out 00:04:10.082 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00472506 s, 222 MB/s 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:10.082 12:31:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:10.341 256+0 records in 00:04:10.341 256+0 records out 00:04:10.341 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202383 s, 51.8 MB/s 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:10.341 256+0 records in 00:04:10.341 256+0 records out 00:04:10.341 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244554 s, 42.9 MB/s 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@51 -- # local i 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:10.341 12:31:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@41 -- # break 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@45 -- # return 0 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:10.599 12:31:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@41 -- # break 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@45 -- # return 0 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:10.857 12:31:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@65 -- # true 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@65 -- # count=0 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@104 -- # count=0 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:11.115 12:31:44 -- bdev/nbd_common.sh@109 -- # return 0 00:04:11.115 12:31:44 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:11.373 12:31:44 -- event/event.sh@35 -- # sleep 3 00:04:11.631 [2024-11-20 12:31:44.659389] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:11.889 [2024-11-20 12:31:44.771419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:11.889 [2024-11-20 12:31:44.771424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.889 [2024-11-20 12:31:44.832585] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:11.889 [2024-11-20 12:31:44.832666] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:14.426 12:31:47 -- event/event.sh@23 -- # for i in {0..2} 00:04:14.426 12:31:47 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:14.426 spdk_app_start Round 2 00:04:14.426 12:31:47 -- event/event.sh@25 -- # waitforlisten 3402059 /var/tmp/spdk-nbd.sock 00:04:14.426 12:31:47 -- common/autotest_common.sh@829 -- # '[' -z 3402059 ']' 00:04:14.426 12:31:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:14.426 12:31:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:14.427 12:31:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:14.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:14.427 12:31:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:14.427 12:31:47 -- common/autotest_common.sh@10 -- # set +x 00:04:14.688 12:31:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:14.688 12:31:47 -- common/autotest_common.sh@862 -- # return 0 00:04:14.688 12:31:47 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:14.946 Malloc0 00:04:14.946 12:31:47 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:15.205 Malloc1 00:04:15.205 12:31:48 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@12 -- # local i 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:15.205 12:31:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:15.462 /dev/nbd0 00:04:15.462 12:31:48 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:15.462 12:31:48 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:15.462 12:31:48 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:15.462 12:31:48 -- common/autotest_common.sh@867 -- # local i 00:04:15.462 12:31:48 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:15.463 12:31:48 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:15.463 12:31:48 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:15.463 12:31:48 -- common/autotest_common.sh@871 -- # break 00:04:15.463 12:31:48 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:15.463 12:31:48 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:15.463 12:31:48 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:15.463 1+0 records in 00:04:15.463 1+0 records out 00:04:15.463 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000196804 s, 20.8 MB/s 00:04:15.463 12:31:48 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:15.463 12:31:48 -- common/autotest_common.sh@884 -- # size=4096 00:04:15.463 12:31:48 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:15.463 12:31:48 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:15.463 12:31:48 -- common/autotest_common.sh@887 -- # return 0 00:04:15.463 12:31:48 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:15.463 12:31:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:15.463 12:31:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:15.721 /dev/nbd1 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:15.721 12:31:48 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:15.721 12:31:48 -- common/autotest_common.sh@867 -- # local i 00:04:15.721 12:31:48 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:15.721 12:31:48 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:15.721 12:31:48 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:15.721 12:31:48 -- common/autotest_common.sh@871 -- # break 00:04:15.721 12:31:48 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:15.721 12:31:48 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:15.721 12:31:48 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:15.721 1+0 records in 00:04:15.721 1+0 records out 00:04:15.721 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000176589 s, 23.2 MB/s 00:04:15.721 12:31:48 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:15.721 12:31:48 -- common/autotest_common.sh@884 -- # size=4096 00:04:15.721 12:31:48 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:15.721 12:31:48 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:15.721 12:31:48 -- common/autotest_common.sh@887 -- # return 0 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:15.721 12:31:48 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:15.979 12:31:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:15.979 { 00:04:15.979 "nbd_device": "/dev/nbd0", 00:04:15.979 "bdev_name": "Malloc0" 00:04:15.979 }, 00:04:15.979 { 00:04:15.979 "nbd_device": "/dev/nbd1", 00:04:15.979 "bdev_name": "Malloc1" 00:04:15.979 } 00:04:15.979 ]' 00:04:15.979 12:31:48 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:15.979 { 00:04:15.979 "nbd_device": "/dev/nbd0", 00:04:15.979 "bdev_name": "Malloc0" 00:04:15.979 }, 00:04:15.979 { 00:04:15.979 "nbd_device": "/dev/nbd1", 00:04:15.979 "bdev_name": "Malloc1" 00:04:15.979 } 00:04:15.979 ]' 00:04:15.979 12:31:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:15.979 /dev/nbd1' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:15.979 /dev/nbd1' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@65 -- # count=2 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@95 -- # count=2 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:15.979 256+0 records in 00:04:15.979 256+0 records out 00:04:15.979 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00504025 s, 208 MB/s 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:15.979 256+0 records in 00:04:15.979 256+0 records out 00:04:15.979 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225234 s, 46.6 MB/s 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:15.979 256+0 records in 00:04:15.979 256+0 records out 00:04:15.979 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243571 s, 43.1 MB/s 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:15.979 12:31:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:16.237 12:31:49 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:16.237 12:31:49 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:16.237 12:31:49 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:16.237 12:31:49 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:16.238 12:31:49 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:16.238 12:31:49 -- bdev/nbd_common.sh@51 -- # local i 00:04:16.238 12:31:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:16.238 12:31:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@41 -- # break 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@45 -- # return 0 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:16.495 12:31:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@41 -- # break 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@45 -- # return 0 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:16.754 12:31:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@65 -- # true 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@65 -- # count=0 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@104 -- # count=0 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:17.012 12:31:49 -- bdev/nbd_common.sh@109 -- # return 0 00:04:17.012 12:31:49 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:17.270 12:31:50 -- event/event.sh@35 -- # sleep 3 00:04:17.528 [2024-11-20 12:31:50.532579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:17.799 [2024-11-20 12:31:50.645449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:17.799 [2024-11-20 12:31:50.645455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:17.799 [2024-11-20 12:31:50.706892] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:17.799 [2024-11-20 12:31:50.706975] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:20.429 12:31:53 -- event/event.sh@38 -- # waitforlisten 3402059 /var/tmp/spdk-nbd.sock 00:04:20.429 12:31:53 -- common/autotest_common.sh@829 -- # '[' -z 3402059 ']' 00:04:20.429 12:31:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:20.429 12:31:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:20.429 12:31:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:20.429 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:20.429 12:31:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:20.429 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:04:20.429 12:31:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:20.429 12:31:53 -- common/autotest_common.sh@862 -- # return 0 00:04:20.429 12:31:53 -- event/event.sh@39 -- # killprocess 3402059 00:04:20.429 12:31:53 -- common/autotest_common.sh@936 -- # '[' -z 3402059 ']' 00:04:20.429 12:31:53 -- common/autotest_common.sh@940 -- # kill -0 3402059 00:04:20.429 12:31:53 -- common/autotest_common.sh@941 -- # uname 00:04:20.429 12:31:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:20.429 12:31:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3402059 00:04:20.688 12:31:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:20.688 12:31:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:20.688 12:31:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3402059' 00:04:20.688 killing process with pid 3402059 00:04:20.688 12:31:53 -- common/autotest_common.sh@955 -- # kill 3402059 00:04:20.688 12:31:53 -- common/autotest_common.sh@960 -- # wait 3402059 00:04:20.947 spdk_app_start is called in Round 0. 00:04:20.947 Shutdown signal received, stop current app iteration 00:04:20.947 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:20.947 spdk_app_start is called in Round 1. 00:04:20.947 Shutdown signal received, stop current app iteration 00:04:20.947 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:20.947 spdk_app_start is called in Round 2. 00:04:20.947 Shutdown signal received, stop current app iteration 00:04:20.947 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:20.947 spdk_app_start is called in Round 3. 00:04:20.947 Shutdown signal received, stop current app iteration 00:04:20.947 12:31:53 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:20.947 12:31:53 -- event/event.sh@42 -- # return 0 00:04:20.947 00:04:20.947 real 0m18.892s 00:04:20.947 user 0m41.190s 00:04:20.947 sys 0m3.148s 00:04:20.947 12:31:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:20.947 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:04:20.947 ************************************ 00:04:20.947 END TEST app_repeat 00:04:20.947 ************************************ 00:04:20.947 12:31:53 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:20.947 12:31:53 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:20.947 12:31:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.947 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:04:20.947 ************************************ 00:04:20.947 START TEST cpu_locks 00:04:20.947 ************************************ 00:04:20.947 12:31:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:20.947 * Looking for test storage... 00:04:20.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:20.947 12:31:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:20.947 12:31:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:20.947 12:31:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:20.947 12:31:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:20.947 12:31:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:20.947 12:31:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:20.947 12:31:53 -- scripts/common.sh@335 -- # IFS=.-: 00:04:20.947 12:31:53 -- scripts/common.sh@335 -- # read -ra ver1 00:04:20.947 12:31:53 -- scripts/common.sh@336 -- # IFS=.-: 00:04:20.947 12:31:53 -- scripts/common.sh@336 -- # read -ra ver2 00:04:20.947 12:31:53 -- scripts/common.sh@337 -- # local 'op=<' 00:04:20.947 12:31:53 -- scripts/common.sh@339 -- # ver1_l=2 00:04:20.947 12:31:53 -- scripts/common.sh@340 -- # ver2_l=1 00:04:20.947 12:31:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:20.947 12:31:53 -- scripts/common.sh@343 -- # case "$op" in 00:04:20.947 12:31:53 -- scripts/common.sh@344 -- # : 1 00:04:20.947 12:31:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:20.947 12:31:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:20.947 12:31:53 -- scripts/common.sh@364 -- # decimal 1 00:04:20.947 12:31:53 -- scripts/common.sh@352 -- # local d=1 00:04:20.947 12:31:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:20.947 12:31:53 -- scripts/common.sh@354 -- # echo 1 00:04:20.947 12:31:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:20.947 12:31:53 -- scripts/common.sh@365 -- # decimal 2 00:04:20.947 12:31:53 -- scripts/common.sh@352 -- # local d=2 00:04:20.947 12:31:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:20.947 12:31:53 -- scripts/common.sh@354 -- # echo 2 00:04:20.947 12:31:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:20.947 12:31:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:20.947 12:31:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:20.947 12:31:53 -- scripts/common.sh@367 -- # return 0 00:04:20.947 12:31:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:20.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.947 --rc genhtml_branch_coverage=1 00:04:20.947 --rc genhtml_function_coverage=1 00:04:20.947 --rc genhtml_legend=1 00:04:20.947 --rc geninfo_all_blocks=1 00:04:20.947 --rc geninfo_unexecuted_blocks=1 00:04:20.947 00:04:20.947 ' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:20.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.947 --rc genhtml_branch_coverage=1 00:04:20.947 --rc genhtml_function_coverage=1 00:04:20.947 --rc genhtml_legend=1 00:04:20.947 --rc geninfo_all_blocks=1 00:04:20.947 --rc geninfo_unexecuted_blocks=1 00:04:20.947 00:04:20.947 ' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:20.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.947 --rc genhtml_branch_coverage=1 00:04:20.947 --rc genhtml_function_coverage=1 00:04:20.947 --rc genhtml_legend=1 00:04:20.947 --rc geninfo_all_blocks=1 00:04:20.947 --rc geninfo_unexecuted_blocks=1 00:04:20.947 00:04:20.947 ' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:20.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.947 --rc genhtml_branch_coverage=1 00:04:20.947 --rc genhtml_function_coverage=1 00:04:20.947 --rc genhtml_legend=1 00:04:20.947 --rc geninfo_all_blocks=1 00:04:20.947 --rc geninfo_unexecuted_blocks=1 00:04:20.947 00:04:20.947 ' 00:04:20.947 12:31:53 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:20.947 12:31:53 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:20.947 12:31:53 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:20.947 12:31:53 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:20.947 12:31:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.947 12:31:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.947 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:04:20.947 ************************************ 00:04:20.947 START TEST default_locks 00:04:20.947 ************************************ 00:04:20.947 12:31:53 -- common/autotest_common.sh@1114 -- # default_locks 00:04:20.947 12:31:53 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3404612 00:04:20.947 12:31:53 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:20.947 12:31:53 -- event/cpu_locks.sh@47 -- # waitforlisten 3404612 00:04:20.947 12:31:53 -- common/autotest_common.sh@829 -- # '[' -z 3404612 ']' 00:04:20.947 12:31:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:20.947 12:31:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:20.947 12:31:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:20.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:20.947 12:31:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:20.947 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:04:20.947 [2024-11-20 12:31:54.022873] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:20.947 [2024-11-20 12:31:54.022967] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3404612 ] 00:04:20.947 EAL: No free 2048 kB hugepages reported on node 1 00:04:21.206 [2024-11-20 12:31:54.083381] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:21.206 [2024-11-20 12:31:54.195594] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:21.206 [2024-11-20 12:31:54.195783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:22.142 12:31:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:22.142 12:31:54 -- common/autotest_common.sh@862 -- # return 0 00:04:22.142 12:31:54 -- event/cpu_locks.sh@49 -- # locks_exist 3404612 00:04:22.142 12:31:54 -- event/cpu_locks.sh@22 -- # lslocks -p 3404612 00:04:22.142 12:31:54 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:22.400 lslocks: write error 00:04:22.400 12:31:55 -- event/cpu_locks.sh@50 -- # killprocess 3404612 00:04:22.400 12:31:55 -- common/autotest_common.sh@936 -- # '[' -z 3404612 ']' 00:04:22.400 12:31:55 -- common/autotest_common.sh@940 -- # kill -0 3404612 00:04:22.400 12:31:55 -- common/autotest_common.sh@941 -- # uname 00:04:22.400 12:31:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:22.400 12:31:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3404612 00:04:22.400 12:31:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:22.400 12:31:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:22.400 12:31:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3404612' 00:04:22.400 killing process with pid 3404612 00:04:22.400 12:31:55 -- common/autotest_common.sh@955 -- # kill 3404612 00:04:22.400 12:31:55 -- common/autotest_common.sh@960 -- # wait 3404612 00:04:22.659 12:31:55 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3404612 00:04:22.659 12:31:55 -- common/autotest_common.sh@650 -- # local es=0 00:04:22.659 12:31:55 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3404612 00:04:22.659 12:31:55 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:22.659 12:31:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:22.659 12:31:55 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:22.659 12:31:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:22.659 12:31:55 -- common/autotest_common.sh@653 -- # waitforlisten 3404612 00:04:22.659 12:31:55 -- common/autotest_common.sh@829 -- # '[' -z 3404612 ']' 00:04:22.659 12:31:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:22.659 12:31:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:22.659 12:31:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:22.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:22.659 12:31:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:22.659 12:31:55 -- common/autotest_common.sh@10 -- # set +x 00:04:22.659 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3404612) - No such process 00:04:22.659 ERROR: process (pid: 3404612) is no longer running 00:04:22.659 12:31:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:22.659 12:31:55 -- common/autotest_common.sh@862 -- # return 1 00:04:22.659 12:31:55 -- common/autotest_common.sh@653 -- # es=1 00:04:22.918 12:31:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:22.918 12:31:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:22.918 12:31:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:22.918 12:31:55 -- event/cpu_locks.sh@54 -- # no_locks 00:04:22.918 12:31:55 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:22.918 12:31:55 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:22.918 12:31:55 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:22.918 00:04:22.918 real 0m1.789s 00:04:22.918 user 0m1.914s 00:04:22.918 sys 0m0.565s 00:04:22.918 12:31:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.918 12:31:55 -- common/autotest_common.sh@10 -- # set +x 00:04:22.918 ************************************ 00:04:22.918 END TEST default_locks 00:04:22.918 ************************************ 00:04:22.918 12:31:55 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:22.918 12:31:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.918 12:31:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.918 12:31:55 -- common/autotest_common.sh@10 -- # set +x 00:04:22.918 ************************************ 00:04:22.918 START TEST default_locks_via_rpc 00:04:22.918 ************************************ 00:04:22.918 12:31:55 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:22.918 12:31:55 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3404909 00:04:22.919 12:31:55 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:22.919 12:31:55 -- event/cpu_locks.sh@63 -- # waitforlisten 3404909 00:04:22.919 12:31:55 -- common/autotest_common.sh@829 -- # '[' -z 3404909 ']' 00:04:22.919 12:31:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:22.919 12:31:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:22.919 12:31:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:22.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:22.919 12:31:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:22.919 12:31:55 -- common/autotest_common.sh@10 -- # set +x 00:04:22.919 [2024-11-20 12:31:55.841622] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:22.919 [2024-11-20 12:31:55.841714] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3404909 ] 00:04:22.919 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.919 [2024-11-20 12:31:55.898223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:22.919 [2024-11-20 12:31:56.006712] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:22.919 [2024-11-20 12:31:56.006878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.857 12:31:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:23.857 12:31:56 -- common/autotest_common.sh@862 -- # return 0 00:04:23.857 12:31:56 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:23.857 12:31:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:23.857 12:31:56 -- common/autotest_common.sh@10 -- # set +x 00:04:23.857 12:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:23.857 12:31:56 -- event/cpu_locks.sh@67 -- # no_locks 00:04:23.857 12:31:56 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:23.857 12:31:56 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:23.857 12:31:56 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:23.857 12:31:56 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:23.857 12:31:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:23.857 12:31:56 -- common/autotest_common.sh@10 -- # set +x 00:04:23.857 12:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:23.857 12:31:56 -- event/cpu_locks.sh@71 -- # locks_exist 3404909 00:04:23.857 12:31:56 -- event/cpu_locks.sh@22 -- # lslocks -p 3404909 00:04:23.857 12:31:56 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:24.116 12:31:57 -- event/cpu_locks.sh@73 -- # killprocess 3404909 00:04:24.116 12:31:57 -- common/autotest_common.sh@936 -- # '[' -z 3404909 ']' 00:04:24.116 12:31:57 -- common/autotest_common.sh@940 -- # kill -0 3404909 00:04:24.116 12:31:57 -- common/autotest_common.sh@941 -- # uname 00:04:24.116 12:31:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:24.116 12:31:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3404909 00:04:24.116 12:31:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:24.116 12:31:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:24.116 12:31:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3404909' 00:04:24.116 killing process with pid 3404909 00:04:24.116 12:31:57 -- common/autotest_common.sh@955 -- # kill 3404909 00:04:24.116 12:31:57 -- common/autotest_common.sh@960 -- # wait 3404909 00:04:24.684 00:04:24.684 real 0m1.788s 00:04:24.684 user 0m1.951s 00:04:24.684 sys 0m0.541s 00:04:24.684 12:31:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.684 12:31:57 -- common/autotest_common.sh@10 -- # set +x 00:04:24.684 ************************************ 00:04:24.684 END TEST default_locks_via_rpc 00:04:24.684 ************************************ 00:04:24.684 12:31:57 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:24.684 12:31:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.684 12:31:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.684 12:31:57 -- common/autotest_common.sh@10 -- # set +x 00:04:24.684 ************************************ 00:04:24.684 START TEST non_locking_app_on_locked_coremask 00:04:24.684 ************************************ 00:04:24.684 12:31:57 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:04:24.684 12:31:57 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3405084 00:04:24.684 12:31:57 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:24.684 12:31:57 -- event/cpu_locks.sh@81 -- # waitforlisten 3405084 /var/tmp/spdk.sock 00:04:24.684 12:31:57 -- common/autotest_common.sh@829 -- # '[' -z 3405084 ']' 00:04:24.684 12:31:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.684 12:31:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:24.684 12:31:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.684 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.684 12:31:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:24.684 12:31:57 -- common/autotest_common.sh@10 -- # set +x 00:04:24.684 [2024-11-20 12:31:57.658879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:24.684 [2024-11-20 12:31:57.658970] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405084 ] 00:04:24.684 EAL: No free 2048 kB hugepages reported on node 1 00:04:24.684 [2024-11-20 12:31:57.717275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:24.943 [2024-11-20 12:31:57.826607] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:24.943 [2024-11-20 12:31:57.826775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.514 12:31:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:25.514 12:31:58 -- common/autotest_common.sh@862 -- # return 0 00:04:25.514 12:31:58 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3405226 00:04:25.514 12:31:58 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:25.514 12:31:58 -- event/cpu_locks.sh@85 -- # waitforlisten 3405226 /var/tmp/spdk2.sock 00:04:25.514 12:31:58 -- common/autotest_common.sh@829 -- # '[' -z 3405226 ']' 00:04:25.514 12:31:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:25.514 12:31:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:25.514 12:31:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:25.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:25.773 12:31:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:25.773 12:31:58 -- common/autotest_common.sh@10 -- # set +x 00:04:25.773 [2024-11-20 12:31:58.666122] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:25.773 [2024-11-20 12:31:58.666195] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405226 ] 00:04:25.773 EAL: No free 2048 kB hugepages reported on node 1 00:04:25.773 [2024-11-20 12:31:58.754873] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:25.773 [2024-11-20 12:31:58.754905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.031 [2024-11-20 12:31:58.986459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.031 [2024-11-20 12:31:58.986608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:26.604 12:31:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:26.604 12:31:59 -- common/autotest_common.sh@862 -- # return 0 00:04:26.604 12:31:59 -- event/cpu_locks.sh@87 -- # locks_exist 3405084 00:04:26.604 12:31:59 -- event/cpu_locks.sh@22 -- # lslocks -p 3405084 00:04:26.604 12:31:59 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:27.172 lslocks: write error 00:04:27.172 12:32:00 -- event/cpu_locks.sh@89 -- # killprocess 3405084 00:04:27.172 12:32:00 -- common/autotest_common.sh@936 -- # '[' -z 3405084 ']' 00:04:27.172 12:32:00 -- common/autotest_common.sh@940 -- # kill -0 3405084 00:04:27.172 12:32:00 -- common/autotest_common.sh@941 -- # uname 00:04:27.172 12:32:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:27.172 12:32:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405084 00:04:27.172 12:32:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:27.172 12:32:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:27.172 12:32:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405084' 00:04:27.172 killing process with pid 3405084 00:04:27.172 12:32:00 -- common/autotest_common.sh@955 -- # kill 3405084 00:04:27.172 12:32:00 -- common/autotest_common.sh@960 -- # wait 3405084 00:04:28.110 12:32:00 -- event/cpu_locks.sh@90 -- # killprocess 3405226 00:04:28.110 12:32:00 -- common/autotest_common.sh@936 -- # '[' -z 3405226 ']' 00:04:28.110 12:32:00 -- common/autotest_common.sh@940 -- # kill -0 3405226 00:04:28.110 12:32:00 -- common/autotest_common.sh@941 -- # uname 00:04:28.110 12:32:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:28.111 12:32:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405226 00:04:28.111 12:32:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:28.111 12:32:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:28.111 12:32:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405226' 00:04:28.111 killing process with pid 3405226 00:04:28.111 12:32:01 -- common/autotest_common.sh@955 -- # kill 3405226 00:04:28.111 12:32:01 -- common/autotest_common.sh@960 -- # wait 3405226 00:04:28.368 00:04:28.368 real 0m3.846s 00:04:28.368 user 0m4.190s 00:04:28.368 sys 0m1.119s 00:04:28.368 12:32:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.368 12:32:01 -- common/autotest_common.sh@10 -- # set +x 00:04:28.368 ************************************ 00:04:28.368 END TEST non_locking_app_on_locked_coremask 00:04:28.368 ************************************ 00:04:28.627 12:32:01 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:28.628 12:32:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.628 12:32:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.628 12:32:01 -- common/autotest_common.sh@10 -- # set +x 00:04:28.628 ************************************ 00:04:28.628 START TEST locking_app_on_unlocked_coremask 00:04:28.628 ************************************ 00:04:28.628 12:32:01 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:04:28.628 12:32:01 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3405662 00:04:28.628 12:32:01 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:28.628 12:32:01 -- event/cpu_locks.sh@99 -- # waitforlisten 3405662 /var/tmp/spdk.sock 00:04:28.628 12:32:01 -- common/autotest_common.sh@829 -- # '[' -z 3405662 ']' 00:04:28.628 12:32:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:28.628 12:32:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:28.628 12:32:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:28.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:28.628 12:32:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:28.628 12:32:01 -- common/autotest_common.sh@10 -- # set +x 00:04:28.628 [2024-11-20 12:32:01.531047] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:28.628 [2024-11-20 12:32:01.531161] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405662 ] 00:04:28.628 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.628 [2024-11-20 12:32:01.587740] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:28.628 [2024-11-20 12:32:01.587778] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.628 [2024-11-20 12:32:01.696047] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.628 [2024-11-20 12:32:01.696235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.566 12:32:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.566 12:32:02 -- common/autotest_common.sh@862 -- # return 0 00:04:29.566 12:32:02 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3405802 00:04:29.566 12:32:02 -- event/cpu_locks.sh@103 -- # waitforlisten 3405802 /var/tmp/spdk2.sock 00:04:29.566 12:32:02 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:29.566 12:32:02 -- common/autotest_common.sh@829 -- # '[' -z 3405802 ']' 00:04:29.566 12:32:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:29.566 12:32:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:29.566 12:32:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:29.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:29.566 12:32:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:29.566 12:32:02 -- common/autotest_common.sh@10 -- # set +x 00:04:29.566 [2024-11-20 12:32:02.536536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:29.566 [2024-11-20 12:32:02.536630] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405802 ] 00:04:29.566 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.566 [2024-11-20 12:32:02.630183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.837 [2024-11-20 12:32:02.864893] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:29.837 [2024-11-20 12:32:02.865118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.404 12:32:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:30.404 12:32:03 -- common/autotest_common.sh@862 -- # return 0 00:04:30.404 12:32:03 -- event/cpu_locks.sh@105 -- # locks_exist 3405802 00:04:30.404 12:32:03 -- event/cpu_locks.sh@22 -- # lslocks -p 3405802 00:04:30.404 12:32:03 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:30.970 lslocks: write error 00:04:30.970 12:32:03 -- event/cpu_locks.sh@107 -- # killprocess 3405662 00:04:30.970 12:32:03 -- common/autotest_common.sh@936 -- # '[' -z 3405662 ']' 00:04:30.970 12:32:03 -- common/autotest_common.sh@940 -- # kill -0 3405662 00:04:30.970 12:32:03 -- common/autotest_common.sh@941 -- # uname 00:04:30.970 12:32:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:30.970 12:32:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405662 00:04:30.970 12:32:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:30.970 12:32:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:30.970 12:32:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405662' 00:04:30.970 killing process with pid 3405662 00:04:30.970 12:32:03 -- common/autotest_common.sh@955 -- # kill 3405662 00:04:30.970 12:32:03 -- common/autotest_common.sh@960 -- # wait 3405662 00:04:31.911 12:32:04 -- event/cpu_locks.sh@108 -- # killprocess 3405802 00:04:31.911 12:32:04 -- common/autotest_common.sh@936 -- # '[' -z 3405802 ']' 00:04:31.911 12:32:04 -- common/autotest_common.sh@940 -- # kill -0 3405802 00:04:31.911 12:32:04 -- common/autotest_common.sh@941 -- # uname 00:04:31.911 12:32:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:31.911 12:32:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405802 00:04:31.911 12:32:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.911 12:32:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.911 12:32:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405802' 00:04:31.911 killing process with pid 3405802 00:04:31.911 12:32:04 -- common/autotest_common.sh@955 -- # kill 3405802 00:04:31.911 12:32:04 -- common/autotest_common.sh@960 -- # wait 3405802 00:04:32.479 00:04:32.479 real 0m3.804s 00:04:32.479 user 0m4.176s 00:04:32.479 sys 0m1.045s 00:04:32.479 12:32:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:32.479 12:32:05 -- common/autotest_common.sh@10 -- # set +x 00:04:32.479 ************************************ 00:04:32.479 END TEST locking_app_on_unlocked_coremask 00:04:32.479 ************************************ 00:04:32.479 12:32:05 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:04:32.479 12:32:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.479 12:32:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.479 12:32:05 -- common/autotest_common.sh@10 -- # set +x 00:04:32.479 ************************************ 00:04:32.479 START TEST locking_app_on_locked_coremask 00:04:32.479 ************************************ 00:04:32.479 12:32:05 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:04:32.479 12:32:05 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3406118 00:04:32.479 12:32:05 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:32.479 12:32:05 -- event/cpu_locks.sh@116 -- # waitforlisten 3406118 /var/tmp/spdk.sock 00:04:32.479 12:32:05 -- common/autotest_common.sh@829 -- # '[' -z 3406118 ']' 00:04:32.479 12:32:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.479 12:32:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.479 12:32:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.479 12:32:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.479 12:32:05 -- common/autotest_common.sh@10 -- # set +x 00:04:32.479 [2024-11-20 12:32:05.365242] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.479 [2024-11-20 12:32:05.365329] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3406118 ] 00:04:32.479 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.479 [2024-11-20 12:32:05.422705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:32.479 [2024-11-20 12:32:05.532097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:32.479 [2024-11-20 12:32:05.532250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.418 12:32:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.418 12:32:06 -- common/autotest_common.sh@862 -- # return 0 00:04:33.418 12:32:06 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3406254 00:04:33.418 12:32:06 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:33.418 12:32:06 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3406254 /var/tmp/spdk2.sock 00:04:33.418 12:32:06 -- common/autotest_common.sh@650 -- # local es=0 00:04:33.418 12:32:06 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3406254 /var/tmp/spdk2.sock 00:04:33.418 12:32:06 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:33.418 12:32:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:33.418 12:32:06 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:33.418 12:32:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:33.418 12:32:06 -- common/autotest_common.sh@653 -- # waitforlisten 3406254 /var/tmp/spdk2.sock 00:04:33.418 12:32:06 -- common/autotest_common.sh@829 -- # '[' -z 3406254 ']' 00:04:33.418 12:32:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:33.418 12:32:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.418 12:32:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:33.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:33.418 12:32:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.418 12:32:06 -- common/autotest_common.sh@10 -- # set +x 00:04:33.418 [2024-11-20 12:32:06.372498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.418 [2024-11-20 12:32:06.372573] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3406254 ] 00:04:33.418 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.418 [2024-11-20 12:32:06.462286] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3406118 has claimed it. 00:04:33.418 [2024-11-20 12:32:06.462349] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:33.985 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3406254) - No such process 00:04:33.985 ERROR: process (pid: 3406254) is no longer running 00:04:33.985 12:32:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.985 12:32:07 -- common/autotest_common.sh@862 -- # return 1 00:04:33.985 12:32:07 -- common/autotest_common.sh@653 -- # es=1 00:04:33.985 12:32:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:33.985 12:32:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:33.985 12:32:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:33.985 12:32:07 -- event/cpu_locks.sh@122 -- # locks_exist 3406118 00:04:33.985 12:32:07 -- event/cpu_locks.sh@22 -- # lslocks -p 3406118 00:04:33.985 12:32:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:34.554 lslocks: write error 00:04:34.554 12:32:07 -- event/cpu_locks.sh@124 -- # killprocess 3406118 00:04:34.554 12:32:07 -- common/autotest_common.sh@936 -- # '[' -z 3406118 ']' 00:04:34.554 12:32:07 -- common/autotest_common.sh@940 -- # kill -0 3406118 00:04:34.554 12:32:07 -- common/autotest_common.sh@941 -- # uname 00:04:34.554 12:32:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:34.554 12:32:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3406118 00:04:34.554 12:32:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:34.554 12:32:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:34.554 12:32:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3406118' 00:04:34.554 killing process with pid 3406118 00:04:34.554 12:32:07 -- common/autotest_common.sh@955 -- # kill 3406118 00:04:34.554 12:32:07 -- common/autotest_common.sh@960 -- # wait 3406118 00:04:34.815 00:04:34.815 real 0m2.603s 00:04:34.815 user 0m2.987s 00:04:34.815 sys 0m0.683s 00:04:34.815 12:32:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.815 12:32:07 -- common/autotest_common.sh@10 -- # set +x 00:04:34.815 ************************************ 00:04:34.815 END TEST locking_app_on_locked_coremask 00:04:34.815 ************************************ 00:04:35.073 12:32:07 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:04:35.073 12:32:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.073 12:32:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.073 12:32:07 -- common/autotest_common.sh@10 -- # set +x 00:04:35.073 ************************************ 00:04:35.073 START TEST locking_overlapped_coremask 00:04:35.073 ************************************ 00:04:35.073 12:32:07 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:04:35.073 12:32:07 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3406548 00:04:35.073 12:32:07 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:04:35.073 12:32:07 -- event/cpu_locks.sh@133 -- # waitforlisten 3406548 /var/tmp/spdk.sock 00:04:35.073 12:32:07 -- common/autotest_common.sh@829 -- # '[' -z 3406548 ']' 00:04:35.073 12:32:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.073 12:32:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:35.073 12:32:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.073 12:32:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:35.073 12:32:07 -- common/autotest_common.sh@10 -- # set +x 00:04:35.073 [2024-11-20 12:32:07.994517] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:35.073 [2024-11-20 12:32:07.994621] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3406548 ] 00:04:35.073 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.073 [2024-11-20 12:32:08.056945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:35.073 [2024-11-20 12:32:08.170498] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.073 [2024-11-20 12:32:08.170744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:35.073 [2024-11-20 12:32:08.170814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:35.073 [2024-11-20 12:32:08.170817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.011 12:32:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.011 12:32:08 -- common/autotest_common.sh@862 -- # return 0 00:04:36.011 12:32:08 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3406613 00:04:36.011 12:32:08 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:04:36.011 12:32:08 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3406613 /var/tmp/spdk2.sock 00:04:36.011 12:32:08 -- common/autotest_common.sh@650 -- # local es=0 00:04:36.011 12:32:08 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3406613 /var/tmp/spdk2.sock 00:04:36.011 12:32:08 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:36.011 12:32:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:36.011 12:32:08 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:36.011 12:32:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:36.011 12:32:08 -- common/autotest_common.sh@653 -- # waitforlisten 3406613 /var/tmp/spdk2.sock 00:04:36.011 12:32:08 -- common/autotest_common.sh@829 -- # '[' -z 3406613 ']' 00:04:36.011 12:32:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:36.011 12:32:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:36.011 12:32:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:36.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:36.011 12:32:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:36.011 12:32:08 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 [2024-11-20 12:32:08.994513] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.011 [2024-11-20 12:32:08.994622] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3406613 ] 00:04:36.011 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.011 [2024-11-20 12:32:09.085297] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3406548 has claimed it. 00:04:36.011 [2024-11-20 12:32:09.085360] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:36.952 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3406613) - No such process 00:04:36.952 ERROR: process (pid: 3406613) is no longer running 00:04:36.952 12:32:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.952 12:32:09 -- common/autotest_common.sh@862 -- # return 1 00:04:36.952 12:32:09 -- common/autotest_common.sh@653 -- # es=1 00:04:36.952 12:32:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:36.952 12:32:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:36.952 12:32:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:36.952 12:32:09 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:04:36.952 12:32:09 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:36.952 12:32:09 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:36.952 12:32:09 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:36.952 12:32:09 -- event/cpu_locks.sh@141 -- # killprocess 3406548 00:04:36.952 12:32:09 -- common/autotest_common.sh@936 -- # '[' -z 3406548 ']' 00:04:36.952 12:32:09 -- common/autotest_common.sh@940 -- # kill -0 3406548 00:04:36.952 12:32:09 -- common/autotest_common.sh@941 -- # uname 00:04:36.952 12:32:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:36.952 12:32:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3406548 00:04:36.952 12:32:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:36.952 12:32:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:36.952 12:32:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3406548' 00:04:36.952 killing process with pid 3406548 00:04:36.952 12:32:09 -- common/autotest_common.sh@955 -- # kill 3406548 00:04:36.952 12:32:09 -- common/autotest_common.sh@960 -- # wait 3406548 00:04:37.212 00:04:37.212 real 0m2.242s 00:04:37.212 user 0m6.312s 00:04:37.212 sys 0m0.505s 00:04:37.212 12:32:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.212 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:04:37.212 ************************************ 00:04:37.212 END TEST locking_overlapped_coremask 00:04:37.212 ************************************ 00:04:37.212 12:32:10 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:04:37.212 12:32:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.212 12:32:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.212 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:04:37.212 ************************************ 00:04:37.212 START TEST locking_overlapped_coremask_via_rpc 00:04:37.212 ************************************ 00:04:37.212 12:32:10 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:04:37.212 12:32:10 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3406856 00:04:37.212 12:32:10 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:04:37.212 12:32:10 -- event/cpu_locks.sh@149 -- # waitforlisten 3406856 /var/tmp/spdk.sock 00:04:37.212 12:32:10 -- common/autotest_common.sh@829 -- # '[' -z 3406856 ']' 00:04:37.212 12:32:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.212 12:32:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.212 12:32:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.212 12:32:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.212 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:04:37.212 [2024-11-20 12:32:10.259786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.212 [2024-11-20 12:32:10.259874] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3406856 ] 00:04:37.212 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.473 [2024-11-20 12:32:10.321443] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:37.473 [2024-11-20 12:32:10.321490] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:37.473 [2024-11-20 12:32:10.441224] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:37.473 [2024-11-20 12:32:10.441446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:37.473 [2024-11-20 12:32:10.441473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:37.473 [2024-11-20 12:32:10.441477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.412 12:32:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.412 12:32:11 -- common/autotest_common.sh@862 -- # return 0 00:04:38.412 12:32:11 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3406994 00:04:38.412 12:32:11 -- event/cpu_locks.sh@153 -- # waitforlisten 3406994 /var/tmp/spdk2.sock 00:04:38.412 12:32:11 -- common/autotest_common.sh@829 -- # '[' -z 3406994 ']' 00:04:38.412 12:32:11 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:04:38.412 12:32:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:38.412 12:32:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.412 12:32:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:38.412 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:38.412 12:32:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.412 12:32:11 -- common/autotest_common.sh@10 -- # set +x 00:04:38.412 [2024-11-20 12:32:11.305969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.412 [2024-11-20 12:32:11.306057] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3406994 ] 00:04:38.412 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.412 [2024-11-20 12:32:11.393191] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:38.412 [2024-11-20 12:32:11.393227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:38.671 [2024-11-20 12:32:11.610742] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.671 [2024-11-20 12:32:11.610978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:38.671 [2024-11-20 12:32:11.614132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:04:38.671 [2024-11-20 12:32:11.614135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:39.237 12:32:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.237 12:32:12 -- common/autotest_common.sh@862 -- # return 0 00:04:39.237 12:32:12 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:04:39.237 12:32:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:39.237 12:32:12 -- common/autotest_common.sh@10 -- # set +x 00:04:39.237 12:32:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:39.237 12:32:12 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:39.237 12:32:12 -- common/autotest_common.sh@650 -- # local es=0 00:04:39.237 12:32:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:39.237 12:32:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:04:39.237 12:32:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:39.237 12:32:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:04:39.237 12:32:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:39.237 12:32:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:39.237 12:32:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:39.237 12:32:12 -- common/autotest_common.sh@10 -- # set +x 00:04:39.237 [2024-11-20 12:32:12.281163] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3406856 has claimed it. 00:04:39.237 request: 00:04:39.237 { 00:04:39.237 "method": "framework_enable_cpumask_locks", 00:04:39.237 "req_id": 1 00:04:39.237 } 00:04:39.237 Got JSON-RPC error response 00:04:39.237 response: 00:04:39.237 { 00:04:39.237 "code": -32603, 00:04:39.237 "message": "Failed to claim CPU core: 2" 00:04:39.237 } 00:04:39.237 12:32:12 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:39.237 12:32:12 -- common/autotest_common.sh@653 -- # es=1 00:04:39.237 12:32:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:39.237 12:32:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:39.237 12:32:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:39.237 12:32:12 -- event/cpu_locks.sh@158 -- # waitforlisten 3406856 /var/tmp/spdk.sock 00:04:39.237 12:32:12 -- common/autotest_common.sh@829 -- # '[' -z 3406856 ']' 00:04:39.237 12:32:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:39.237 12:32:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.237 12:32:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:39.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:39.237 12:32:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.237 12:32:12 -- common/autotest_common.sh@10 -- # set +x 00:04:39.495 12:32:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.495 12:32:12 -- common/autotest_common.sh@862 -- # return 0 00:04:39.495 12:32:12 -- event/cpu_locks.sh@159 -- # waitforlisten 3406994 /var/tmp/spdk2.sock 00:04:39.495 12:32:12 -- common/autotest_common.sh@829 -- # '[' -z 3406994 ']' 00:04:39.495 12:32:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:39.495 12:32:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.495 12:32:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:39.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:39.495 12:32:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.495 12:32:12 -- common/autotest_common.sh@10 -- # set +x 00:04:39.754 12:32:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.754 12:32:12 -- common/autotest_common.sh@862 -- # return 0 00:04:39.754 12:32:12 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:04:39.754 12:32:12 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:39.754 12:32:12 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:39.754 12:32:12 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:39.754 00:04:39.754 real 0m2.577s 00:04:39.754 user 0m1.287s 00:04:39.754 sys 0m0.215s 00:04:39.754 12:32:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.754 12:32:12 -- common/autotest_common.sh@10 -- # set +x 00:04:39.754 ************************************ 00:04:39.754 END TEST locking_overlapped_coremask_via_rpc 00:04:39.754 ************************************ 00:04:39.754 12:32:12 -- event/cpu_locks.sh@174 -- # cleanup 00:04:39.754 12:32:12 -- event/cpu_locks.sh@15 -- # [[ -z 3406856 ]] 00:04:39.754 12:32:12 -- event/cpu_locks.sh@15 -- # killprocess 3406856 00:04:39.754 12:32:12 -- common/autotest_common.sh@936 -- # '[' -z 3406856 ']' 00:04:39.754 12:32:12 -- common/autotest_common.sh@940 -- # kill -0 3406856 00:04:39.754 12:32:12 -- common/autotest_common.sh@941 -- # uname 00:04:39.754 12:32:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:39.754 12:32:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3406856 00:04:39.754 12:32:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:39.754 12:32:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:39.754 12:32:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3406856' 00:04:39.754 killing process with pid 3406856 00:04:39.754 12:32:12 -- common/autotest_common.sh@955 -- # kill 3406856 00:04:39.754 12:32:12 -- common/autotest_common.sh@960 -- # wait 3406856 00:04:40.323 12:32:13 -- event/cpu_locks.sh@16 -- # [[ -z 3406994 ]] 00:04:40.323 12:32:13 -- event/cpu_locks.sh@16 -- # killprocess 3406994 00:04:40.323 12:32:13 -- common/autotest_common.sh@936 -- # '[' -z 3406994 ']' 00:04:40.323 12:32:13 -- common/autotest_common.sh@940 -- # kill -0 3406994 00:04:40.323 12:32:13 -- common/autotest_common.sh@941 -- # uname 00:04:40.323 12:32:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.323 12:32:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3406994 00:04:40.323 12:32:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:40.323 12:32:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:40.323 12:32:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3406994' 00:04:40.323 killing process with pid 3406994 00:04:40.323 12:32:13 -- common/autotest_common.sh@955 -- # kill 3406994 00:04:40.323 12:32:13 -- common/autotest_common.sh@960 -- # wait 3406994 00:04:40.890 12:32:13 -- event/cpu_locks.sh@18 -- # rm -f 00:04:40.890 12:32:13 -- event/cpu_locks.sh@1 -- # cleanup 00:04:40.890 12:32:13 -- event/cpu_locks.sh@15 -- # [[ -z 3406856 ]] 00:04:40.890 12:32:13 -- event/cpu_locks.sh@15 -- # killprocess 3406856 00:04:40.890 12:32:13 -- common/autotest_common.sh@936 -- # '[' -z 3406856 ']' 00:04:40.890 12:32:13 -- common/autotest_common.sh@940 -- # kill -0 3406856 00:04:40.890 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3406856) - No such process 00:04:40.890 12:32:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3406856 is not found' 00:04:40.890 Process with pid 3406856 is not found 00:04:40.890 12:32:13 -- event/cpu_locks.sh@16 -- # [[ -z 3406994 ]] 00:04:40.890 12:32:13 -- event/cpu_locks.sh@16 -- # killprocess 3406994 00:04:40.890 12:32:13 -- common/autotest_common.sh@936 -- # '[' -z 3406994 ']' 00:04:40.890 12:32:13 -- common/autotest_common.sh@940 -- # kill -0 3406994 00:04:40.890 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3406994) - No such process 00:04:40.890 12:32:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3406994 is not found' 00:04:40.890 Process with pid 3406994 is not found 00:04:40.890 12:32:13 -- event/cpu_locks.sh@18 -- # rm -f 00:04:40.890 00:04:40.890 real 0m19.957s 00:04:40.890 user 0m35.685s 00:04:40.890 sys 0m5.559s 00:04:40.890 12:32:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.890 12:32:13 -- common/autotest_common.sh@10 -- # set +x 00:04:40.890 ************************************ 00:04:40.890 END TEST cpu_locks 00:04:40.890 ************************************ 00:04:40.890 00:04:40.890 real 0m47.043s 00:04:40.890 user 1m29.648s 00:04:40.890 sys 0m9.452s 00:04:40.890 12:32:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.890 12:32:13 -- common/autotest_common.sh@10 -- # set +x 00:04:40.890 ************************************ 00:04:40.890 END TEST event 00:04:40.890 ************************************ 00:04:40.891 12:32:13 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:40.891 12:32:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.891 12:32:13 -- common/autotest_common.sh@10 -- # set +x 00:04:40.891 ************************************ 00:04:40.891 START TEST thread 00:04:40.891 ************************************ 00:04:40.891 12:32:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:40.891 * Looking for test storage... 00:04:40.891 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:04:40.891 12:32:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.891 12:32:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.891 12:32:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.891 12:32:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.891 12:32:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.891 12:32:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.891 12:32:13 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.891 12:32:13 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.891 12:32:13 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.891 12:32:13 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.891 12:32:13 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.891 12:32:13 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.891 12:32:13 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.891 12:32:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.891 12:32:13 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.891 12:32:13 -- scripts/common.sh@344 -- # : 1 00:04:40.891 12:32:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.891 12:32:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.891 12:32:13 -- scripts/common.sh@364 -- # decimal 1 00:04:40.891 12:32:13 -- scripts/common.sh@352 -- # local d=1 00:04:40.891 12:32:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.891 12:32:13 -- scripts/common.sh@354 -- # echo 1 00:04:40.891 12:32:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.891 12:32:13 -- scripts/common.sh@365 -- # decimal 2 00:04:40.891 12:32:13 -- scripts/common.sh@352 -- # local d=2 00:04:40.891 12:32:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.891 12:32:13 -- scripts/common.sh@354 -- # echo 2 00:04:40.891 12:32:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.891 12:32:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.891 12:32:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.891 12:32:13 -- scripts/common.sh@367 -- # return 0 00:04:40.891 12:32:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.891 --rc genhtml_branch_coverage=1 00:04:40.891 --rc genhtml_function_coverage=1 00:04:40.891 --rc genhtml_legend=1 00:04:40.891 --rc geninfo_all_blocks=1 00:04:40.891 --rc geninfo_unexecuted_blocks=1 00:04:40.891 00:04:40.891 ' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.891 --rc genhtml_branch_coverage=1 00:04:40.891 --rc genhtml_function_coverage=1 00:04:40.891 --rc genhtml_legend=1 00:04:40.891 --rc geninfo_all_blocks=1 00:04:40.891 --rc geninfo_unexecuted_blocks=1 00:04:40.891 00:04:40.891 ' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.891 --rc genhtml_branch_coverage=1 00:04:40.891 --rc genhtml_function_coverage=1 00:04:40.891 --rc genhtml_legend=1 00:04:40.891 --rc geninfo_all_blocks=1 00:04:40.891 --rc geninfo_unexecuted_blocks=1 00:04:40.891 00:04:40.891 ' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.891 --rc genhtml_branch_coverage=1 00:04:40.891 --rc genhtml_function_coverage=1 00:04:40.891 --rc genhtml_legend=1 00:04:40.891 --rc geninfo_all_blocks=1 00:04:40.891 --rc geninfo_unexecuted_blocks=1 00:04:40.891 00:04:40.891 ' 00:04:40.891 12:32:13 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:40.891 12:32:13 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:40.891 12:32:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.891 12:32:13 -- common/autotest_common.sh@10 -- # set +x 00:04:40.891 ************************************ 00:04:40.891 START TEST thread_poller_perf 00:04:40.891 ************************************ 00:04:40.891 12:32:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:41.151 [2024-11-20 12:32:13.999682] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:41.151 [2024-11-20 12:32:13.999768] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3407380 ] 00:04:41.151 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.151 [2024-11-20 12:32:14.060466] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.151 [2024-11-20 12:32:14.171638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.151 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:04:42.528 [2024-11-20T11:32:15.636Z] ====================================== 00:04:42.528 [2024-11-20T11:32:15.636Z] busy:2717896470 (cyc) 00:04:42.528 [2024-11-20T11:32:15.636Z] total_run_count: 280000 00:04:42.528 [2024-11-20T11:32:15.636Z] tsc_hz: 2700000000 (cyc) 00:04:42.528 [2024-11-20T11:32:15.636Z] ====================================== 00:04:42.528 [2024-11-20T11:32:15.636Z] poller_cost: 9706 (cyc), 3594 (nsec) 00:04:42.528 00:04:42.528 real 0m1.321s 00:04:42.528 user 0m1.222s 00:04:42.528 sys 0m0.091s 00:04:42.528 12:32:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.528 12:32:15 -- common/autotest_common.sh@10 -- # set +x 00:04:42.528 ************************************ 00:04:42.528 END TEST thread_poller_perf 00:04:42.528 ************************************ 00:04:42.528 12:32:15 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:42.528 12:32:15 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:42.528 12:32:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.528 12:32:15 -- common/autotest_common.sh@10 -- # set +x 00:04:42.528 ************************************ 00:04:42.528 START TEST thread_poller_perf 00:04:42.528 ************************************ 00:04:42.528 12:32:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:42.528 [2024-11-20 12:32:15.349461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.528 [2024-11-20 12:32:15.349540] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3407535 ] 00:04:42.528 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.528 [2024-11-20 12:32:15.414155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.528 [2024-11-20 12:32:15.527954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.528 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:04:43.906 [2024-11-20T11:32:17.014Z] ====================================== 00:04:43.906 [2024-11-20T11:32:17.014Z] busy:2703978157 (cyc) 00:04:43.906 [2024-11-20T11:32:17.014Z] total_run_count: 3826000 00:04:43.906 [2024-11-20T11:32:17.014Z] tsc_hz: 2700000000 (cyc) 00:04:43.906 [2024-11-20T11:32:17.014Z] ====================================== 00:04:43.906 [2024-11-20T11:32:17.014Z] poller_cost: 706 (cyc), 261 (nsec) 00:04:43.906 00:04:43.906 real 0m1.315s 00:04:43.906 user 0m1.224s 00:04:43.906 sys 0m0.083s 00:04:43.907 12:32:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.907 12:32:16 -- common/autotest_common.sh@10 -- # set +x 00:04:43.907 ************************************ 00:04:43.907 END TEST thread_poller_perf 00:04:43.907 ************************************ 00:04:43.907 12:32:16 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:04:43.907 00:04:43.907 real 0m2.831s 00:04:43.907 user 0m2.568s 00:04:43.907 sys 0m0.266s 00:04:43.907 12:32:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.907 12:32:16 -- common/autotest_common.sh@10 -- # set +x 00:04:43.907 ************************************ 00:04:43.907 END TEST thread 00:04:43.907 ************************************ 00:04:43.907 12:32:16 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:43.907 12:32:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.907 12:32:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.907 12:32:16 -- common/autotest_common.sh@10 -- # set +x 00:04:43.907 ************************************ 00:04:43.907 START TEST accel 00:04:43.907 ************************************ 00:04:43.907 12:32:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:43.907 * Looking for test storage... 00:04:43.907 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:04:43.907 12:32:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:43.907 12:32:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:43.907 12:32:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:43.907 12:32:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:43.907 12:32:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:43.907 12:32:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:43.907 12:32:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:43.907 12:32:16 -- scripts/common.sh@335 -- # IFS=.-: 00:04:43.907 12:32:16 -- scripts/common.sh@335 -- # read -ra ver1 00:04:43.907 12:32:16 -- scripts/common.sh@336 -- # IFS=.-: 00:04:43.907 12:32:16 -- scripts/common.sh@336 -- # read -ra ver2 00:04:43.907 12:32:16 -- scripts/common.sh@337 -- # local 'op=<' 00:04:43.907 12:32:16 -- scripts/common.sh@339 -- # ver1_l=2 00:04:43.907 12:32:16 -- scripts/common.sh@340 -- # ver2_l=1 00:04:43.907 12:32:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:43.907 12:32:16 -- scripts/common.sh@343 -- # case "$op" in 00:04:43.907 12:32:16 -- scripts/common.sh@344 -- # : 1 00:04:43.907 12:32:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:43.907 12:32:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:43.907 12:32:16 -- scripts/common.sh@364 -- # decimal 1 00:04:43.907 12:32:16 -- scripts/common.sh@352 -- # local d=1 00:04:43.907 12:32:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:43.907 12:32:16 -- scripts/common.sh@354 -- # echo 1 00:04:43.907 12:32:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:43.907 12:32:16 -- scripts/common.sh@365 -- # decimal 2 00:04:43.907 12:32:16 -- scripts/common.sh@352 -- # local d=2 00:04:43.907 12:32:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:43.907 12:32:16 -- scripts/common.sh@354 -- # echo 2 00:04:43.907 12:32:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:43.907 12:32:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:43.907 12:32:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:43.907 12:32:16 -- scripts/common.sh@367 -- # return 0 00:04:43.907 12:32:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:43.907 12:32:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:43.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.907 --rc genhtml_branch_coverage=1 00:04:43.907 --rc genhtml_function_coverage=1 00:04:43.907 --rc genhtml_legend=1 00:04:43.907 --rc geninfo_all_blocks=1 00:04:43.907 --rc geninfo_unexecuted_blocks=1 00:04:43.907 00:04:43.907 ' 00:04:43.907 12:32:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:43.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.907 --rc genhtml_branch_coverage=1 00:04:43.907 --rc genhtml_function_coverage=1 00:04:43.907 --rc genhtml_legend=1 00:04:43.907 --rc geninfo_all_blocks=1 00:04:43.907 --rc geninfo_unexecuted_blocks=1 00:04:43.907 00:04:43.907 ' 00:04:43.907 12:32:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:43.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.907 --rc genhtml_branch_coverage=1 00:04:43.907 --rc genhtml_function_coverage=1 00:04:43.907 --rc genhtml_legend=1 00:04:43.907 --rc geninfo_all_blocks=1 00:04:43.907 --rc geninfo_unexecuted_blocks=1 00:04:43.907 00:04:43.907 ' 00:04:43.907 12:32:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:43.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.907 --rc genhtml_branch_coverage=1 00:04:43.907 --rc genhtml_function_coverage=1 00:04:43.907 --rc genhtml_legend=1 00:04:43.907 --rc geninfo_all_blocks=1 00:04:43.907 --rc geninfo_unexecuted_blocks=1 00:04:43.907 00:04:43.907 ' 00:04:43.907 12:32:16 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:04:43.907 12:32:16 -- accel/accel.sh@74 -- # get_expected_opcs 00:04:43.907 12:32:16 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:43.907 12:32:16 -- accel/accel.sh@59 -- # spdk_tgt_pid=3407800 00:04:43.907 12:32:16 -- accel/accel.sh@60 -- # waitforlisten 3407800 00:04:43.907 12:32:16 -- common/autotest_common.sh@829 -- # '[' -z 3407800 ']' 00:04:43.907 12:32:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:43.907 12:32:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.907 12:32:16 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:04:43.907 12:32:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:43.907 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:43.907 12:32:16 -- accel/accel.sh@58 -- # build_accel_config 00:04:43.907 12:32:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.907 12:32:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:43.907 12:32:16 -- common/autotest_common.sh@10 -- # set +x 00:04:43.907 12:32:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:43.907 12:32:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:43.907 12:32:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:43.907 12:32:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:43.907 12:32:16 -- accel/accel.sh@41 -- # local IFS=, 00:04:43.907 12:32:16 -- accel/accel.sh@42 -- # jq -r . 00:04:43.907 [2024-11-20 12:32:16.879962] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.907 [2024-11-20 12:32:16.880044] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3407800 ] 00:04:43.907 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.907 [2024-11-20 12:32:16.937168] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:44.167 [2024-11-20 12:32:17.050051] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:44.167 [2024-11-20 12:32:17.050230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.737 12:32:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:44.737 12:32:17 -- common/autotest_common.sh@862 -- # return 0 00:04:44.737 12:32:17 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:04:44.737 12:32:17 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:04:44.737 12:32:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:44.737 12:32:17 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:04:44.737 12:32:17 -- common/autotest_common.sh@10 -- # set +x 00:04:44.737 12:32:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # IFS== 00:04:44.997 12:32:17 -- accel/accel.sh@64 -- # read -r opc module 00:04:44.997 12:32:17 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:44.997 12:32:17 -- accel/accel.sh@67 -- # killprocess 3407800 00:04:44.997 12:32:17 -- common/autotest_common.sh@936 -- # '[' -z 3407800 ']' 00:04:44.997 12:32:17 -- common/autotest_common.sh@940 -- # kill -0 3407800 00:04:44.997 12:32:17 -- common/autotest_common.sh@941 -- # uname 00:04:44.997 12:32:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:44.997 12:32:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3407800 00:04:44.997 12:32:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:44.997 12:32:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:44.997 12:32:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3407800' 00:04:44.997 killing process with pid 3407800 00:04:44.997 12:32:17 -- common/autotest_common.sh@955 -- # kill 3407800 00:04:44.997 12:32:17 -- common/autotest_common.sh@960 -- # wait 3407800 00:04:45.256 12:32:18 -- accel/accel.sh@68 -- # trap - ERR 00:04:45.256 12:32:18 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:04:45.256 12:32:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:04:45.256 12:32:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.256 12:32:18 -- common/autotest_common.sh@10 -- # set +x 00:04:45.256 12:32:18 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:04:45.256 12:32:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:04:45.256 12:32:18 -- accel/accel.sh@12 -- # build_accel_config 00:04:45.256 12:32:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:45.256 12:32:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:45.256 12:32:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:45.256 12:32:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:45.256 12:32:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:45.256 12:32:18 -- accel/accel.sh@41 -- # local IFS=, 00:04:45.256 12:32:18 -- accel/accel.sh@42 -- # jq -r . 00:04:45.516 12:32:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.516 12:32:18 -- common/autotest_common.sh@10 -- # set +x 00:04:45.516 12:32:18 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:04:45.516 12:32:18 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:45.516 12:32:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.516 12:32:18 -- common/autotest_common.sh@10 -- # set +x 00:04:45.516 ************************************ 00:04:45.516 START TEST accel_missing_filename 00:04:45.516 ************************************ 00:04:45.516 12:32:18 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:04:45.516 12:32:18 -- common/autotest_common.sh@650 -- # local es=0 00:04:45.516 12:32:18 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:04:45.516 12:32:18 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:45.516 12:32:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:45.516 12:32:18 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:45.516 12:32:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:45.516 12:32:18 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:04:45.516 12:32:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:04:45.516 12:32:18 -- accel/accel.sh@12 -- # build_accel_config 00:04:45.516 12:32:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:45.516 12:32:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:45.516 12:32:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:45.516 12:32:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:45.516 12:32:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:45.516 12:32:18 -- accel/accel.sh@41 -- # local IFS=, 00:04:45.516 12:32:18 -- accel/accel.sh@42 -- # jq -r . 00:04:45.516 [2024-11-20 12:32:18.408281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.516 [2024-11-20 12:32:18.408358] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408047 ] 00:04:45.516 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.516 [2024-11-20 12:32:18.472131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.516 [2024-11-20 12:32:18.586844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.775 [2024-11-20 12:32:18.648753] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:45.775 [2024-11-20 12:32:18.737525] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:45.775 A filename is required. 00:04:45.775 12:32:18 -- common/autotest_common.sh@653 -- # es=234 00:04:45.775 12:32:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:45.775 12:32:18 -- common/autotest_common.sh@662 -- # es=106 00:04:45.775 12:32:18 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:45.775 12:32:18 -- common/autotest_common.sh@670 -- # es=1 00:04:45.775 12:32:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:45.775 00:04:45.775 real 0m0.469s 00:04:45.775 user 0m0.351s 00:04:45.775 sys 0m0.146s 00:04:45.775 12:32:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.775 12:32:18 -- common/autotest_common.sh@10 -- # set +x 00:04:45.775 ************************************ 00:04:45.775 END TEST accel_missing_filename 00:04:45.775 ************************************ 00:04:46.034 12:32:18 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:46.034 12:32:18 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:46.034 12:32:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.034 12:32:18 -- common/autotest_common.sh@10 -- # set +x 00:04:46.034 ************************************ 00:04:46.034 START TEST accel_compress_verify 00:04:46.034 ************************************ 00:04:46.034 12:32:18 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:46.034 12:32:18 -- common/autotest_common.sh@650 -- # local es=0 00:04:46.034 12:32:18 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:46.034 12:32:18 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:46.034 12:32:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.034 12:32:18 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:46.034 12:32:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.034 12:32:18 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:46.034 12:32:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:46.034 12:32:18 -- accel/accel.sh@12 -- # build_accel_config 00:04:46.034 12:32:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:46.034 12:32:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:46.034 12:32:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:46.034 12:32:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:46.034 12:32:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:46.034 12:32:18 -- accel/accel.sh@41 -- # local IFS=, 00:04:46.034 12:32:18 -- accel/accel.sh@42 -- # jq -r . 00:04:46.034 [2024-11-20 12:32:18.905935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.034 [2024-11-20 12:32:18.906007] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408066 ] 00:04:46.034 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.034 [2024-11-20 12:32:18.968493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.034 [2024-11-20 12:32:19.087988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.292 [2024-11-20 12:32:19.146756] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:46.292 [2024-11-20 12:32:19.234660] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:46.292 00:04:46.292 Compression does not support the verify option, aborting. 00:04:46.292 12:32:19 -- common/autotest_common.sh@653 -- # es=161 00:04:46.292 12:32:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:46.292 12:32:19 -- common/autotest_common.sh@662 -- # es=33 00:04:46.292 12:32:19 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:46.292 12:32:19 -- common/autotest_common.sh@670 -- # es=1 00:04:46.292 12:32:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:46.292 00:04:46.292 real 0m0.465s 00:04:46.292 user 0m0.362s 00:04:46.292 sys 0m0.134s 00:04:46.292 12:32:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.292 12:32:19 -- common/autotest_common.sh@10 -- # set +x 00:04:46.292 ************************************ 00:04:46.292 END TEST accel_compress_verify 00:04:46.292 ************************************ 00:04:46.292 12:32:19 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:04:46.292 12:32:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:46.292 12:32:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.292 12:32:19 -- common/autotest_common.sh@10 -- # set +x 00:04:46.292 ************************************ 00:04:46.292 START TEST accel_wrong_workload 00:04:46.292 ************************************ 00:04:46.292 12:32:19 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:04:46.292 12:32:19 -- common/autotest_common.sh@650 -- # local es=0 00:04:46.292 12:32:19 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:04:46.292 12:32:19 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:46.292 12:32:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.292 12:32:19 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:46.292 12:32:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.292 12:32:19 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:04:46.292 12:32:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:04:46.292 12:32:19 -- accel/accel.sh@12 -- # build_accel_config 00:04:46.292 12:32:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:46.292 12:32:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:46.292 12:32:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:46.292 12:32:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:46.292 12:32:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:46.292 12:32:19 -- accel/accel.sh@41 -- # local IFS=, 00:04:46.292 12:32:19 -- accel/accel.sh@42 -- # jq -r . 00:04:46.292 Unsupported workload type: foobar 00:04:46.292 [2024-11-20 12:32:19.395145] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:04:46.552 accel_perf options: 00:04:46.552 [-h help message] 00:04:46.552 [-q queue depth per core] 00:04:46.552 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:46.552 [-T number of threads per core 00:04:46.552 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:46.552 [-t time in seconds] 00:04:46.552 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:46.552 [ dif_verify, , dif_generate, dif_generate_copy 00:04:46.552 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:46.552 [-l for compress/decompress workloads, name of uncompressed input file 00:04:46.552 [-S for crc32c workload, use this seed value (default 0) 00:04:46.552 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:46.552 [-f for fill workload, use this BYTE value (default 255) 00:04:46.552 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:46.552 [-y verify result if this switch is on] 00:04:46.552 [-a tasks to allocate per core (default: same value as -q)] 00:04:46.552 Can be used to spread operations across a wider range of memory. 00:04:46.552 12:32:19 -- common/autotest_common.sh@653 -- # es=1 00:04:46.552 12:32:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:46.552 12:32:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:46.552 12:32:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:46.552 00:04:46.552 real 0m0.022s 00:04:46.552 user 0m0.014s 00:04:46.552 sys 0m0.009s 00:04:46.552 12:32:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.552 12:32:19 -- common/autotest_common.sh@10 -- # set +x 00:04:46.552 ************************************ 00:04:46.552 END TEST accel_wrong_workload 00:04:46.552 ************************************ 00:04:46.552 Error: writing output failed: Broken pipe 00:04:46.552 12:32:19 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:04:46.552 12:32:19 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:46.552 12:32:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.552 12:32:19 -- common/autotest_common.sh@10 -- # set +x 00:04:46.552 ************************************ 00:04:46.552 START TEST accel_negative_buffers 00:04:46.552 ************************************ 00:04:46.552 12:32:19 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:04:46.552 12:32:19 -- common/autotest_common.sh@650 -- # local es=0 00:04:46.552 12:32:19 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:04:46.552 12:32:19 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:46.552 12:32:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.552 12:32:19 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:46.552 12:32:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.552 12:32:19 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:04:46.552 12:32:19 -- accel/accel.sh@12 -- # build_accel_config 00:04:46.552 12:32:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:04:46.552 12:32:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:46.552 12:32:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:46.552 12:32:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:46.552 12:32:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:46.552 12:32:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:46.552 12:32:19 -- accel/accel.sh@41 -- # local IFS=, 00:04:46.552 12:32:19 -- accel/accel.sh@42 -- # jq -r . 00:04:46.552 -x option must be non-negative. 00:04:46.552 [2024-11-20 12:32:19.439733] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:04:46.552 accel_perf options: 00:04:46.552 [-h help message] 00:04:46.552 [-q queue depth per core] 00:04:46.552 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:46.552 [-T number of threads per core 00:04:46.552 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:46.552 [-t time in seconds] 00:04:46.552 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:46.552 [ dif_verify, , dif_generate, dif_generate_copy 00:04:46.552 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:46.552 [-l for compress/decompress workloads, name of uncompressed input file 00:04:46.552 [-S for crc32c workload, use this seed value (default 0) 00:04:46.552 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:46.552 [-f for fill workload, use this BYTE value (default 255) 00:04:46.552 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:46.552 [-y verify result if this switch is on] 00:04:46.552 [-a tasks to allocate per core (default: same value as -q)] 00:04:46.553 Can be used to spread operations across a wider range of memory. 00:04:46.553 12:32:19 -- common/autotest_common.sh@653 -- # es=1 00:04:46.553 12:32:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:46.553 12:32:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:46.553 12:32:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:46.553 00:04:46.553 real 0m0.023s 00:04:46.553 user 0m0.013s 00:04:46.553 sys 0m0.010s 00:04:46.553 12:32:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.553 12:32:19 -- common/autotest_common.sh@10 -- # set +x 00:04:46.553 ************************************ 00:04:46.553 END TEST accel_negative_buffers 00:04:46.553 ************************************ 00:04:46.553 Error: writing output failed: Broken pipe 00:04:46.553 12:32:19 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:04:46.553 12:32:19 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:04:46.553 12:32:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.553 12:32:19 -- common/autotest_common.sh@10 -- # set +x 00:04:46.553 ************************************ 00:04:46.553 START TEST accel_crc32c 00:04:46.553 ************************************ 00:04:46.553 12:32:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:04:46.553 12:32:19 -- accel/accel.sh@16 -- # local accel_opc 00:04:46.553 12:32:19 -- accel/accel.sh@17 -- # local accel_module 00:04:46.553 12:32:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:46.553 12:32:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:46.553 12:32:19 -- accel/accel.sh@12 -- # build_accel_config 00:04:46.553 12:32:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:46.553 12:32:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:46.553 12:32:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:46.553 12:32:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:46.553 12:32:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:46.553 12:32:19 -- accel/accel.sh@41 -- # local IFS=, 00:04:46.553 12:32:19 -- accel/accel.sh@42 -- # jq -r . 00:04:46.553 [2024-11-20 12:32:19.482915] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.553 [2024-11-20 12:32:19.482980] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408256 ] 00:04:46.553 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.553 [2024-11-20 12:32:19.545350] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.812 [2024-11-20 12:32:19.661912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.190 12:32:20 -- accel/accel.sh@18 -- # out=' 00:04:48.190 SPDK Configuration: 00:04:48.190 Core mask: 0x1 00:04:48.190 00:04:48.190 Accel Perf Configuration: 00:04:48.190 Workload Type: crc32c 00:04:48.190 CRC-32C seed: 32 00:04:48.190 Transfer size: 4096 bytes 00:04:48.190 Vector count 1 00:04:48.190 Module: software 00:04:48.190 Queue depth: 32 00:04:48.190 Allocate depth: 32 00:04:48.190 # threads/core: 1 00:04:48.190 Run time: 1 seconds 00:04:48.190 Verify: Yes 00:04:48.190 00:04:48.190 Running for 1 seconds... 00:04:48.190 00:04:48.190 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:48.190 ------------------------------------------------------------------------------------ 00:04:48.190 0,0 405888/s 1585 MiB/s 0 0 00:04:48.190 ==================================================================================== 00:04:48.190 Total 405888/s 1585 MiB/s 0 0' 00:04:48.190 12:32:20 -- accel/accel.sh@20 -- # IFS=: 00:04:48.190 12:32:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:48.190 12:32:20 -- accel/accel.sh@20 -- # read -r var val 00:04:48.190 12:32:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:48.191 12:32:20 -- accel/accel.sh@12 -- # build_accel_config 00:04:48.191 12:32:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:48.191 12:32:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:48.191 12:32:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:48.191 12:32:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:48.191 12:32:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:48.191 12:32:20 -- accel/accel.sh@41 -- # local IFS=, 00:04:48.191 12:32:20 -- accel/accel.sh@42 -- # jq -r . 00:04:48.191 [2024-11-20 12:32:20.957758] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.191 [2024-11-20 12:32:20.957847] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408394 ] 00:04:48.191 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.191 [2024-11-20 12:32:21.021091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.191 [2024-11-20 12:32:21.136557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=0x1 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=crc32c 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=32 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=software 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@23 -- # accel_module=software 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=32 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=32 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=1 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val=Yes 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:48.191 12:32:21 -- accel/accel.sh@21 -- # val= 00:04:48.191 12:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # IFS=: 00:04:48.191 12:32:21 -- accel/accel.sh@20 -- # read -r var val 00:04:49.598 12:32:22 -- accel/accel.sh@21 -- # val= 00:04:49.598 12:32:22 -- accel/accel.sh@22 -- # case "$var" in 00:04:49.598 12:32:22 -- accel/accel.sh@20 -- # IFS=: 00:04:49.598 12:32:22 -- accel/accel.sh@20 -- # read -r var val 00:04:49.598 12:32:22 -- accel/accel.sh@21 -- # val= 00:04:49.598 12:32:22 -- accel/accel.sh@22 -- # case "$var" in 00:04:49.598 12:32:22 -- accel/accel.sh@20 -- # IFS=: 00:04:49.598 12:32:22 -- accel/accel.sh@20 -- # read -r var val 00:04:49.598 12:32:22 -- accel/accel.sh@21 -- # val= 00:04:49.598 12:32:22 -- accel/accel.sh@22 -- # case "$var" in 00:04:49.598 12:32:22 -- accel/accel.sh@20 -- # IFS=: 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # read -r var val 00:04:49.599 12:32:22 -- accel/accel.sh@21 -- # val= 00:04:49.599 12:32:22 -- accel/accel.sh@22 -- # case "$var" in 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # IFS=: 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # read -r var val 00:04:49.599 12:32:22 -- accel/accel.sh@21 -- # val= 00:04:49.599 12:32:22 -- accel/accel.sh@22 -- # case "$var" in 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # IFS=: 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # read -r var val 00:04:49.599 12:32:22 -- accel/accel.sh@21 -- # val= 00:04:49.599 12:32:22 -- accel/accel.sh@22 -- # case "$var" in 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # IFS=: 00:04:49.599 12:32:22 -- accel/accel.sh@20 -- # read -r var val 00:04:49.599 12:32:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:49.599 12:32:22 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:04:49.599 12:32:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:49.599 00:04:49.599 real 0m2.949s 00:04:49.599 user 0m2.647s 00:04:49.599 sys 0m0.294s 00:04:49.599 12:32:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.599 12:32:22 -- common/autotest_common.sh@10 -- # set +x 00:04:49.599 ************************************ 00:04:49.599 END TEST accel_crc32c 00:04:49.599 ************************************ 00:04:49.599 12:32:22 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:04:49.599 12:32:22 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:04:49.599 12:32:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.599 12:32:22 -- common/autotest_common.sh@10 -- # set +x 00:04:49.599 ************************************ 00:04:49.599 START TEST accel_crc32c_C2 00:04:49.599 ************************************ 00:04:49.599 12:32:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:04:49.599 12:32:22 -- accel/accel.sh@16 -- # local accel_opc 00:04:49.599 12:32:22 -- accel/accel.sh@17 -- # local accel_module 00:04:49.599 12:32:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:04:49.599 12:32:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:04:49.599 12:32:22 -- accel/accel.sh@12 -- # build_accel_config 00:04:49.599 12:32:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:49.599 12:32:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:49.599 12:32:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:49.599 12:32:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:49.599 12:32:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:49.599 12:32:22 -- accel/accel.sh@41 -- # local IFS=, 00:04:49.599 12:32:22 -- accel/accel.sh@42 -- # jq -r . 00:04:49.599 [2024-11-20 12:32:22.456555] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:49.599 [2024-11-20 12:32:22.456649] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408578 ] 00:04:49.599 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.599 [2024-11-20 12:32:22.514564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:49.599 [2024-11-20 12:32:22.616652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.054 12:32:23 -- accel/accel.sh@18 -- # out=' 00:04:51.054 SPDK Configuration: 00:04:51.054 Core mask: 0x1 00:04:51.054 00:04:51.054 Accel Perf Configuration: 00:04:51.054 Workload Type: crc32c 00:04:51.054 CRC-32C seed: 0 00:04:51.054 Transfer size: 4096 bytes 00:04:51.054 Vector count 2 00:04:51.054 Module: software 00:04:51.054 Queue depth: 32 00:04:51.054 Allocate depth: 32 00:04:51.054 # threads/core: 1 00:04:51.054 Run time: 1 seconds 00:04:51.054 Verify: Yes 00:04:51.054 00:04:51.055 Running for 1 seconds... 00:04:51.055 00:04:51.055 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:51.055 ------------------------------------------------------------------------------------ 00:04:51.055 0,0 383328/s 2994 MiB/s 0 0 00:04:51.055 ==================================================================================== 00:04:51.055 Total 383328/s 1497 MiB/s 0 0' 00:04:51.055 12:32:23 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:04:51.055 12:32:23 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:04:51.055 12:32:23 -- accel/accel.sh@12 -- # build_accel_config 00:04:51.055 12:32:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:51.055 12:32:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:51.055 12:32:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:51.055 12:32:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:51.055 12:32:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:51.055 12:32:23 -- accel/accel.sh@41 -- # local IFS=, 00:04:51.055 12:32:23 -- accel/accel.sh@42 -- # jq -r . 00:04:51.055 [2024-11-20 12:32:23.900491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.055 [2024-11-20 12:32:23.900570] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408825 ] 00:04:51.055 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.055 [2024-11-20 12:32:23.956819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.055 [2024-11-20 12:32:24.072665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=0x1 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=crc32c 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=0 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=software 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@23 -- # accel_module=software 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=32 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=32 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=1 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val=Yes 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:51.055 12:32:24 -- accel/accel.sh@21 -- # val= 00:04:51.055 12:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # IFS=: 00:04:51.055 12:32:24 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@21 -- # val= 00:04:52.435 12:32:25 -- accel/accel.sh@22 -- # case "$var" in 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # IFS=: 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@21 -- # val= 00:04:52.435 12:32:25 -- accel/accel.sh@22 -- # case "$var" in 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # IFS=: 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@21 -- # val= 00:04:52.435 12:32:25 -- accel/accel.sh@22 -- # case "$var" in 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # IFS=: 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@21 -- # val= 00:04:52.435 12:32:25 -- accel/accel.sh@22 -- # case "$var" in 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # IFS=: 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@21 -- # val= 00:04:52.435 12:32:25 -- accel/accel.sh@22 -- # case "$var" in 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # IFS=: 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@21 -- # val= 00:04:52.435 12:32:25 -- accel/accel.sh@22 -- # case "$var" in 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # IFS=: 00:04:52.435 12:32:25 -- accel/accel.sh@20 -- # read -r var val 00:04:52.435 12:32:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:52.435 12:32:25 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:04:52.435 12:32:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:52.435 00:04:52.435 real 0m2.910s 00:04:52.435 user 0m2.616s 00:04:52.435 sys 0m0.287s 00:04:52.435 12:32:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:52.435 12:32:25 -- common/autotest_common.sh@10 -- # set +x 00:04:52.435 ************************************ 00:04:52.435 END TEST accel_crc32c_C2 00:04:52.435 ************************************ 00:04:52.435 12:32:25 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:04:52.435 12:32:25 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:52.435 12:32:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.435 12:32:25 -- common/autotest_common.sh@10 -- # set +x 00:04:52.435 ************************************ 00:04:52.435 START TEST accel_copy 00:04:52.435 ************************************ 00:04:52.435 12:32:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:04:52.435 12:32:25 -- accel/accel.sh@16 -- # local accel_opc 00:04:52.435 12:32:25 -- accel/accel.sh@17 -- # local accel_module 00:04:52.435 12:32:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:04:52.435 12:32:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:04:52.435 12:32:25 -- accel/accel.sh@12 -- # build_accel_config 00:04:52.435 12:32:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:52.435 12:32:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:52.435 12:32:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:52.435 12:32:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:52.435 12:32:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:52.435 12:32:25 -- accel/accel.sh@41 -- # local IFS=, 00:04:52.435 12:32:25 -- accel/accel.sh@42 -- # jq -r . 00:04:52.435 [2024-11-20 12:32:25.392179] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:52.435 [2024-11-20 12:32:25.392259] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408981 ] 00:04:52.435 EAL: No free 2048 kB hugepages reported on node 1 00:04:52.435 [2024-11-20 12:32:25.454603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:52.693 [2024-11-20 12:32:25.572415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.074 12:32:26 -- accel/accel.sh@18 -- # out=' 00:04:54.074 SPDK Configuration: 00:04:54.074 Core mask: 0x1 00:04:54.074 00:04:54.074 Accel Perf Configuration: 00:04:54.074 Workload Type: copy 00:04:54.074 Transfer size: 4096 bytes 00:04:54.074 Vector count 1 00:04:54.074 Module: software 00:04:54.074 Queue depth: 32 00:04:54.074 Allocate depth: 32 00:04:54.074 # threads/core: 1 00:04:54.074 Run time: 1 seconds 00:04:54.074 Verify: Yes 00:04:54.074 00:04:54.074 Running for 1 seconds... 00:04:54.074 00:04:54.074 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:54.074 ------------------------------------------------------------------------------------ 00:04:54.074 0,0 272640/s 1065 MiB/s 0 0 00:04:54.074 ==================================================================================== 00:04:54.074 Total 272640/s 1065 MiB/s 0 0' 00:04:54.074 12:32:26 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:04:54.074 12:32:26 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:04:54.074 12:32:26 -- accel/accel.sh@12 -- # build_accel_config 00:04:54.074 12:32:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:54.074 12:32:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:54.074 12:32:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:54.074 12:32:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:54.074 12:32:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:54.074 12:32:26 -- accel/accel.sh@41 -- # local IFS=, 00:04:54.074 12:32:26 -- accel/accel.sh@42 -- # jq -r . 00:04:54.074 [2024-11-20 12:32:26.868150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.074 [2024-11-20 12:32:26.868234] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3409125 ] 00:04:54.074 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.074 [2024-11-20 12:32:26.929669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.074 [2024-11-20 12:32:27.046787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val=0x1 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val=copy 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@24 -- # accel_opc=copy 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val=software 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@23 -- # accel_module=software 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val=32 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.074 12:32:27 -- accel/accel.sh@21 -- # val=32 00:04:54.074 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.074 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.075 12:32:27 -- accel/accel.sh@21 -- # val=1 00:04:54.075 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.075 12:32:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:54.075 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.075 12:32:27 -- accel/accel.sh@21 -- # val=Yes 00:04:54.075 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.075 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.075 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:54.075 12:32:27 -- accel/accel.sh@21 -- # val= 00:04:54.075 12:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # IFS=: 00:04:54.075 12:32:27 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@21 -- # val= 00:04:55.458 12:32:28 -- accel/accel.sh@22 -- # case "$var" in 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # IFS=: 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@21 -- # val= 00:04:55.458 12:32:28 -- accel/accel.sh@22 -- # case "$var" in 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # IFS=: 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@21 -- # val= 00:04:55.458 12:32:28 -- accel/accel.sh@22 -- # case "$var" in 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # IFS=: 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@21 -- # val= 00:04:55.458 12:32:28 -- accel/accel.sh@22 -- # case "$var" in 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # IFS=: 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@21 -- # val= 00:04:55.458 12:32:28 -- accel/accel.sh@22 -- # case "$var" in 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # IFS=: 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@21 -- # val= 00:04:55.458 12:32:28 -- accel/accel.sh@22 -- # case "$var" in 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # IFS=: 00:04:55.458 12:32:28 -- accel/accel.sh@20 -- # read -r var val 00:04:55.458 12:32:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:55.458 12:32:28 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:04:55.458 12:32:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:55.458 00:04:55.458 real 0m2.944s 00:04:55.458 user 0m2.652s 00:04:55.458 sys 0m0.283s 00:04:55.458 12:32:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.458 12:32:28 -- common/autotest_common.sh@10 -- # set +x 00:04:55.458 ************************************ 00:04:55.458 END TEST accel_copy 00:04:55.458 ************************************ 00:04:55.458 12:32:28 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:04:55.458 12:32:28 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:04:55.458 12:32:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.458 12:32:28 -- common/autotest_common.sh@10 -- # set +x 00:04:55.458 ************************************ 00:04:55.458 START TEST accel_fill 00:04:55.458 ************************************ 00:04:55.458 12:32:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:04:55.458 12:32:28 -- accel/accel.sh@16 -- # local accel_opc 00:04:55.458 12:32:28 -- accel/accel.sh@17 -- # local accel_module 00:04:55.458 12:32:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:04:55.458 12:32:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:04:55.458 12:32:28 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.458 12:32:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.458 12:32:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.458 12:32:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.458 12:32:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.458 12:32:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.458 12:32:28 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.458 12:32:28 -- accel/accel.sh@42 -- # jq -r . 00:04:55.458 [2024-11-20 12:32:28.358563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:55.458 [2024-11-20 12:32:28.358647] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3409405 ] 00:04:55.458 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.459 [2024-11-20 12:32:28.419614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.459 [2024-11-20 12:32:28.532817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.839 12:32:29 -- accel/accel.sh@18 -- # out=' 00:04:56.839 SPDK Configuration: 00:04:56.839 Core mask: 0x1 00:04:56.839 00:04:56.839 Accel Perf Configuration: 00:04:56.839 Workload Type: fill 00:04:56.839 Fill pattern: 0x80 00:04:56.839 Transfer size: 4096 bytes 00:04:56.839 Vector count 1 00:04:56.839 Module: software 00:04:56.839 Queue depth: 64 00:04:56.839 Allocate depth: 64 00:04:56.839 # threads/core: 1 00:04:56.839 Run time: 1 seconds 00:04:56.839 Verify: Yes 00:04:56.839 00:04:56.839 Running for 1 seconds... 00:04:56.839 00:04:56.839 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:56.839 ------------------------------------------------------------------------------------ 00:04:56.839 0,0 403200/s 1575 MiB/s 0 0 00:04:56.839 ==================================================================================== 00:04:56.839 Total 403200/s 1575 MiB/s 0 0' 00:04:56.839 12:32:29 -- accel/accel.sh@20 -- # IFS=: 00:04:56.839 12:32:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:04:56.839 12:32:29 -- accel/accel.sh@20 -- # read -r var val 00:04:56.839 12:32:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:04:56.839 12:32:29 -- accel/accel.sh@12 -- # build_accel_config 00:04:56.839 12:32:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:56.839 12:32:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:56.839 12:32:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:56.839 12:32:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:56.839 12:32:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:56.839 12:32:29 -- accel/accel.sh@41 -- # local IFS=, 00:04:56.839 12:32:29 -- accel/accel.sh@42 -- # jq -r . 00:04:56.839 [2024-11-20 12:32:29.818519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.839 [2024-11-20 12:32:29.818607] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3409554 ] 00:04:56.839 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.839 [2024-11-20 12:32:29.879625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.100 [2024-11-20 12:32:29.995648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val=0x1 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val=fill 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.100 12:32:30 -- accel/accel.sh@24 -- # accel_opc=fill 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.100 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.100 12:32:30 -- accel/accel.sh@21 -- # val=0x80 00:04:57.100 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val=software 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@23 -- # accel_module=software 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val=64 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val=64 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val=1 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val=Yes 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:57.101 12:32:30 -- accel/accel.sh@21 -- # val= 00:04:57.101 12:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # IFS=: 00:04:57.101 12:32:30 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@21 -- # val= 00:04:58.480 12:32:31 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # IFS=: 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@21 -- # val= 00:04:58.480 12:32:31 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # IFS=: 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@21 -- # val= 00:04:58.480 12:32:31 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # IFS=: 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@21 -- # val= 00:04:58.480 12:32:31 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # IFS=: 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@21 -- # val= 00:04:58.480 12:32:31 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # IFS=: 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@21 -- # val= 00:04:58.480 12:32:31 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # IFS=: 00:04:58.480 12:32:31 -- accel/accel.sh@20 -- # read -r var val 00:04:58.480 12:32:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:58.480 12:32:31 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:04:58.480 12:32:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:58.480 00:04:58.480 real 0m2.937s 00:04:58.480 user 0m2.644s 00:04:58.480 sys 0m0.285s 00:04:58.481 12:32:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.481 12:32:31 -- common/autotest_common.sh@10 -- # set +x 00:04:58.481 ************************************ 00:04:58.481 END TEST accel_fill 00:04:58.481 ************************************ 00:04:58.481 12:32:31 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:04:58.481 12:32:31 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:58.481 12:32:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.481 12:32:31 -- common/autotest_common.sh@10 -- # set +x 00:04:58.481 ************************************ 00:04:58.481 START TEST accel_copy_crc32c 00:04:58.481 ************************************ 00:04:58.481 12:32:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:04:58.481 12:32:31 -- accel/accel.sh@16 -- # local accel_opc 00:04:58.481 12:32:31 -- accel/accel.sh@17 -- # local accel_module 00:04:58.481 12:32:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:04:58.481 12:32:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:04:58.481 12:32:31 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.481 12:32:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.481 12:32:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.481 12:32:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.481 12:32:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.481 12:32:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.481 12:32:31 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.481 12:32:31 -- accel/accel.sh@42 -- # jq -r . 00:04:58.481 [2024-11-20 12:32:31.318677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.481 [2024-11-20 12:32:31.318758] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3409709 ] 00:04:58.481 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.481 [2024-11-20 12:32:31.379024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.481 [2024-11-20 12:32:31.497331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.859 12:32:32 -- accel/accel.sh@18 -- # out=' 00:04:59.859 SPDK Configuration: 00:04:59.859 Core mask: 0x1 00:04:59.859 00:04:59.859 Accel Perf Configuration: 00:04:59.859 Workload Type: copy_crc32c 00:04:59.859 CRC-32C seed: 0 00:04:59.859 Vector size: 4096 bytes 00:04:59.859 Transfer size: 4096 bytes 00:04:59.859 Vector count 1 00:04:59.859 Module: software 00:04:59.859 Queue depth: 32 00:04:59.859 Allocate depth: 32 00:04:59.859 # threads/core: 1 00:04:59.859 Run time: 1 seconds 00:04:59.859 Verify: Yes 00:04:59.859 00:04:59.859 Running for 1 seconds... 00:04:59.859 00:04:59.859 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:59.859 ------------------------------------------------------------------------------------ 00:04:59.859 0,0 219232/s 856 MiB/s 0 0 00:04:59.859 ==================================================================================== 00:04:59.859 Total 219232/s 856 MiB/s 0 0' 00:04:59.859 12:32:32 -- accel/accel.sh@20 -- # IFS=: 00:04:59.859 12:32:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:04:59.859 12:32:32 -- accel/accel.sh@20 -- # read -r var val 00:04:59.859 12:32:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:04:59.859 12:32:32 -- accel/accel.sh@12 -- # build_accel_config 00:04:59.859 12:32:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:59.859 12:32:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:59.859 12:32:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:59.859 12:32:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:59.859 12:32:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:59.859 12:32:32 -- accel/accel.sh@41 -- # local IFS=, 00:04:59.859 12:32:32 -- accel/accel.sh@42 -- # jq -r . 00:04:59.859 [2024-11-20 12:32:32.789693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:59.859 [2024-11-20 12:32:32.789778] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3409974 ] 00:04:59.859 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.859 [2024-11-20 12:32:32.850628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.860 [2024-11-20 12:32:32.966044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val=0x1 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val=0 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.181 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.181 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.181 12:32:33 -- accel/accel.sh@21 -- # val=software 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@23 -- # accel_module=software 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val=32 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val=32 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val=1 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val=Yes 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:00.182 12:32:33 -- accel/accel.sh@21 -- # val= 00:05:00.182 12:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # IFS=: 00:05:00.182 12:32:33 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@21 -- # val= 00:05:01.562 12:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # IFS=: 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@21 -- # val= 00:05:01.562 12:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # IFS=: 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@21 -- # val= 00:05:01.562 12:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # IFS=: 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@21 -- # val= 00:05:01.562 12:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # IFS=: 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@21 -- # val= 00:05:01.562 12:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # IFS=: 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@21 -- # val= 00:05:01.562 12:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # IFS=: 00:05:01.562 12:32:34 -- accel/accel.sh@20 -- # read -r var val 00:05:01.562 12:32:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:01.562 12:32:34 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:01.562 12:32:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:01.562 00:05:01.562 real 0m2.931s 00:05:01.562 user 0m2.633s 00:05:01.562 sys 0m0.288s 00:05:01.562 12:32:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.562 12:32:34 -- common/autotest_common.sh@10 -- # set +x 00:05:01.562 ************************************ 00:05:01.562 END TEST accel_copy_crc32c 00:05:01.562 ************************************ 00:05:01.562 12:32:34 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:01.562 12:32:34 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:01.562 12:32:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.562 12:32:34 -- common/autotest_common.sh@10 -- # set +x 00:05:01.562 ************************************ 00:05:01.562 START TEST accel_copy_crc32c_C2 00:05:01.562 ************************************ 00:05:01.562 12:32:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:01.562 12:32:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:01.562 12:32:34 -- accel/accel.sh@17 -- # local accel_module 00:05:01.562 12:32:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:01.562 12:32:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:01.562 12:32:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:01.562 12:32:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:01.562 12:32:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:01.562 12:32:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:01.562 12:32:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:01.562 12:32:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:01.562 12:32:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:01.562 12:32:34 -- accel/accel.sh@42 -- # jq -r . 00:05:01.562 [2024-11-20 12:32:34.273177] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.562 [2024-11-20 12:32:34.273262] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3410137 ] 00:05:01.562 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.562 [2024-11-20 12:32:34.334694] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.562 [2024-11-20 12:32:34.451412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.939 12:32:35 -- accel/accel.sh@18 -- # out=' 00:05:02.939 SPDK Configuration: 00:05:02.939 Core mask: 0x1 00:05:02.939 00:05:02.939 Accel Perf Configuration: 00:05:02.939 Workload Type: copy_crc32c 00:05:02.939 CRC-32C seed: 0 00:05:02.939 Vector size: 4096 bytes 00:05:02.939 Transfer size: 8192 bytes 00:05:02.939 Vector count 2 00:05:02.939 Module: software 00:05:02.939 Queue depth: 32 00:05:02.939 Allocate depth: 32 00:05:02.939 # threads/core: 1 00:05:02.939 Run time: 1 seconds 00:05:02.939 Verify: Yes 00:05:02.939 00:05:02.939 Running for 1 seconds... 00:05:02.939 00:05:02.939 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:02.939 ------------------------------------------------------------------------------------ 00:05:02.939 0,0 155520/s 1215 MiB/s 0 0 00:05:02.939 ==================================================================================== 00:05:02.939 Total 155520/s 607 MiB/s 0 0' 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:02.939 12:32:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:02.939 12:32:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:02.939 12:32:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:02.939 12:32:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:02.939 12:32:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:02.939 12:32:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:02.939 12:32:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:02.939 12:32:35 -- accel/accel.sh@42 -- # jq -r . 00:05:02.939 [2024-11-20 12:32:35.749591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.939 [2024-11-20 12:32:35.749681] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3410281 ] 00:05:02.939 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.939 [2024-11-20 12:32:35.811178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.939 [2024-11-20 12:32:35.926893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=0x1 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=0 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=software 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=32 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=32 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=1 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val=Yes 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:02.939 12:32:35 -- accel/accel.sh@21 -- # val= 00:05:02.939 12:32:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # IFS=: 00:05:02.939 12:32:35 -- accel/accel.sh@20 -- # read -r var val 00:05:04.319 12:32:37 -- accel/accel.sh@21 -- # val= 00:05:04.319 12:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.319 12:32:37 -- accel/accel.sh@20 -- # IFS=: 00:05:04.319 12:32:37 -- accel/accel.sh@20 -- # read -r var val 00:05:04.319 12:32:37 -- accel/accel.sh@21 -- # val= 00:05:04.319 12:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.319 12:32:37 -- accel/accel.sh@20 -- # IFS=: 00:05:04.319 12:32:37 -- accel/accel.sh@20 -- # read -r var val 00:05:04.319 12:32:37 -- accel/accel.sh@21 -- # val= 00:05:04.319 12:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # IFS=: 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # read -r var val 00:05:04.320 12:32:37 -- accel/accel.sh@21 -- # val= 00:05:04.320 12:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # IFS=: 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # read -r var val 00:05:04.320 12:32:37 -- accel/accel.sh@21 -- # val= 00:05:04.320 12:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # IFS=: 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # read -r var val 00:05:04.320 12:32:37 -- accel/accel.sh@21 -- # val= 00:05:04.320 12:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # IFS=: 00:05:04.320 12:32:37 -- accel/accel.sh@20 -- # read -r var val 00:05:04.320 12:32:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:04.320 12:32:37 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:04.320 12:32:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:04.320 00:05:04.320 real 0m2.949s 00:05:04.320 user 0m2.658s 00:05:04.320 sys 0m0.282s 00:05:04.320 12:32:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.320 12:32:37 -- common/autotest_common.sh@10 -- # set +x 00:05:04.320 ************************************ 00:05:04.320 END TEST accel_copy_crc32c_C2 00:05:04.320 ************************************ 00:05:04.320 12:32:37 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:04.320 12:32:37 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:04.320 12:32:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.320 12:32:37 -- common/autotest_common.sh@10 -- # set +x 00:05:04.320 ************************************ 00:05:04.320 START TEST accel_dualcast 00:05:04.320 ************************************ 00:05:04.320 12:32:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:04.320 12:32:37 -- accel/accel.sh@16 -- # local accel_opc 00:05:04.320 12:32:37 -- accel/accel.sh@17 -- # local accel_module 00:05:04.320 12:32:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:04.320 12:32:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:04.320 12:32:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:04.320 12:32:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:04.320 12:32:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:04.320 12:32:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:04.320 12:32:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:04.320 12:32:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:04.320 12:32:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:04.320 12:32:37 -- accel/accel.sh@42 -- # jq -r . 00:05:04.320 [2024-11-20 12:32:37.245063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:04.320 [2024-11-20 12:32:37.245177] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3410556 ] 00:05:04.320 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.320 [2024-11-20 12:32:37.306438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.320 [2024-11-20 12:32:37.424062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.702 12:32:38 -- accel/accel.sh@18 -- # out=' 00:05:05.702 SPDK Configuration: 00:05:05.702 Core mask: 0x1 00:05:05.702 00:05:05.702 Accel Perf Configuration: 00:05:05.702 Workload Type: dualcast 00:05:05.702 Transfer size: 4096 bytes 00:05:05.702 Vector count 1 00:05:05.702 Module: software 00:05:05.702 Queue depth: 32 00:05:05.702 Allocate depth: 32 00:05:05.702 # threads/core: 1 00:05:05.702 Run time: 1 seconds 00:05:05.702 Verify: Yes 00:05:05.702 00:05:05.702 Running for 1 seconds... 00:05:05.702 00:05:05.702 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:05.702 ------------------------------------------------------------------------------------ 00:05:05.702 0,0 298688/s 1166 MiB/s 0 0 00:05:05.702 ==================================================================================== 00:05:05.702 Total 298688/s 1166 MiB/s 0 0' 00:05:05.702 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.702 12:32:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:05.702 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.702 12:32:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:05.702 12:32:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:05.702 12:32:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:05.702 12:32:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:05.703 12:32:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:05.703 12:32:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:05.703 12:32:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:05.703 12:32:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:05.703 12:32:38 -- accel/accel.sh@42 -- # jq -r . 00:05:05.703 [2024-11-20 12:32:38.714409] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.703 [2024-11-20 12:32:38.714494] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3410709 ] 00:05:05.703 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.703 [2024-11-20 12:32:38.775031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.963 [2024-11-20 12:32:38.894467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=0x1 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=dualcast 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=software 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@23 -- # accel_module=software 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=32 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=32 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=1 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val=Yes 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:05.963 12:32:38 -- accel/accel.sh@21 -- # val= 00:05:05.963 12:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # IFS=: 00:05:05.963 12:32:38 -- accel/accel.sh@20 -- # read -r var val 00:05:07.352 12:32:40 -- accel/accel.sh@21 -- # val= 00:05:07.352 12:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # IFS=: 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # read -r var val 00:05:07.352 12:32:40 -- accel/accel.sh@21 -- # val= 00:05:07.352 12:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # IFS=: 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # read -r var val 00:05:07.352 12:32:40 -- accel/accel.sh@21 -- # val= 00:05:07.352 12:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # IFS=: 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # read -r var val 00:05:07.352 12:32:40 -- accel/accel.sh@21 -- # val= 00:05:07.352 12:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # IFS=: 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # read -r var val 00:05:07.352 12:32:40 -- accel/accel.sh@21 -- # val= 00:05:07.352 12:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # IFS=: 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # read -r var val 00:05:07.352 12:32:40 -- accel/accel.sh@21 -- # val= 00:05:07.352 12:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.352 12:32:40 -- accel/accel.sh@20 -- # IFS=: 00:05:07.353 12:32:40 -- accel/accel.sh@20 -- # read -r var val 00:05:07.353 12:32:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:07.353 12:32:40 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:07.353 12:32:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:07.353 00:05:07.353 real 0m2.955s 00:05:07.353 user 0m2.656s 00:05:07.353 sys 0m0.290s 00:05:07.353 12:32:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.353 12:32:40 -- common/autotest_common.sh@10 -- # set +x 00:05:07.353 ************************************ 00:05:07.353 END TEST accel_dualcast 00:05:07.353 ************************************ 00:05:07.353 12:32:40 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:07.353 12:32:40 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:07.353 12:32:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.353 12:32:40 -- common/autotest_common.sh@10 -- # set +x 00:05:07.353 ************************************ 00:05:07.353 START TEST accel_compare 00:05:07.353 ************************************ 00:05:07.353 12:32:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:07.353 12:32:40 -- accel/accel.sh@16 -- # local accel_opc 00:05:07.353 12:32:40 -- accel/accel.sh@17 -- # local accel_module 00:05:07.353 12:32:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:07.353 12:32:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:07.353 12:32:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:07.353 12:32:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:07.353 12:32:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:07.353 12:32:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:07.353 12:32:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:07.353 12:32:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:07.353 12:32:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:07.353 12:32:40 -- accel/accel.sh@42 -- # jq -r . 00:05:07.353 [2024-11-20 12:32:40.230679] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:07.353 [2024-11-20 12:32:40.230761] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3410865 ] 00:05:07.353 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.353 [2024-11-20 12:32:40.294453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.353 [2024-11-20 12:32:40.413490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.729 12:32:41 -- accel/accel.sh@18 -- # out=' 00:05:08.729 SPDK Configuration: 00:05:08.729 Core mask: 0x1 00:05:08.729 00:05:08.729 Accel Perf Configuration: 00:05:08.729 Workload Type: compare 00:05:08.729 Transfer size: 4096 bytes 00:05:08.729 Vector count 1 00:05:08.729 Module: software 00:05:08.729 Queue depth: 32 00:05:08.729 Allocate depth: 32 00:05:08.729 # threads/core: 1 00:05:08.729 Run time: 1 seconds 00:05:08.729 Verify: Yes 00:05:08.729 00:05:08.729 Running for 1 seconds... 00:05:08.729 00:05:08.729 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:08.729 ------------------------------------------------------------------------------------ 00:05:08.729 0,0 395328/s 1544 MiB/s 0 0 00:05:08.729 ==================================================================================== 00:05:08.729 Total 395328/s 1544 MiB/s 0 0' 00:05:08.729 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.729 12:32:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:08.729 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.729 12:32:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:08.729 12:32:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:08.729 12:32:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:08.729 12:32:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:08.729 12:32:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:08.729 12:32:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:08.729 12:32:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:08.729 12:32:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:08.729 12:32:41 -- accel/accel.sh@42 -- # jq -r . 00:05:08.729 [2024-11-20 12:32:41.710861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.729 [2024-11-20 12:32:41.710949] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411088 ] 00:05:08.729 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.729 [2024-11-20 12:32:41.775132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.988 [2024-11-20 12:32:41.895911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=0x1 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=compare 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=software 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@23 -- # accel_module=software 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=32 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=32 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=1 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val=Yes 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:08.988 12:32:41 -- accel/accel.sh@21 -- # val= 00:05:08.988 12:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # IFS=: 00:05:08.988 12:32:41 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@21 -- # val= 00:05:10.365 12:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # IFS=: 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@21 -- # val= 00:05:10.365 12:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # IFS=: 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@21 -- # val= 00:05:10.365 12:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # IFS=: 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@21 -- # val= 00:05:10.365 12:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # IFS=: 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@21 -- # val= 00:05:10.365 12:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # IFS=: 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@21 -- # val= 00:05:10.365 12:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # IFS=: 00:05:10.365 12:32:43 -- accel/accel.sh@20 -- # read -r var val 00:05:10.365 12:32:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:10.365 12:32:43 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:10.365 12:32:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:10.365 00:05:10.365 real 0m2.962s 00:05:10.365 user 0m2.666s 00:05:10.365 sys 0m0.287s 00:05:10.365 12:32:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.365 12:32:43 -- common/autotest_common.sh@10 -- # set +x 00:05:10.365 ************************************ 00:05:10.365 END TEST accel_compare 00:05:10.365 ************************************ 00:05:10.365 12:32:43 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:10.365 12:32:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:10.365 12:32:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.365 12:32:43 -- common/autotest_common.sh@10 -- # set +x 00:05:10.365 ************************************ 00:05:10.365 START TEST accel_xor 00:05:10.365 ************************************ 00:05:10.365 12:32:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:10.365 12:32:43 -- accel/accel.sh@16 -- # local accel_opc 00:05:10.365 12:32:43 -- accel/accel.sh@17 -- # local accel_module 00:05:10.365 12:32:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:10.365 12:32:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:10.365 12:32:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:10.365 12:32:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:10.365 12:32:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:10.365 12:32:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:10.365 12:32:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:10.365 12:32:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:10.365 12:32:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:10.365 12:32:43 -- accel/accel.sh@42 -- # jq -r . 00:05:10.365 [2024-11-20 12:32:43.219170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.365 [2024-11-20 12:32:43.219251] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411292 ] 00:05:10.365 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.365 [2024-11-20 12:32:43.281833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.365 [2024-11-20 12:32:43.405090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.739 12:32:44 -- accel/accel.sh@18 -- # out=' 00:05:11.739 SPDK Configuration: 00:05:11.739 Core mask: 0x1 00:05:11.739 00:05:11.739 Accel Perf Configuration: 00:05:11.739 Workload Type: xor 00:05:11.739 Source buffers: 2 00:05:11.739 Transfer size: 4096 bytes 00:05:11.739 Vector count 1 00:05:11.739 Module: software 00:05:11.739 Queue depth: 32 00:05:11.739 Allocate depth: 32 00:05:11.739 # threads/core: 1 00:05:11.739 Run time: 1 seconds 00:05:11.739 Verify: Yes 00:05:11.739 00:05:11.739 Running for 1 seconds... 00:05:11.739 00:05:11.739 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:11.739 ------------------------------------------------------------------------------------ 00:05:11.739 0,0 190688/s 744 MiB/s 0 0 00:05:11.739 ==================================================================================== 00:05:11.739 Total 190688/s 744 MiB/s 0 0' 00:05:11.739 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.739 12:32:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:11.739 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.739 12:32:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:11.739 12:32:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:11.739 12:32:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:11.739 12:32:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:11.739 12:32:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:11.739 12:32:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:11.739 12:32:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:11.739 12:32:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:11.739 12:32:44 -- accel/accel.sh@42 -- # jq -r . 00:05:11.739 [2024-11-20 12:32:44.703537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.739 [2024-11-20 12:32:44.703631] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411431 ] 00:05:11.739 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.739 [2024-11-20 12:32:44.765566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.997 [2024-11-20 12:32:44.886093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=0x1 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=xor 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=2 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=software 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@23 -- # accel_module=software 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=32 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=32 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val=1 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.997 12:32:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:11.997 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.997 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.998 12:32:44 -- accel/accel.sh@21 -- # val=Yes 00:05:11.998 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.998 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.998 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:11.998 12:32:44 -- accel/accel.sh@21 -- # val= 00:05:11.998 12:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # IFS=: 00:05:11.998 12:32:44 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@21 -- # val= 00:05:13.371 12:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # IFS=: 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@21 -- # val= 00:05:13.371 12:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # IFS=: 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@21 -- # val= 00:05:13.371 12:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # IFS=: 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@21 -- # val= 00:05:13.371 12:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # IFS=: 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@21 -- # val= 00:05:13.371 12:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # IFS=: 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@21 -- # val= 00:05:13.371 12:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # IFS=: 00:05:13.371 12:32:46 -- accel/accel.sh@20 -- # read -r var val 00:05:13.371 12:32:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:13.371 12:32:46 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:13.371 12:32:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:13.371 00:05:13.371 real 0m2.972s 00:05:13.371 user 0m2.668s 00:05:13.371 sys 0m0.294s 00:05:13.371 12:32:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.371 12:32:46 -- common/autotest_common.sh@10 -- # set +x 00:05:13.371 ************************************ 00:05:13.371 END TEST accel_xor 00:05:13.371 ************************************ 00:05:13.371 12:32:46 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:13.371 12:32:46 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:13.371 12:32:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.371 12:32:46 -- common/autotest_common.sh@10 -- # set +x 00:05:13.371 ************************************ 00:05:13.371 START TEST accel_xor 00:05:13.371 ************************************ 00:05:13.371 12:32:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:13.371 12:32:46 -- accel/accel.sh@16 -- # local accel_opc 00:05:13.371 12:32:46 -- accel/accel.sh@17 -- # local accel_module 00:05:13.371 12:32:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:13.371 12:32:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:13.371 12:32:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:13.371 12:32:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:13.371 12:32:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:13.371 12:32:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:13.371 12:32:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:13.371 12:32:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:13.371 12:32:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:13.371 12:32:46 -- accel/accel.sh@42 -- # jq -r . 00:05:13.371 [2024-11-20 12:32:46.212881] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.371 [2024-11-20 12:32:46.212969] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411642 ] 00:05:13.371 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.371 [2024-11-20 12:32:46.275791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.371 [2024-11-20 12:32:46.396929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.744 12:32:47 -- accel/accel.sh@18 -- # out=' 00:05:14.745 SPDK Configuration: 00:05:14.745 Core mask: 0x1 00:05:14.745 00:05:14.745 Accel Perf Configuration: 00:05:14.745 Workload Type: xor 00:05:14.745 Source buffers: 3 00:05:14.745 Transfer size: 4096 bytes 00:05:14.745 Vector count 1 00:05:14.745 Module: software 00:05:14.745 Queue depth: 32 00:05:14.745 Allocate depth: 32 00:05:14.745 # threads/core: 1 00:05:14.745 Run time: 1 seconds 00:05:14.745 Verify: Yes 00:05:14.745 00:05:14.745 Running for 1 seconds... 00:05:14.745 00:05:14.745 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:14.745 ------------------------------------------------------------------------------------ 00:05:14.745 0,0 183520/s 716 MiB/s 0 0 00:05:14.745 ==================================================================================== 00:05:14.745 Total 183520/s 716 MiB/s 0 0' 00:05:14.745 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:14.745 12:32:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:14.745 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:14.745 12:32:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:14.745 12:32:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.745 12:32:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.745 12:32:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.745 12:32:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.745 12:32:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.745 12:32:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.745 12:32:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.745 12:32:47 -- accel/accel.sh@42 -- # jq -r . 00:05:14.745 [2024-11-20 12:32:47.699011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.745 [2024-11-20 12:32:47.699119] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411851 ] 00:05:14.745 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.745 [2024-11-20 12:32:47.760448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.004 [2024-11-20 12:32:47.881880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=0x1 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=xor 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=3 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=software 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@23 -- # accel_module=software 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=32 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=32 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=1 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val=Yes 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.004 12:32:47 -- accel/accel.sh@21 -- # val= 00:05:15.004 12:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.004 12:32:47 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@21 -- # val= 00:05:16.375 12:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # IFS=: 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@21 -- # val= 00:05:16.375 12:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # IFS=: 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@21 -- # val= 00:05:16.375 12:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # IFS=: 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@21 -- # val= 00:05:16.375 12:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # IFS=: 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@21 -- # val= 00:05:16.375 12:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # IFS=: 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@21 -- # val= 00:05:16.375 12:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # IFS=: 00:05:16.375 12:32:49 -- accel/accel.sh@20 -- # read -r var val 00:05:16.375 12:32:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:16.375 12:32:49 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:16.375 12:32:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:16.375 00:05:16.375 real 0m2.961s 00:05:16.375 user 0m2.655s 00:05:16.375 sys 0m0.297s 00:05:16.375 12:32:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.375 12:32:49 -- common/autotest_common.sh@10 -- # set +x 00:05:16.375 ************************************ 00:05:16.375 END TEST accel_xor 00:05:16.375 ************************************ 00:05:16.375 12:32:49 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:16.375 12:32:49 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:16.375 12:32:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.375 12:32:49 -- common/autotest_common.sh@10 -- # set +x 00:05:16.375 ************************************ 00:05:16.375 START TEST accel_dif_verify 00:05:16.375 ************************************ 00:05:16.375 12:32:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:16.375 12:32:49 -- accel/accel.sh@16 -- # local accel_opc 00:05:16.375 12:32:49 -- accel/accel.sh@17 -- # local accel_module 00:05:16.375 12:32:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:16.375 12:32:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:16.375 12:32:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:16.375 12:32:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:16.375 12:32:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:16.375 12:32:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:16.375 12:32:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:16.375 12:32:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:16.375 12:32:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:16.375 12:32:49 -- accel/accel.sh@42 -- # jq -r . 00:05:16.375 [2024-11-20 12:32:49.197761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.375 [2024-11-20 12:32:49.197853] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3412017 ] 00:05:16.375 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.375 [2024-11-20 12:32:49.261274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.375 [2024-11-20 12:32:49.381747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.749 12:32:50 -- accel/accel.sh@18 -- # out=' 00:05:17.749 SPDK Configuration: 00:05:17.749 Core mask: 0x1 00:05:17.749 00:05:17.749 Accel Perf Configuration: 00:05:17.749 Workload Type: dif_verify 00:05:17.749 Vector size: 4096 bytes 00:05:17.749 Transfer size: 4096 bytes 00:05:17.749 Block size: 512 bytes 00:05:17.749 Metadata size: 8 bytes 00:05:17.749 Vector count 1 00:05:17.749 Module: software 00:05:17.749 Queue depth: 32 00:05:17.749 Allocate depth: 32 00:05:17.749 # threads/core: 1 00:05:17.749 Run time: 1 seconds 00:05:17.749 Verify: No 00:05:17.749 00:05:17.749 Running for 1 seconds... 00:05:17.749 00:05:17.749 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:17.749 ------------------------------------------------------------------------------------ 00:05:17.749 0,0 81888/s 324 MiB/s 0 0 00:05:17.749 ==================================================================================== 00:05:17.749 Total 81888/s 319 MiB/s 0 0' 00:05:17.749 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:17.749 12:32:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:17.749 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:17.749 12:32:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:17.749 12:32:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:17.749 12:32:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:17.749 12:32:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:17.749 12:32:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:17.749 12:32:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:17.749 12:32:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:17.749 12:32:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:17.749 12:32:50 -- accel/accel.sh@42 -- # jq -r . 00:05:17.749 [2024-11-20 12:32:50.686007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.749 [2024-11-20 12:32:50.686109] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3412158 ] 00:05:17.749 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.749 [2024-11-20 12:32:50.749456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.008 [2024-11-20 12:32:50.869143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=0x1 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=dif_verify 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=software 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@23 -- # accel_module=software 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=32 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=32 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=1 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val=No 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.008 12:32:50 -- accel/accel.sh@21 -- # val= 00:05:18.008 12:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.008 12:32:50 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@21 -- # val= 00:05:19.383 12:32:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # IFS=: 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@21 -- # val= 00:05:19.383 12:32:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # IFS=: 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@21 -- # val= 00:05:19.383 12:32:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # IFS=: 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@21 -- # val= 00:05:19.383 12:32:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # IFS=: 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@21 -- # val= 00:05:19.383 12:32:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # IFS=: 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@21 -- # val= 00:05:19.383 12:32:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # IFS=: 00:05:19.383 12:32:52 -- accel/accel.sh@20 -- # read -r var val 00:05:19.383 12:32:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:19.383 12:32:52 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:19.383 12:32:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:19.383 00:05:19.383 real 0m2.974s 00:05:19.383 user 0m2.677s 00:05:19.383 sys 0m0.290s 00:05:19.383 12:32:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.383 12:32:52 -- common/autotest_common.sh@10 -- # set +x 00:05:19.383 ************************************ 00:05:19.383 END TEST accel_dif_verify 00:05:19.383 ************************************ 00:05:19.383 12:32:52 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:19.383 12:32:52 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:19.383 12:32:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.383 12:32:52 -- common/autotest_common.sh@10 -- # set +x 00:05:19.383 ************************************ 00:05:19.383 START TEST accel_dif_generate 00:05:19.383 ************************************ 00:05:19.383 12:32:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:19.383 12:32:52 -- accel/accel.sh@16 -- # local accel_opc 00:05:19.383 12:32:52 -- accel/accel.sh@17 -- # local accel_module 00:05:19.383 12:32:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:19.383 12:32:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:19.383 12:32:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.383 12:32:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.383 12:32:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.383 12:32:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.383 12:32:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.383 12:32:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.383 12:32:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.383 12:32:52 -- accel/accel.sh@42 -- # jq -r . 00:05:19.383 [2024-11-20 12:32:52.196504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.383 [2024-11-20 12:32:52.196593] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3412436 ] 00:05:19.383 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.383 [2024-11-20 12:32:52.263116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.383 [2024-11-20 12:32:52.381003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.756 12:32:53 -- accel/accel.sh@18 -- # out=' 00:05:20.756 SPDK Configuration: 00:05:20.756 Core mask: 0x1 00:05:20.756 00:05:20.756 Accel Perf Configuration: 00:05:20.756 Workload Type: dif_generate 00:05:20.756 Vector size: 4096 bytes 00:05:20.756 Transfer size: 4096 bytes 00:05:20.756 Block size: 512 bytes 00:05:20.756 Metadata size: 8 bytes 00:05:20.756 Vector count 1 00:05:20.756 Module: software 00:05:20.756 Queue depth: 32 00:05:20.756 Allocate depth: 32 00:05:20.756 # threads/core: 1 00:05:20.756 Run time: 1 seconds 00:05:20.756 Verify: No 00:05:20.756 00:05:20.756 Running for 1 seconds... 00:05:20.756 00:05:20.756 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:20.756 ------------------------------------------------------------------------------------ 00:05:20.756 0,0 96416/s 382 MiB/s 0 0 00:05:20.756 ==================================================================================== 00:05:20.756 Total 96416/s 376 MiB/s 0 0' 00:05:20.756 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:20.756 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:20.756 12:32:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:20.756 12:32:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:20.756 12:32:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:20.756 12:32:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:20.756 12:32:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:20.756 12:32:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:20.756 12:32:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:20.756 12:32:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:20.756 12:32:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:20.756 12:32:53 -- accel/accel.sh@42 -- # jq -r . 00:05:20.756 [2024-11-20 12:32:53.678846] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.756 [2024-11-20 12:32:53.678940] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3412581 ] 00:05:20.756 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.756 [2024-11-20 12:32:53.747749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.015 [2024-11-20 12:32:53.865326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=0x1 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=dif_generate 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=software 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@23 -- # accel_module=software 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=32 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=32 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=1 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val=No 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.015 12:32:53 -- accel/accel.sh@21 -- # val= 00:05:21.015 12:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.015 12:32:53 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@21 -- # val= 00:05:22.389 12:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # IFS=: 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@21 -- # val= 00:05:22.389 12:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # IFS=: 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@21 -- # val= 00:05:22.389 12:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # IFS=: 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@21 -- # val= 00:05:22.389 12:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # IFS=: 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@21 -- # val= 00:05:22.389 12:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # IFS=: 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@21 -- # val= 00:05:22.389 12:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # IFS=: 00:05:22.389 12:32:55 -- accel/accel.sh@20 -- # read -r var val 00:05:22.389 12:32:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:22.389 12:32:55 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:22.389 12:32:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:22.389 00:05:22.389 real 0m2.963s 00:05:22.389 user 0m2.668s 00:05:22.389 sys 0m0.288s 00:05:22.389 12:32:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.389 12:32:55 -- common/autotest_common.sh@10 -- # set +x 00:05:22.389 ************************************ 00:05:22.389 END TEST accel_dif_generate 00:05:22.389 ************************************ 00:05:22.389 12:32:55 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:22.389 12:32:55 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:22.389 12:32:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.389 12:32:55 -- common/autotest_common.sh@10 -- # set +x 00:05:22.389 ************************************ 00:05:22.389 START TEST accel_dif_generate_copy 00:05:22.389 ************************************ 00:05:22.389 12:32:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:22.389 12:32:55 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.389 12:32:55 -- accel/accel.sh@17 -- # local accel_module 00:05:22.389 12:32:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:22.389 12:32:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:22.389 12:32:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.389 12:32:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.389 12:32:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.389 12:32:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.389 12:32:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.389 12:32:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.389 12:32:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.389 12:32:55 -- accel/accel.sh@42 -- # jq -r . 00:05:22.389 [2024-11-20 12:32:55.183122] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.389 [2024-11-20 12:32:55.183212] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3412745 ] 00:05:22.389 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.389 [2024-11-20 12:32:55.247839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.389 [2024-11-20 12:32:55.366742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.762 12:32:56 -- accel/accel.sh@18 -- # out=' 00:05:23.762 SPDK Configuration: 00:05:23.762 Core mask: 0x1 00:05:23.762 00:05:23.762 Accel Perf Configuration: 00:05:23.762 Workload Type: dif_generate_copy 00:05:23.762 Vector size: 4096 bytes 00:05:23.762 Transfer size: 4096 bytes 00:05:23.762 Vector count 1 00:05:23.762 Module: software 00:05:23.762 Queue depth: 32 00:05:23.762 Allocate depth: 32 00:05:23.762 # threads/core: 1 00:05:23.762 Run time: 1 seconds 00:05:23.762 Verify: No 00:05:23.762 00:05:23.762 Running for 1 seconds... 00:05:23.762 00:05:23.762 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:23.762 ------------------------------------------------------------------------------------ 00:05:23.762 0,0 76288/s 302 MiB/s 0 0 00:05:23.762 ==================================================================================== 00:05:23.762 Total 76288/s 298 MiB/s 0 0' 00:05:23.762 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:23.762 12:32:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:23.762 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:23.762 12:32:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:23.762 12:32:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:23.762 12:32:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.762 12:32:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.762 12:32:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.762 12:32:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.762 12:32:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.762 12:32:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.762 12:32:56 -- accel/accel.sh@42 -- # jq -r . 00:05:23.762 [2024-11-20 12:32:56.660842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.762 [2024-11-20 12:32:56.660933] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3413004 ] 00:05:23.762 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.762 [2024-11-20 12:32:56.726796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.762 [2024-11-20 12:32:56.846427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=0x1 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=software 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=32 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=32 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=1 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val=No 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:24.021 12:32:56 -- accel/accel.sh@21 -- # val= 00:05:24.021 12:32:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # IFS=: 00:05:24.021 12:32:56 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@21 -- # val= 00:05:25.398 12:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # IFS=: 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@21 -- # val= 00:05:25.398 12:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # IFS=: 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@21 -- # val= 00:05:25.398 12:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # IFS=: 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@21 -- # val= 00:05:25.398 12:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # IFS=: 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@21 -- # val= 00:05:25.398 12:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # IFS=: 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@21 -- # val= 00:05:25.398 12:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # IFS=: 00:05:25.398 12:32:58 -- accel/accel.sh@20 -- # read -r var val 00:05:25.398 12:32:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:25.398 12:32:58 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:25.398 12:32:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:25.398 00:05:25.398 real 0m2.959s 00:05:25.398 user 0m2.659s 00:05:25.398 sys 0m0.291s 00:05:25.398 12:32:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.398 12:32:58 -- common/autotest_common.sh@10 -- # set +x 00:05:25.398 ************************************ 00:05:25.398 END TEST accel_dif_generate_copy 00:05:25.398 ************************************ 00:05:25.398 12:32:58 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:25.398 12:32:58 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:25.398 12:32:58 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:25.398 12:32:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.398 12:32:58 -- common/autotest_common.sh@10 -- # set +x 00:05:25.398 ************************************ 00:05:25.398 START TEST accel_comp 00:05:25.398 ************************************ 00:05:25.398 12:32:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:25.398 12:32:58 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.398 12:32:58 -- accel/accel.sh@17 -- # local accel_module 00:05:25.398 12:32:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:25.398 12:32:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:25.398 12:32:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.398 12:32:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.398 12:32:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.398 12:32:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.398 12:32:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.398 12:32:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.398 12:32:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.398 12:32:58 -- accel/accel.sh@42 -- # jq -r . 00:05:25.398 [2024-11-20 12:32:58.169104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.398 [2024-11-20 12:32:58.169207] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3413167 ] 00:05:25.398 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.398 [2024-11-20 12:32:58.231806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.398 [2024-11-20 12:32:58.352284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.837 12:32:59 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:26.838 00:05:26.838 SPDK Configuration: 00:05:26.838 Core mask: 0x1 00:05:26.838 00:05:26.838 Accel Perf Configuration: 00:05:26.838 Workload Type: compress 00:05:26.838 Transfer size: 4096 bytes 00:05:26.838 Vector count 1 00:05:26.838 Module: software 00:05:26.838 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:26.838 Queue depth: 32 00:05:26.838 Allocate depth: 32 00:05:26.838 # threads/core: 1 00:05:26.838 Run time: 1 seconds 00:05:26.838 Verify: No 00:05:26.838 00:05:26.838 Running for 1 seconds... 00:05:26.838 00:05:26.838 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:26.838 ------------------------------------------------------------------------------------ 00:05:26.838 0,0 31488/s 131 MiB/s 0 0 00:05:26.838 ==================================================================================== 00:05:26.838 Total 31488/s 123 MiB/s 0 0' 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:26.838 12:32:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.838 12:32:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.838 12:32:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.838 12:32:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.838 12:32:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.838 12:32:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.838 12:32:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.838 12:32:59 -- accel/accel.sh@42 -- # jq -r . 00:05:26.838 [2024-11-20 12:32:59.654411] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.838 [2024-11-20 12:32:59.654487] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3413316 ] 00:05:26.838 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.838 [2024-11-20 12:32:59.712890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.838 [2024-11-20 12:32:59.832657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=0x1 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=compress 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=software 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@23 -- # accel_module=software 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=32 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=32 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=1 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val=No 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 12:32:59 -- accel/accel.sh@21 -- # val= 00:05:26.838 12:32:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 12:32:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.212 12:33:01 -- accel/accel.sh@21 -- # val= 00:05:28.212 12:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.212 12:33:01 -- accel/accel.sh@20 -- # IFS=: 00:05:28.212 12:33:01 -- accel/accel.sh@20 -- # read -r var val 00:05:28.212 12:33:01 -- accel/accel.sh@21 -- # val= 00:05:28.212 12:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.212 12:33:01 -- accel/accel.sh@20 -- # IFS=: 00:05:28.212 12:33:01 -- accel/accel.sh@20 -- # read -r var val 00:05:28.212 12:33:01 -- accel/accel.sh@21 -- # val= 00:05:28.213 12:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # IFS=: 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # read -r var val 00:05:28.213 12:33:01 -- accel/accel.sh@21 -- # val= 00:05:28.213 12:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # IFS=: 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # read -r var val 00:05:28.213 12:33:01 -- accel/accel.sh@21 -- # val= 00:05:28.213 12:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # IFS=: 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # read -r var val 00:05:28.213 12:33:01 -- accel/accel.sh@21 -- # val= 00:05:28.213 12:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # IFS=: 00:05:28.213 12:33:01 -- accel/accel.sh@20 -- # read -r var val 00:05:28.213 12:33:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.213 12:33:01 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:28.213 12:33:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.213 00:05:28.213 real 0m2.965s 00:05:28.213 user 0m2.665s 00:05:28.213 sys 0m0.292s 00:05:28.213 12:33:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.213 12:33:01 -- common/autotest_common.sh@10 -- # set +x 00:05:28.213 ************************************ 00:05:28.213 END TEST accel_comp 00:05:28.213 ************************************ 00:05:28.213 12:33:01 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.213 12:33:01 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:28.213 12:33:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.213 12:33:01 -- common/autotest_common.sh@10 -- # set +x 00:05:28.213 ************************************ 00:05:28.213 START TEST accel_decomp 00:05:28.213 ************************************ 00:05:28.213 12:33:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.213 12:33:01 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.213 12:33:01 -- accel/accel.sh@17 -- # local accel_module 00:05:28.213 12:33:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.213 12:33:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.213 12:33:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.213 12:33:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.213 12:33:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.213 12:33:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.213 12:33:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.213 12:33:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.213 12:33:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.213 12:33:01 -- accel/accel.sh@42 -- # jq -r . 00:05:28.213 [2024-11-20 12:33:01.156446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.213 [2024-11-20 12:33:01.156534] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3413663 ] 00:05:28.213 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.213 [2024-11-20 12:33:01.219080] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.472 [2024-11-20 12:33:01.339616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.847 12:33:02 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:29.847 00:05:29.847 SPDK Configuration: 00:05:29.847 Core mask: 0x1 00:05:29.847 00:05:29.847 Accel Perf Configuration: 00:05:29.847 Workload Type: decompress 00:05:29.847 Transfer size: 4096 bytes 00:05:29.847 Vector count 1 00:05:29.847 Module: software 00:05:29.847 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:29.847 Queue depth: 32 00:05:29.847 Allocate depth: 32 00:05:29.847 # threads/core: 1 00:05:29.847 Run time: 1 seconds 00:05:29.847 Verify: Yes 00:05:29.847 00:05:29.847 Running for 1 seconds... 00:05:29.847 00:05:29.847 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:29.847 ------------------------------------------------------------------------------------ 00:05:29.847 0,0 55424/s 102 MiB/s 0 0 00:05:29.847 ==================================================================================== 00:05:29.847 Total 55424/s 216 MiB/s 0 0' 00:05:29.847 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.847 12:33:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.847 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.847 12:33:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.847 12:33:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.847 12:33:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.847 12:33:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.847 12:33:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.847 12:33:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.847 12:33:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.847 12:33:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.847 12:33:02 -- accel/accel.sh@42 -- # jq -r . 00:05:29.847 [2024-11-20 12:33:02.644336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.847 [2024-11-20 12:33:02.644429] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3413848 ] 00:05:29.847 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.847 [2024-11-20 12:33:02.707745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.848 [2024-11-20 12:33:02.826466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=0x1 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=decompress 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=software 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@23 -- # accel_module=software 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=32 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=32 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=1 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val=Yes 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:29.848 12:33:02 -- accel/accel.sh@21 -- # val= 00:05:29.848 12:33:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # IFS=: 00:05:29.848 12:33:02 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@21 -- # val= 00:05:31.223 12:33:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # IFS=: 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@21 -- # val= 00:05:31.223 12:33:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # IFS=: 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@21 -- # val= 00:05:31.223 12:33:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # IFS=: 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@21 -- # val= 00:05:31.223 12:33:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # IFS=: 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@21 -- # val= 00:05:31.223 12:33:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # IFS=: 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@21 -- # val= 00:05:31.223 12:33:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # IFS=: 00:05:31.223 12:33:04 -- accel/accel.sh@20 -- # read -r var val 00:05:31.223 12:33:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.223 12:33:04 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:31.223 12:33:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.223 00:05:31.223 real 0m2.975s 00:05:31.223 user 0m2.680s 00:05:31.223 sys 0m0.284s 00:05:31.223 12:33:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.223 12:33:04 -- common/autotest_common.sh@10 -- # set +x 00:05:31.223 ************************************ 00:05:31.223 END TEST accel_decomp 00:05:31.223 ************************************ 00:05:31.223 12:33:04 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:31.223 12:33:04 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:31.223 12:33:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.223 12:33:04 -- common/autotest_common.sh@10 -- # set +x 00:05:31.223 ************************************ 00:05:31.223 START TEST accel_decmop_full 00:05:31.223 ************************************ 00:05:31.223 12:33:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:31.223 12:33:04 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.223 12:33:04 -- accel/accel.sh@17 -- # local accel_module 00:05:31.223 12:33:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:31.223 12:33:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:31.223 12:33:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.223 12:33:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.223 12:33:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.223 12:33:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.223 12:33:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.223 12:33:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.223 12:33:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.223 12:33:04 -- accel/accel.sh@42 -- # jq -r . 00:05:31.223 [2024-11-20 12:33:04.156515] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.223 [2024-11-20 12:33:04.156607] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3414012 ] 00:05:31.223 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.223 [2024-11-20 12:33:04.219121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.481 [2024-11-20 12:33:04.339619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.855 12:33:05 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:32.855 00:05:32.855 SPDK Configuration: 00:05:32.855 Core mask: 0x1 00:05:32.855 00:05:32.855 Accel Perf Configuration: 00:05:32.855 Workload Type: decompress 00:05:32.855 Transfer size: 111250 bytes 00:05:32.855 Vector count 1 00:05:32.855 Module: software 00:05:32.855 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:32.855 Queue depth: 32 00:05:32.855 Allocate depth: 32 00:05:32.855 # threads/core: 1 00:05:32.855 Run time: 1 seconds 00:05:32.855 Verify: Yes 00:05:32.855 00:05:32.855 Running for 1 seconds... 00:05:32.855 00:05:32.855 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:32.855 ------------------------------------------------------------------------------------ 00:05:32.855 0,0 3776/s 155 MiB/s 0 0 00:05:32.855 ==================================================================================== 00:05:32.855 Total 3776/s 400 MiB/s 0 0' 00:05:32.855 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.855 12:33:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:32.855 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.855 12:33:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:32.855 12:33:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.856 12:33:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.856 12:33:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.856 12:33:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.856 12:33:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.856 12:33:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.856 12:33:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.856 12:33:05 -- accel/accel.sh@42 -- # jq -r . 00:05:32.856 [2024-11-20 12:33:05.636621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.856 [2024-11-20 12:33:05.636712] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3414275 ] 00:05:32.856 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.856 [2024-11-20 12:33:05.701250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.856 [2024-11-20 12:33:05.821537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=0x1 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=decompress 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=software 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@23 -- # accel_module=software 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=32 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=32 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=1 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val=Yes 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:32.856 12:33:05 -- accel/accel.sh@21 -- # val= 00:05:32.856 12:33:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # IFS=: 00:05:32.856 12:33:05 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@21 -- # val= 00:05:34.228 12:33:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # IFS=: 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@21 -- # val= 00:05:34.228 12:33:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # IFS=: 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@21 -- # val= 00:05:34.228 12:33:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # IFS=: 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@21 -- # val= 00:05:34.228 12:33:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # IFS=: 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@21 -- # val= 00:05:34.228 12:33:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # IFS=: 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@21 -- # val= 00:05:34.228 12:33:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # IFS=: 00:05:34.228 12:33:07 -- accel/accel.sh@20 -- # read -r var val 00:05:34.228 12:33:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.228 12:33:07 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:34.228 12:33:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.228 00:05:34.228 real 0m2.979s 00:05:34.228 user 0m2.690s 00:05:34.228 sys 0m0.279s 00:05:34.228 12:33:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.228 12:33:07 -- common/autotest_common.sh@10 -- # set +x 00:05:34.228 ************************************ 00:05:34.228 END TEST accel_decmop_full 00:05:34.228 ************************************ 00:05:34.228 12:33:07 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:34.228 12:33:07 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:34.228 12:33:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.228 12:33:07 -- common/autotest_common.sh@10 -- # set +x 00:05:34.228 ************************************ 00:05:34.228 START TEST accel_decomp_mcore 00:05:34.228 ************************************ 00:05:34.228 12:33:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:34.228 12:33:07 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.228 12:33:07 -- accel/accel.sh@17 -- # local accel_module 00:05:34.228 12:33:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:34.228 12:33:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:34.228 12:33:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.228 12:33:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.228 12:33:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.228 12:33:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.228 12:33:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.228 12:33:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.228 12:33:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.228 12:33:07 -- accel/accel.sh@42 -- # jq -r . 00:05:34.228 [2024-11-20 12:33:07.160331] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.228 [2024-11-20 12:33:07.160423] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3414436 ] 00:05:34.228 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.228 [2024-11-20 12:33:07.223958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:34.487 [2024-11-20 12:33:07.347363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:34.487 [2024-11-20 12:33:07.347417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:34.487 [2024-11-20 12:33:07.347471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:34.487 [2024-11-20 12:33:07.347475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.862 12:33:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:35.862 00:05:35.862 SPDK Configuration: 00:05:35.862 Core mask: 0xf 00:05:35.862 00:05:35.862 Accel Perf Configuration: 00:05:35.862 Workload Type: decompress 00:05:35.862 Transfer size: 4096 bytes 00:05:35.862 Vector count 1 00:05:35.862 Module: software 00:05:35.862 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:35.862 Queue depth: 32 00:05:35.862 Allocate depth: 32 00:05:35.862 # threads/core: 1 00:05:35.862 Run time: 1 seconds 00:05:35.862 Verify: Yes 00:05:35.862 00:05:35.862 Running for 1 seconds... 00:05:35.862 00:05:35.862 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:35.862 ------------------------------------------------------------------------------------ 00:05:35.862 0,0 50272/s 92 MiB/s 0 0 00:05:35.863 3,0 50688/s 93 MiB/s 0 0 00:05:35.863 2,0 50560/s 93 MiB/s 0 0 00:05:35.863 1,0 50464/s 92 MiB/s 0 0 00:05:35.863 ==================================================================================== 00:05:35.863 Total 201984/s 789 MiB/s 0 0' 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:35.863 12:33:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.863 12:33:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.863 12:33:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.863 12:33:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.863 12:33:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.863 12:33:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.863 12:33:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.863 12:33:08 -- accel/accel.sh@42 -- # jq -r . 00:05:35.863 [2024-11-20 12:33:08.657358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.863 [2024-11-20 12:33:08.657449] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3414966 ] 00:05:35.863 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.863 [2024-11-20 12:33:08.719476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:35.863 [2024-11-20 12:33:08.845159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:35.863 [2024-11-20 12:33:08.845214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:35.863 [2024-11-20 12:33:08.845268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:35.863 [2024-11-20 12:33:08.845272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=0xf 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=decompress 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=software 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@23 -- # accel_module=software 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=32 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=32 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=1 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val=Yes 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:35.863 12:33:08 -- accel/accel.sh@21 -- # val= 00:05:35.863 12:33:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # IFS=: 00:05:35.863 12:33:08 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@21 -- # val= 00:05:37.238 12:33:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # IFS=: 00:05:37.238 12:33:10 -- accel/accel.sh@20 -- # read -r var val 00:05:37.238 12:33:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.238 12:33:10 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:37.238 12:33:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.238 00:05:37.238 real 0m2.991s 00:05:37.239 user 0m9.598s 00:05:37.239 sys 0m0.296s 00:05:37.239 12:33:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.239 12:33:10 -- common/autotest_common.sh@10 -- # set +x 00:05:37.239 ************************************ 00:05:37.239 END TEST accel_decomp_mcore 00:05:37.239 ************************************ 00:05:37.239 12:33:10 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:37.239 12:33:10 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:37.239 12:33:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.239 12:33:10 -- common/autotest_common.sh@10 -- # set +x 00:05:37.239 ************************************ 00:05:37.239 START TEST accel_decomp_full_mcore 00:05:37.239 ************************************ 00:05:37.239 12:33:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:37.239 12:33:10 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.239 12:33:10 -- accel/accel.sh@17 -- # local accel_module 00:05:37.239 12:33:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:37.239 12:33:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:37.239 12:33:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.239 12:33:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.239 12:33:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.239 12:33:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.239 12:33:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.239 12:33:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.239 12:33:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.239 12:33:10 -- accel/accel.sh@42 -- # jq -r . 00:05:37.239 [2024-11-20 12:33:10.175692] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.239 [2024-11-20 12:33:10.175778] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3415374 ] 00:05:37.239 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.239 [2024-11-20 12:33:10.243218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:37.499 [2024-11-20 12:33:10.367718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:37.499 [2024-11-20 12:33:10.367741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:37.499 [2024-11-20 12:33:10.367761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:37.499 [2024-11-20 12:33:10.367764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.874 12:33:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:38.874 00:05:38.874 SPDK Configuration: 00:05:38.874 Core mask: 0xf 00:05:38.874 00:05:38.874 Accel Perf Configuration: 00:05:38.874 Workload Type: decompress 00:05:38.874 Transfer size: 111250 bytes 00:05:38.874 Vector count 1 00:05:38.874 Module: software 00:05:38.874 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:38.874 Queue depth: 32 00:05:38.874 Allocate depth: 32 00:05:38.874 # threads/core: 1 00:05:38.874 Run time: 1 seconds 00:05:38.874 Verify: Yes 00:05:38.874 00:05:38.874 Running for 1 seconds... 00:05:38.874 00:05:38.874 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.874 ------------------------------------------------------------------------------------ 00:05:38.874 0,0 4224/s 174 MiB/s 0 0 00:05:38.874 3,0 4224/s 174 MiB/s 0 0 00:05:38.874 2,0 4224/s 174 MiB/s 0 0 00:05:38.874 1,0 4224/s 174 MiB/s 0 0 00:05:38.874 ==================================================================================== 00:05:38.874 Total 16896/s 1792 MiB/s 0 0' 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:38.874 12:33:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.874 12:33:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.874 12:33:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.874 12:33:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.874 12:33:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.874 12:33:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.874 12:33:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.874 12:33:11 -- accel/accel.sh@42 -- # jq -r . 00:05:38.874 [2024-11-20 12:33:11.677392] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.874 [2024-11-20 12:33:11.677485] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3415518 ] 00:05:38.874 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.874 [2024-11-20 12:33:11.740373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:38.874 [2024-11-20 12:33:11.863513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.874 [2024-11-20 12:33:11.863558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.874 [2024-11-20 12:33:11.863612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:38.874 [2024-11-20 12:33:11.863615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=0xf 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=decompress 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=software 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=32 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=32 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=1 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val=Yes 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:38.874 12:33:11 -- accel/accel.sh@21 -- # val= 00:05:38.874 12:33:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # IFS=: 00:05:38.874 12:33:11 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@21 -- # val= 00:05:40.249 12:33:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # IFS=: 00:05:40.249 12:33:13 -- accel/accel.sh@20 -- # read -r var val 00:05:40.249 12:33:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.249 12:33:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:40.249 12:33:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.249 00:05:40.249 real 0m3.012s 00:05:40.249 user 0m9.661s 00:05:40.249 sys 0m0.314s 00:05:40.249 12:33:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.249 12:33:13 -- common/autotest_common.sh@10 -- # set +x 00:05:40.249 ************************************ 00:05:40.249 END TEST accel_decomp_full_mcore 00:05:40.249 ************************************ 00:05:40.249 12:33:13 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:40.249 12:33:13 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:40.249 12:33:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.249 12:33:13 -- common/autotest_common.sh@10 -- # set +x 00:05:40.249 ************************************ 00:05:40.249 START TEST accel_decomp_mthread 00:05:40.249 ************************************ 00:05:40.249 12:33:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:40.249 12:33:13 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.249 12:33:13 -- accel/accel.sh@17 -- # local accel_module 00:05:40.249 12:33:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:40.249 12:33:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:40.249 12:33:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.249 12:33:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.249 12:33:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.249 12:33:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.249 12:33:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.249 12:33:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.249 12:33:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.249 12:33:13 -- accel/accel.sh@42 -- # jq -r . 00:05:40.249 [2024-11-20 12:33:13.217644] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.249 [2024-11-20 12:33:13.217729] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3415680 ] 00:05:40.249 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.249 [2024-11-20 12:33:13.282088] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.508 [2024-11-20 12:33:13.400576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.882 12:33:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:41.882 00:05:41.882 SPDK Configuration: 00:05:41.882 Core mask: 0x1 00:05:41.882 00:05:41.882 Accel Perf Configuration: 00:05:41.882 Workload Type: decompress 00:05:41.882 Transfer size: 4096 bytes 00:05:41.882 Vector count 1 00:05:41.882 Module: software 00:05:41.882 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:41.882 Queue depth: 32 00:05:41.882 Allocate depth: 32 00:05:41.882 # threads/core: 2 00:05:41.882 Run time: 1 seconds 00:05:41.882 Verify: Yes 00:05:41.882 00:05:41.882 Running for 1 seconds... 00:05:41.882 00:05:41.882 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.882 ------------------------------------------------------------------------------------ 00:05:41.882 0,1 28064/s 51 MiB/s 0 0 00:05:41.882 0,0 27936/s 51 MiB/s 0 0 00:05:41.882 ==================================================================================== 00:05:41.882 Total 56000/s 218 MiB/s 0 0' 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:41.882 12:33:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.882 12:33:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.882 12:33:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.882 12:33:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.882 12:33:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.882 12:33:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.882 12:33:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.882 12:33:14 -- accel/accel.sh@42 -- # jq -r . 00:05:41.882 [2024-11-20 12:33:14.699527] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.882 [2024-11-20 12:33:14.699623] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3415944 ] 00:05:41.882 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.882 [2024-11-20 12:33:14.766322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.882 [2024-11-20 12:33:14.886180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=0x1 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=decompress 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=software 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=32 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=32 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=2 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val=Yes 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:41.882 12:33:14 -- accel/accel.sh@21 -- # val= 00:05:41.882 12:33:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # IFS=: 00:05:41.882 12:33:14 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@21 -- # val= 00:05:43.257 12:33:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # IFS=: 00:05:43.257 12:33:16 -- accel/accel.sh@20 -- # read -r var val 00:05:43.257 12:33:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.257 12:33:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:43.257 12:33:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.257 00:05:43.257 real 0m2.970s 00:05:43.257 user 0m2.668s 00:05:43.257 sys 0m0.292s 00:05:43.257 12:33:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.257 12:33:16 -- common/autotest_common.sh@10 -- # set +x 00:05:43.257 ************************************ 00:05:43.257 END TEST accel_decomp_mthread 00:05:43.257 ************************************ 00:05:43.257 12:33:16 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:43.257 12:33:16 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:43.257 12:33:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.257 12:33:16 -- common/autotest_common.sh@10 -- # set +x 00:05:43.257 ************************************ 00:05:43.257 START TEST accel_deomp_full_mthread 00:05:43.257 ************************************ 00:05:43.257 12:33:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:43.257 12:33:16 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.257 12:33:16 -- accel/accel.sh@17 -- # local accel_module 00:05:43.257 12:33:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:43.257 12:33:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:43.257 12:33:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.257 12:33:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.257 12:33:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.257 12:33:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.257 12:33:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.257 12:33:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.257 12:33:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.257 12:33:16 -- accel/accel.sh@42 -- # jq -r . 00:05:43.257 [2024-11-20 12:33:16.211227] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.257 [2024-11-20 12:33:16.211313] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416107 ] 00:05:43.257 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.257 [2024-11-20 12:33:16.277212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.515 [2024-11-20 12:33:16.398771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.888 12:33:17 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:44.888 00:05:44.888 SPDK Configuration: 00:05:44.888 Core mask: 0x1 00:05:44.888 00:05:44.888 Accel Perf Configuration: 00:05:44.888 Workload Type: decompress 00:05:44.888 Transfer size: 111250 bytes 00:05:44.888 Vector count 1 00:05:44.888 Module: software 00:05:44.889 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:44.889 Queue depth: 32 00:05:44.889 Allocate depth: 32 00:05:44.889 # threads/core: 2 00:05:44.889 Run time: 1 seconds 00:05:44.889 Verify: Yes 00:05:44.889 00:05:44.889 Running for 1 seconds... 00:05:44.889 00:05:44.889 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.889 ------------------------------------------------------------------------------------ 00:05:44.889 0,1 1952/s 80 MiB/s 0 0 00:05:44.889 0,0 1920/s 79 MiB/s 0 0 00:05:44.889 ==================================================================================== 00:05:44.889 Total 3872/s 410 MiB/s 0 0' 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:44.889 12:33:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.889 12:33:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.889 12:33:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.889 12:33:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.889 12:33:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.889 12:33:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.889 12:33:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.889 12:33:17 -- accel/accel.sh@42 -- # jq -r . 00:05:44.889 [2024-11-20 12:33:17.739785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.889 [2024-11-20 12:33:17.739881] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416249 ] 00:05:44.889 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.889 [2024-11-20 12:33:17.801796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.889 [2024-11-20 12:33:17.923661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=0x1 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=decompress 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=software 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=32 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=32 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=2 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val=Yes 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:44.889 12:33:17 -- accel/accel.sh@21 -- # val= 00:05:44.889 12:33:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # IFS=: 00:05:44.889 12:33:17 -- accel/accel.sh@20 -- # read -r var val 00:05:46.268 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.268 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.268 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.268 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.268 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.269 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.269 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.269 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.269 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.269 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.269 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.269 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.269 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.269 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.269 12:33:19 -- accel/accel.sh@21 -- # val= 00:05:46.269 12:33:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # IFS=: 00:05:46.269 12:33:19 -- accel/accel.sh@20 -- # read -r var val 00:05:46.269 12:33:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.269 12:33:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:46.269 12:33:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.269 00:05:46.269 real 0m3.045s 00:05:46.269 user 0m2.747s 00:05:46.269 sys 0m0.289s 00:05:46.269 12:33:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.269 12:33:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.269 ************************************ 00:05:46.269 END TEST accel_deomp_full_mthread 00:05:46.269 ************************************ 00:05:46.269 12:33:19 -- accel/accel.sh@116 -- # [[ n == y ]] 00:05:46.269 12:33:19 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:46.269 12:33:19 -- accel/accel.sh@129 -- # build_accel_config 00:05:46.269 12:33:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:46.269 12:33:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.269 12:33:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.269 12:33:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.269 12:33:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.269 12:33:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.269 12:33:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.269 12:33:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.269 12:33:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.269 12:33:19 -- accel/accel.sh@42 -- # jq -r . 00:05:46.269 ************************************ 00:05:46.269 START TEST accel_dif_functional_tests 00:05:46.269 ************************************ 00:05:46.269 12:33:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:46.269 [2024-11-20 12:33:19.300851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.269 [2024-11-20 12:33:19.300934] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416535 ] 00:05:46.269 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.269 [2024-11-20 12:33:19.362138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:46.529 [2024-11-20 12:33:19.485048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:46.529 [2024-11-20 12:33:19.485109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:46.529 [2024-11-20 12:33:19.485264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.529 00:05:46.529 00:05:46.529 CUnit - A unit testing framework for C - Version 2.1-3 00:05:46.529 http://cunit.sourceforge.net/ 00:05:46.529 00:05:46.529 00:05:46.529 Suite: accel_dif 00:05:46.529 Test: verify: DIF generated, GUARD check ...passed 00:05:46.529 Test: verify: DIF generated, APPTAG check ...passed 00:05:46.529 Test: verify: DIF generated, REFTAG check ...passed 00:05:46.529 Test: verify: DIF not generated, GUARD check ...[2024-11-20 12:33:19.587496] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:46.529 [2024-11-20 12:33:19.587571] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:46.529 passed 00:05:46.529 Test: verify: DIF not generated, APPTAG check ...[2024-11-20 12:33:19.587613] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:46.529 [2024-11-20 12:33:19.587642] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:46.529 passed 00:05:46.529 Test: verify: DIF not generated, REFTAG check ...[2024-11-20 12:33:19.587679] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:46.529 [2024-11-20 12:33:19.587707] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:46.529 passed 00:05:46.529 Test: verify: APPTAG correct, APPTAG check ...passed 00:05:46.529 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-20 12:33:19.587784] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:05:46.529 passed 00:05:46.529 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:05:46.529 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:05:46.529 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:05:46.529 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-20 12:33:19.587947] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:05:46.529 passed 00:05:46.529 Test: generate copy: DIF generated, GUARD check ...passed 00:05:46.529 Test: generate copy: DIF generated, APTTAG check ...passed 00:05:46.529 Test: generate copy: DIF generated, REFTAG check ...passed 00:05:46.529 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:05:46.529 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:05:46.529 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:05:46.529 Test: generate copy: iovecs-len validate ...[2024-11-20 12:33:19.588236] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:05:46.529 passed 00:05:46.529 Test: generate copy: buffer alignment validate ...passed 00:05:46.529 00:05:46.529 Run Summary: Type Total Ran Passed Failed Inactive 00:05:46.529 suites 1 1 n/a 0 0 00:05:46.529 tests 20 20 20 0 0 00:05:46.529 asserts 204 204 204 0 n/a 00:05:46.529 00:05:46.529 Elapsed time = 0.003 seconds 00:05:46.788 00:05:46.788 real 0m0.576s 00:05:46.788 user 0m0.853s 00:05:46.788 sys 0m0.191s 00:05:46.788 12:33:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.788 12:33:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.788 ************************************ 00:05:46.788 END TEST accel_dif_functional_tests 00:05:46.788 ************************************ 00:05:46.788 00:05:46.788 real 1m3.169s 00:05:46.788 user 1m10.925s 00:05:46.788 sys 0m7.256s 00:05:46.788 12:33:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.788 12:33:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.788 ************************************ 00:05:46.788 END TEST accel 00:05:46.788 ************************************ 00:05:46.788 12:33:19 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:46.788 12:33:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.788 12:33:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.788 12:33:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.788 ************************************ 00:05:46.788 START TEST accel_rpc 00:05:46.788 ************************************ 00:05:47.045 12:33:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:47.045 * Looking for test storage... 00:05:47.045 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:47.045 12:33:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:47.045 12:33:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:47.045 12:33:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:47.045 12:33:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:47.045 12:33:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:47.045 12:33:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:47.045 12:33:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:47.045 12:33:20 -- scripts/common.sh@335 -- # IFS=.-: 00:05:47.045 12:33:20 -- scripts/common.sh@335 -- # read -ra ver1 00:05:47.045 12:33:20 -- scripts/common.sh@336 -- # IFS=.-: 00:05:47.045 12:33:20 -- scripts/common.sh@336 -- # read -ra ver2 00:05:47.045 12:33:20 -- scripts/common.sh@337 -- # local 'op=<' 00:05:47.045 12:33:20 -- scripts/common.sh@339 -- # ver1_l=2 00:05:47.045 12:33:20 -- scripts/common.sh@340 -- # ver2_l=1 00:05:47.045 12:33:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:47.045 12:33:20 -- scripts/common.sh@343 -- # case "$op" in 00:05:47.045 12:33:20 -- scripts/common.sh@344 -- # : 1 00:05:47.045 12:33:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:47.045 12:33:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:47.045 12:33:20 -- scripts/common.sh@364 -- # decimal 1 00:05:47.045 12:33:20 -- scripts/common.sh@352 -- # local d=1 00:05:47.045 12:33:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:47.045 12:33:20 -- scripts/common.sh@354 -- # echo 1 00:05:47.045 12:33:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:47.045 12:33:20 -- scripts/common.sh@365 -- # decimal 2 00:05:47.045 12:33:20 -- scripts/common.sh@352 -- # local d=2 00:05:47.045 12:33:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:47.045 12:33:20 -- scripts/common.sh@354 -- # echo 2 00:05:47.045 12:33:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:47.045 12:33:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:47.045 12:33:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:47.045 12:33:20 -- scripts/common.sh@367 -- # return 0 00:05:47.045 12:33:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:47.045 12:33:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:47.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.045 --rc genhtml_branch_coverage=1 00:05:47.045 --rc genhtml_function_coverage=1 00:05:47.045 --rc genhtml_legend=1 00:05:47.045 --rc geninfo_all_blocks=1 00:05:47.045 --rc geninfo_unexecuted_blocks=1 00:05:47.045 00:05:47.045 ' 00:05:47.045 12:33:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:47.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.045 --rc genhtml_branch_coverage=1 00:05:47.045 --rc genhtml_function_coverage=1 00:05:47.045 --rc genhtml_legend=1 00:05:47.045 --rc geninfo_all_blocks=1 00:05:47.045 --rc geninfo_unexecuted_blocks=1 00:05:47.045 00:05:47.046 ' 00:05:47.046 12:33:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:47.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.046 --rc genhtml_branch_coverage=1 00:05:47.046 --rc genhtml_function_coverage=1 00:05:47.046 --rc genhtml_legend=1 00:05:47.046 --rc geninfo_all_blocks=1 00:05:47.046 --rc geninfo_unexecuted_blocks=1 00:05:47.046 00:05:47.046 ' 00:05:47.046 12:33:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:47.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:47.046 --rc genhtml_branch_coverage=1 00:05:47.046 --rc genhtml_function_coverage=1 00:05:47.046 --rc genhtml_legend=1 00:05:47.046 --rc geninfo_all_blocks=1 00:05:47.046 --rc geninfo_unexecuted_blocks=1 00:05:47.046 00:05:47.046 ' 00:05:47.046 12:33:20 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:47.046 12:33:20 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3416606 00:05:47.046 12:33:20 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:05:47.046 12:33:20 -- accel/accel_rpc.sh@15 -- # waitforlisten 3416606 00:05:47.046 12:33:20 -- common/autotest_common.sh@829 -- # '[' -z 3416606 ']' 00:05:47.046 12:33:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:47.046 12:33:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:47.046 12:33:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:47.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:47.046 12:33:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:47.046 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.046 [2024-11-20 12:33:20.099215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.046 [2024-11-20 12:33:20.099312] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416606 ] 00:05:47.046 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.303 [2024-11-20 12:33:20.168490] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.303 [2024-11-20 12:33:20.290111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:47.303 [2024-11-20 12:33:20.290284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.303 12:33:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:47.303 12:33:20 -- common/autotest_common.sh@862 -- # return 0 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:05:47.303 12:33:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:47.303 12:33:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.303 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.303 ************************************ 00:05:47.303 START TEST accel_assign_opcode 00:05:47.303 ************************************ 00:05:47.303 12:33:20 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:05:47.303 12:33:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:47.303 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.303 [2024-11-20 12:33:20.334821] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:05:47.303 12:33:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:05:47.303 12:33:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:47.303 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.303 [2024-11-20 12:33:20.342836] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:05:47.303 12:33:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:47.303 12:33:20 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:05:47.303 12:33:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:47.303 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.562 12:33:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:47.562 12:33:20 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:05:47.562 12:33:20 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:05:47.562 12:33:20 -- accel/accel_rpc.sh@42 -- # grep software 00:05:47.562 12:33:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:47.562 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.562 12:33:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:47.562 software 00:05:47.562 00:05:47.562 real 0m0.309s 00:05:47.562 user 0m0.040s 00:05:47.562 sys 0m0.009s 00:05:47.562 12:33:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.562 12:33:20 -- common/autotest_common.sh@10 -- # set +x 00:05:47.562 ************************************ 00:05:47.562 END TEST accel_assign_opcode 00:05:47.562 ************************************ 00:05:47.562 12:33:20 -- accel/accel_rpc.sh@55 -- # killprocess 3416606 00:05:47.562 12:33:20 -- common/autotest_common.sh@936 -- # '[' -z 3416606 ']' 00:05:47.562 12:33:20 -- common/autotest_common.sh@940 -- # kill -0 3416606 00:05:47.562 12:33:20 -- common/autotest_common.sh@941 -- # uname 00:05:47.562 12:33:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.562 12:33:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3416606 00:05:47.820 12:33:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:47.820 12:33:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:47.820 12:33:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3416606' 00:05:47.820 killing process with pid 3416606 00:05:47.820 12:33:20 -- common/autotest_common.sh@955 -- # kill 3416606 00:05:47.820 12:33:20 -- common/autotest_common.sh@960 -- # wait 3416606 00:05:48.080 00:05:48.080 real 0m1.268s 00:05:48.080 user 0m1.176s 00:05:48.080 sys 0m0.473s 00:05:48.080 12:33:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.080 12:33:21 -- common/autotest_common.sh@10 -- # set +x 00:05:48.080 ************************************ 00:05:48.080 END TEST accel_rpc 00:05:48.080 ************************************ 00:05:48.339 12:33:21 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:48.339 12:33:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.339 12:33:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.339 12:33:21 -- common/autotest_common.sh@10 -- # set +x 00:05:48.339 ************************************ 00:05:48.339 START TEST app_cmdline 00:05:48.339 ************************************ 00:05:48.339 12:33:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:48.339 * Looking for test storage... 00:05:48.339 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:05:48.339 12:33:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:48.339 12:33:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:48.339 12:33:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:48.339 12:33:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:48.339 12:33:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:48.339 12:33:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:48.339 12:33:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:48.339 12:33:21 -- scripts/common.sh@335 -- # IFS=.-: 00:05:48.339 12:33:21 -- scripts/common.sh@335 -- # read -ra ver1 00:05:48.339 12:33:21 -- scripts/common.sh@336 -- # IFS=.-: 00:05:48.339 12:33:21 -- scripts/common.sh@336 -- # read -ra ver2 00:05:48.339 12:33:21 -- scripts/common.sh@337 -- # local 'op=<' 00:05:48.339 12:33:21 -- scripts/common.sh@339 -- # ver1_l=2 00:05:48.339 12:33:21 -- scripts/common.sh@340 -- # ver2_l=1 00:05:48.339 12:33:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:48.339 12:33:21 -- scripts/common.sh@343 -- # case "$op" in 00:05:48.339 12:33:21 -- scripts/common.sh@344 -- # : 1 00:05:48.339 12:33:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:48.339 12:33:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:48.339 12:33:21 -- scripts/common.sh@364 -- # decimal 1 00:05:48.339 12:33:21 -- scripts/common.sh@352 -- # local d=1 00:05:48.339 12:33:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:48.339 12:33:21 -- scripts/common.sh@354 -- # echo 1 00:05:48.339 12:33:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:48.339 12:33:21 -- scripts/common.sh@365 -- # decimal 2 00:05:48.339 12:33:21 -- scripts/common.sh@352 -- # local d=2 00:05:48.339 12:33:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:48.339 12:33:21 -- scripts/common.sh@354 -- # echo 2 00:05:48.339 12:33:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:48.339 12:33:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:48.339 12:33:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:48.339 12:33:21 -- scripts/common.sh@367 -- # return 0 00:05:48.339 12:33:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:48.339 12:33:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:48.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.339 --rc genhtml_branch_coverage=1 00:05:48.339 --rc genhtml_function_coverage=1 00:05:48.339 --rc genhtml_legend=1 00:05:48.339 --rc geninfo_all_blocks=1 00:05:48.339 --rc geninfo_unexecuted_blocks=1 00:05:48.339 00:05:48.339 ' 00:05:48.339 12:33:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:48.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.339 --rc genhtml_branch_coverage=1 00:05:48.339 --rc genhtml_function_coverage=1 00:05:48.339 --rc genhtml_legend=1 00:05:48.339 --rc geninfo_all_blocks=1 00:05:48.339 --rc geninfo_unexecuted_blocks=1 00:05:48.339 00:05:48.339 ' 00:05:48.339 12:33:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:48.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.339 --rc genhtml_branch_coverage=1 00:05:48.339 --rc genhtml_function_coverage=1 00:05:48.339 --rc genhtml_legend=1 00:05:48.339 --rc geninfo_all_blocks=1 00:05:48.339 --rc geninfo_unexecuted_blocks=1 00:05:48.339 00:05:48.339 ' 00:05:48.339 12:33:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:48.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.339 --rc genhtml_branch_coverage=1 00:05:48.339 --rc genhtml_function_coverage=1 00:05:48.339 --rc genhtml_legend=1 00:05:48.339 --rc geninfo_all_blocks=1 00:05:48.340 --rc geninfo_unexecuted_blocks=1 00:05:48.340 00:05:48.340 ' 00:05:48.340 12:33:21 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:05:48.340 12:33:21 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3416911 00:05:48.340 12:33:21 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:05:48.340 12:33:21 -- app/cmdline.sh@18 -- # waitforlisten 3416911 00:05:48.340 12:33:21 -- common/autotest_common.sh@829 -- # '[' -z 3416911 ']' 00:05:48.340 12:33:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:48.340 12:33:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:48.340 12:33:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:48.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:48.340 12:33:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:48.340 12:33:21 -- common/autotest_common.sh@10 -- # set +x 00:05:48.340 [2024-11-20 12:33:21.382254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.340 [2024-11-20 12:33:21.382347] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416911 ] 00:05:48.340 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.340 [2024-11-20 12:33:21.439383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.598 [2024-11-20 12:33:21.546378] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:48.598 [2024-11-20 12:33:21.546559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.532 12:33:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:49.532 12:33:22 -- common/autotest_common.sh@862 -- # return 0 00:05:49.532 12:33:22 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:05:49.790 { 00:05:49.790 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:05:49.790 "fields": { 00:05:49.790 "major": 24, 00:05:49.790 "minor": 1, 00:05:49.790 "patch": 1, 00:05:49.790 "suffix": "-pre", 00:05:49.790 "commit": "c13c99a5e" 00:05:49.790 } 00:05:49.790 } 00:05:49.790 12:33:22 -- app/cmdline.sh@22 -- # expected_methods=() 00:05:49.790 12:33:22 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:05:49.790 12:33:22 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:05:49.790 12:33:22 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:05:49.790 12:33:22 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:05:49.790 12:33:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.790 12:33:22 -- common/autotest_common.sh@10 -- # set +x 00:05:49.790 12:33:22 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:05:49.790 12:33:22 -- app/cmdline.sh@26 -- # sort 00:05:49.790 12:33:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.790 12:33:22 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:05:49.790 12:33:22 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:05:49.790 12:33:22 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:49.790 12:33:22 -- common/autotest_common.sh@650 -- # local es=0 00:05:49.790 12:33:22 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:49.790 12:33:22 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:49.790 12:33:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:49.790 12:33:22 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:49.790 12:33:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:49.790 12:33:22 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:49.790 12:33:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:49.790 12:33:22 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:49.790 12:33:22 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:05:49.790 12:33:22 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:50.047 request: 00:05:50.047 { 00:05:50.048 "method": "env_dpdk_get_mem_stats", 00:05:50.048 "req_id": 1 00:05:50.048 } 00:05:50.048 Got JSON-RPC error response 00:05:50.048 response: 00:05:50.048 { 00:05:50.048 "code": -32601, 00:05:50.048 "message": "Method not found" 00:05:50.048 } 00:05:50.048 12:33:23 -- common/autotest_common.sh@653 -- # es=1 00:05:50.048 12:33:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:50.048 12:33:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:50.048 12:33:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:50.048 12:33:23 -- app/cmdline.sh@1 -- # killprocess 3416911 00:05:50.048 12:33:23 -- common/autotest_common.sh@936 -- # '[' -z 3416911 ']' 00:05:50.048 12:33:23 -- common/autotest_common.sh@940 -- # kill -0 3416911 00:05:50.048 12:33:23 -- common/autotest_common.sh@941 -- # uname 00:05:50.048 12:33:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:50.048 12:33:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3416911 00:05:50.048 12:33:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:50.048 12:33:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:50.048 12:33:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3416911' 00:05:50.048 killing process with pid 3416911 00:05:50.048 12:33:23 -- common/autotest_common.sh@955 -- # kill 3416911 00:05:50.048 12:33:23 -- common/autotest_common.sh@960 -- # wait 3416911 00:05:50.614 00:05:50.614 real 0m2.342s 00:05:50.614 user 0m3.008s 00:05:50.614 sys 0m0.531s 00:05:50.614 12:33:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.614 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.614 ************************************ 00:05:50.614 END TEST app_cmdline 00:05:50.614 ************************************ 00:05:50.614 12:33:23 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:05:50.614 12:33:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.614 12:33:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.614 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.614 ************************************ 00:05:50.614 START TEST version 00:05:50.614 ************************************ 00:05:50.614 12:33:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:05:50.614 * Looking for test storage... 00:05:50.614 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:05:50.614 12:33:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:50.614 12:33:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:50.614 12:33:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:50.614 12:33:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:50.614 12:33:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:50.614 12:33:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:50.614 12:33:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:50.614 12:33:23 -- scripts/common.sh@335 -- # IFS=.-: 00:05:50.614 12:33:23 -- scripts/common.sh@335 -- # read -ra ver1 00:05:50.614 12:33:23 -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.614 12:33:23 -- scripts/common.sh@336 -- # read -ra ver2 00:05:50.614 12:33:23 -- scripts/common.sh@337 -- # local 'op=<' 00:05:50.614 12:33:23 -- scripts/common.sh@339 -- # ver1_l=2 00:05:50.614 12:33:23 -- scripts/common.sh@340 -- # ver2_l=1 00:05:50.614 12:33:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:50.614 12:33:23 -- scripts/common.sh@343 -- # case "$op" in 00:05:50.614 12:33:23 -- scripts/common.sh@344 -- # : 1 00:05:50.614 12:33:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:50.614 12:33:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.614 12:33:23 -- scripts/common.sh@364 -- # decimal 1 00:05:50.614 12:33:23 -- scripts/common.sh@352 -- # local d=1 00:05:50.614 12:33:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.614 12:33:23 -- scripts/common.sh@354 -- # echo 1 00:05:50.614 12:33:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:50.614 12:33:23 -- scripts/common.sh@365 -- # decimal 2 00:05:50.614 12:33:23 -- scripts/common.sh@352 -- # local d=2 00:05:50.615 12:33:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.615 12:33:23 -- scripts/common.sh@354 -- # echo 2 00:05:50.615 12:33:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:50.615 12:33:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:50.615 12:33:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:50.615 12:33:23 -- scripts/common.sh@367 -- # return 0 00:05:50.615 12:33:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.615 12:33:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:50.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.615 --rc genhtml_branch_coverage=1 00:05:50.615 --rc genhtml_function_coverage=1 00:05:50.615 --rc genhtml_legend=1 00:05:50.615 --rc geninfo_all_blocks=1 00:05:50.615 --rc geninfo_unexecuted_blocks=1 00:05:50.615 00:05:50.615 ' 00:05:50.615 12:33:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:50.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.615 --rc genhtml_branch_coverage=1 00:05:50.615 --rc genhtml_function_coverage=1 00:05:50.615 --rc genhtml_legend=1 00:05:50.615 --rc geninfo_all_blocks=1 00:05:50.615 --rc geninfo_unexecuted_blocks=1 00:05:50.615 00:05:50.615 ' 00:05:50.615 12:33:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:50.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.615 --rc genhtml_branch_coverage=1 00:05:50.615 --rc genhtml_function_coverage=1 00:05:50.615 --rc genhtml_legend=1 00:05:50.615 --rc geninfo_all_blocks=1 00:05:50.615 --rc geninfo_unexecuted_blocks=1 00:05:50.615 00:05:50.615 ' 00:05:50.615 12:33:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:50.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.615 --rc genhtml_branch_coverage=1 00:05:50.615 --rc genhtml_function_coverage=1 00:05:50.615 --rc genhtml_legend=1 00:05:50.615 --rc geninfo_all_blocks=1 00:05:50.615 --rc geninfo_unexecuted_blocks=1 00:05:50.615 00:05:50.615 ' 00:05:50.615 12:33:23 -- app/version.sh@17 -- # get_header_version major 00:05:50.615 12:33:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:50.615 12:33:23 -- app/version.sh@14 -- # cut -f2 00:05:50.615 12:33:23 -- app/version.sh@14 -- # tr -d '"' 00:05:50.615 12:33:23 -- app/version.sh@17 -- # major=24 00:05:50.615 12:33:23 -- app/version.sh@18 -- # get_header_version minor 00:05:50.615 12:33:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:50.615 12:33:23 -- app/version.sh@14 -- # cut -f2 00:05:50.615 12:33:23 -- app/version.sh@14 -- # tr -d '"' 00:05:50.615 12:33:23 -- app/version.sh@18 -- # minor=1 00:05:50.615 12:33:23 -- app/version.sh@19 -- # get_header_version patch 00:05:50.615 12:33:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:50.615 12:33:23 -- app/version.sh@14 -- # cut -f2 00:05:50.615 12:33:23 -- app/version.sh@14 -- # tr -d '"' 00:05:50.615 12:33:23 -- app/version.sh@19 -- # patch=1 00:05:50.615 12:33:23 -- app/version.sh@20 -- # get_header_version suffix 00:05:50.615 12:33:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:50.615 12:33:23 -- app/version.sh@14 -- # cut -f2 00:05:50.615 12:33:23 -- app/version.sh@14 -- # tr -d '"' 00:05:50.615 12:33:23 -- app/version.sh@20 -- # suffix=-pre 00:05:50.615 12:33:23 -- app/version.sh@22 -- # version=24.1 00:05:50.615 12:33:23 -- app/version.sh@25 -- # (( patch != 0 )) 00:05:50.615 12:33:23 -- app/version.sh@25 -- # version=24.1.1 00:05:50.615 12:33:23 -- app/version.sh@28 -- # version=24.1.1rc0 00:05:50.615 12:33:23 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:05:50.615 12:33:23 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:05:50.874 12:33:23 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:05:50.874 12:33:23 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:05:50.874 00:05:50.874 real 0m0.190s 00:05:50.874 user 0m0.136s 00:05:50.874 sys 0m0.078s 00:05:50.874 12:33:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.874 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.874 ************************************ 00:05:50.874 END TEST version 00:05:50.874 ************************************ 00:05:50.874 12:33:23 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@191 -- # uname -s 00:05:50.874 12:33:23 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:05:50.874 12:33:23 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:05:50.874 12:33:23 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:05:50.874 12:33:23 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@255 -- # timing_exit lib 00:05:50.874 12:33:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:50.874 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.874 12:33:23 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:05:50.874 12:33:23 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:05:50.874 12:33:23 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:05:50.874 12:33:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:50.874 12:33:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.874 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.874 ************************************ 00:05:50.874 START TEST nvmf_tcp 00:05:50.874 ************************************ 00:05:50.874 12:33:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:05:50.874 * Looking for test storage... 00:05:50.874 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:05:50.874 12:33:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:50.874 12:33:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:50.874 12:33:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:50.874 12:33:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:50.874 12:33:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:50.874 12:33:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:50.874 12:33:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:50.874 12:33:23 -- scripts/common.sh@335 -- # IFS=.-: 00:05:50.874 12:33:23 -- scripts/common.sh@335 -- # read -ra ver1 00:05:50.874 12:33:23 -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.874 12:33:23 -- scripts/common.sh@336 -- # read -ra ver2 00:05:50.874 12:33:23 -- scripts/common.sh@337 -- # local 'op=<' 00:05:50.874 12:33:23 -- scripts/common.sh@339 -- # ver1_l=2 00:05:50.874 12:33:23 -- scripts/common.sh@340 -- # ver2_l=1 00:05:50.874 12:33:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:50.874 12:33:23 -- scripts/common.sh@343 -- # case "$op" in 00:05:50.874 12:33:23 -- scripts/common.sh@344 -- # : 1 00:05:50.874 12:33:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:50.874 12:33:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.874 12:33:23 -- scripts/common.sh@364 -- # decimal 1 00:05:50.874 12:33:23 -- scripts/common.sh@352 -- # local d=1 00:05:50.874 12:33:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.875 12:33:23 -- scripts/common.sh@354 -- # echo 1 00:05:50.875 12:33:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:50.875 12:33:23 -- scripts/common.sh@365 -- # decimal 2 00:05:50.875 12:33:23 -- scripts/common.sh@352 -- # local d=2 00:05:50.875 12:33:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.875 12:33:23 -- scripts/common.sh@354 -- # echo 2 00:05:50.875 12:33:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:50.875 12:33:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:50.875 12:33:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:50.875 12:33:23 -- scripts/common.sh@367 -- # return 0 00:05:50.875 12:33:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.875 12:33:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:50.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.875 --rc genhtml_branch_coverage=1 00:05:50.875 --rc genhtml_function_coverage=1 00:05:50.875 --rc genhtml_legend=1 00:05:50.875 --rc geninfo_all_blocks=1 00:05:50.875 --rc geninfo_unexecuted_blocks=1 00:05:50.875 00:05:50.875 ' 00:05:50.875 12:33:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:50.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.875 --rc genhtml_branch_coverage=1 00:05:50.875 --rc genhtml_function_coverage=1 00:05:50.875 --rc genhtml_legend=1 00:05:50.875 --rc geninfo_all_blocks=1 00:05:50.875 --rc geninfo_unexecuted_blocks=1 00:05:50.875 00:05:50.875 ' 00:05:50.875 12:33:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:50.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.875 --rc genhtml_branch_coverage=1 00:05:50.875 --rc genhtml_function_coverage=1 00:05:50.875 --rc genhtml_legend=1 00:05:50.875 --rc geninfo_all_blocks=1 00:05:50.875 --rc geninfo_unexecuted_blocks=1 00:05:50.875 00:05:50.875 ' 00:05:50.875 12:33:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:50.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.875 --rc genhtml_branch_coverage=1 00:05:50.875 --rc genhtml_function_coverage=1 00:05:50.875 --rc genhtml_legend=1 00:05:50.875 --rc geninfo_all_blocks=1 00:05:50.875 --rc geninfo_unexecuted_blocks=1 00:05:50.875 00:05:50.875 ' 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@10 -- # uname -s 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:50.875 12:33:23 -- nvmf/common.sh@7 -- # uname -s 00:05:50.875 12:33:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:50.875 12:33:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:50.875 12:33:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:50.875 12:33:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:50.875 12:33:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:50.875 12:33:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:50.875 12:33:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:50.875 12:33:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:50.875 12:33:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:50.875 12:33:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:50.875 12:33:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:50.875 12:33:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:50.875 12:33:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:50.875 12:33:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:50.875 12:33:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:05:50.875 12:33:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:50.875 12:33:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:50.875 12:33:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:50.875 12:33:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:50.875 12:33:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.875 12:33:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.875 12:33:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.875 12:33:23 -- paths/export.sh@5 -- # export PATH 00:05:50.875 12:33:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.875 12:33:23 -- nvmf/common.sh@46 -- # : 0 00:05:50.875 12:33:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:50.875 12:33:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:50.875 12:33:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:50.875 12:33:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:50.875 12:33:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:50.875 12:33:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:50.875 12:33:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:50.875 12:33:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:05:50.875 12:33:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:50.875 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:05:50.875 12:33:23 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:05:50.875 12:33:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:50.875 12:33:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.875 12:33:23 -- common/autotest_common.sh@10 -- # set +x 00:05:50.875 ************************************ 00:05:50.875 START TEST nvmf_example 00:05:50.875 ************************************ 00:05:50.875 12:33:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:05:51.141 * Looking for test storage... 00:05:51.141 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:05:51.141 12:33:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:51.141 12:33:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:51.141 12:33:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:51.141 12:33:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:51.141 12:33:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:51.141 12:33:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:51.141 12:33:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:51.141 12:33:24 -- scripts/common.sh@335 -- # IFS=.-: 00:05:51.141 12:33:24 -- scripts/common.sh@335 -- # read -ra ver1 00:05:51.141 12:33:24 -- scripts/common.sh@336 -- # IFS=.-: 00:05:51.141 12:33:24 -- scripts/common.sh@336 -- # read -ra ver2 00:05:51.141 12:33:24 -- scripts/common.sh@337 -- # local 'op=<' 00:05:51.141 12:33:24 -- scripts/common.sh@339 -- # ver1_l=2 00:05:51.141 12:33:24 -- scripts/common.sh@340 -- # ver2_l=1 00:05:51.141 12:33:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:51.141 12:33:24 -- scripts/common.sh@343 -- # case "$op" in 00:05:51.141 12:33:24 -- scripts/common.sh@344 -- # : 1 00:05:51.141 12:33:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:51.141 12:33:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:51.141 12:33:24 -- scripts/common.sh@364 -- # decimal 1 00:05:51.141 12:33:24 -- scripts/common.sh@352 -- # local d=1 00:05:51.141 12:33:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:51.141 12:33:24 -- scripts/common.sh@354 -- # echo 1 00:05:51.141 12:33:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:51.141 12:33:24 -- scripts/common.sh@365 -- # decimal 2 00:05:51.141 12:33:24 -- scripts/common.sh@352 -- # local d=2 00:05:51.141 12:33:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:51.141 12:33:24 -- scripts/common.sh@354 -- # echo 2 00:05:51.141 12:33:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:51.141 12:33:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:51.141 12:33:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:51.141 12:33:24 -- scripts/common.sh@367 -- # return 0 00:05:51.141 12:33:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:51.141 12:33:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:51.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.141 --rc genhtml_branch_coverage=1 00:05:51.141 --rc genhtml_function_coverage=1 00:05:51.141 --rc genhtml_legend=1 00:05:51.141 --rc geninfo_all_blocks=1 00:05:51.141 --rc geninfo_unexecuted_blocks=1 00:05:51.141 00:05:51.141 ' 00:05:51.141 12:33:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:51.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.141 --rc genhtml_branch_coverage=1 00:05:51.141 --rc genhtml_function_coverage=1 00:05:51.141 --rc genhtml_legend=1 00:05:51.141 --rc geninfo_all_blocks=1 00:05:51.141 --rc geninfo_unexecuted_blocks=1 00:05:51.141 00:05:51.141 ' 00:05:51.141 12:33:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:51.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.141 --rc genhtml_branch_coverage=1 00:05:51.141 --rc genhtml_function_coverage=1 00:05:51.141 --rc genhtml_legend=1 00:05:51.141 --rc geninfo_all_blocks=1 00:05:51.141 --rc geninfo_unexecuted_blocks=1 00:05:51.141 00:05:51.141 ' 00:05:51.141 12:33:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:51.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.141 --rc genhtml_branch_coverage=1 00:05:51.141 --rc genhtml_function_coverage=1 00:05:51.141 --rc genhtml_legend=1 00:05:51.141 --rc geninfo_all_blocks=1 00:05:51.141 --rc geninfo_unexecuted_blocks=1 00:05:51.141 00:05:51.141 ' 00:05:51.141 12:33:24 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:51.141 12:33:24 -- nvmf/common.sh@7 -- # uname -s 00:05:51.141 12:33:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:51.141 12:33:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:51.141 12:33:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:51.141 12:33:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:51.141 12:33:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:51.141 12:33:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:51.141 12:33:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:51.141 12:33:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:51.141 12:33:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:51.141 12:33:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:51.141 12:33:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:51.141 12:33:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:51.141 12:33:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:51.141 12:33:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:51.141 12:33:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:05:51.141 12:33:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:51.141 12:33:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:51.141 12:33:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:51.141 12:33:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:51.141 12:33:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.141 12:33:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.141 12:33:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.141 12:33:24 -- paths/export.sh@5 -- # export PATH 00:05:51.141 12:33:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.141 12:33:24 -- nvmf/common.sh@46 -- # : 0 00:05:51.142 12:33:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:51.142 12:33:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:51.142 12:33:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:51.142 12:33:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:51.142 12:33:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:51.142 12:33:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:51.142 12:33:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:51.142 12:33:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:51.142 12:33:24 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:05:51.142 12:33:24 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:05:51.142 12:33:24 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:05:51.142 12:33:24 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:05:51.142 12:33:24 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:05:51.142 12:33:24 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:05:51.142 12:33:24 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:05:51.142 12:33:24 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:05:51.142 12:33:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:51.142 12:33:24 -- common/autotest_common.sh@10 -- # set +x 00:05:51.142 12:33:24 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:05:51.142 12:33:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:05:51.142 12:33:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:05:51.142 12:33:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:05:51.142 12:33:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:05:51.142 12:33:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:05:51.142 12:33:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:51.142 12:33:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:05:51.142 12:33:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:51.142 12:33:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:05:51.142 12:33:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:05:51.142 12:33:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:05:51.142 12:33:24 -- common/autotest_common.sh@10 -- # set +x 00:05:53.049 12:33:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:05:53.049 12:33:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:05:53.049 12:33:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:05:53.049 12:33:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:05:53.049 12:33:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:05:53.049 12:33:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:05:53.049 12:33:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:05:53.049 12:33:26 -- nvmf/common.sh@294 -- # net_devs=() 00:05:53.049 12:33:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:05:53.049 12:33:26 -- nvmf/common.sh@295 -- # e810=() 00:05:53.049 12:33:26 -- nvmf/common.sh@295 -- # local -ga e810 00:05:53.049 12:33:26 -- nvmf/common.sh@296 -- # x722=() 00:05:53.049 12:33:26 -- nvmf/common.sh@296 -- # local -ga x722 00:05:53.049 12:33:26 -- nvmf/common.sh@297 -- # mlx=() 00:05:53.049 12:33:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:05:53.049 12:33:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:05:53.049 12:33:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:05:53.050 12:33:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:05:53.050 12:33:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:05:53.050 12:33:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:05:53.050 12:33:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:05:53.050 12:33:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:05:53.050 12:33:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:05:53.050 12:33:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:05:53.050 12:33:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:05:53.050 12:33:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:05:53.050 12:33:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:05:53.309 12:33:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:05:53.309 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:05:53.309 12:33:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:05:53.309 12:33:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:05:53.309 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:05:53.309 12:33:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:05:53.309 12:33:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:05:53.309 12:33:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:53.309 12:33:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:05:53.309 12:33:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:53.309 12:33:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:05:53.309 Found net devices under 0000:0a:00.0: cvl_0_0 00:05:53.309 12:33:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:05:53.309 12:33:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:05:53.309 12:33:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:53.309 12:33:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:05:53.309 12:33:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:53.309 12:33:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:05:53.309 Found net devices under 0000:0a:00.1: cvl_0_1 00:05:53.309 12:33:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:05:53.309 12:33:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:05:53.309 12:33:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:05:53.309 12:33:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:05:53.309 12:33:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:05:53.309 12:33:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:05:53.309 12:33:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:05:53.309 12:33:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:05:53.309 12:33:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:05:53.309 12:33:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:05:53.309 12:33:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:05:53.309 12:33:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:05:53.309 12:33:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:05:53.309 12:33:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:05:53.309 12:33:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:05:53.310 12:33:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:05:53.310 12:33:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:05:53.310 12:33:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:05:53.310 12:33:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:05:53.310 12:33:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:05:53.310 12:33:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:05:53.310 12:33:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:05:53.310 12:33:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:05:53.310 12:33:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:05:53.310 12:33:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:05:53.310 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:05:53.310 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:05:53.310 00:05:53.310 --- 10.0.0.2 ping statistics --- 00:05:53.310 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:53.310 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:05:53.310 12:33:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:05:53.310 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:05:53.310 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:05:53.310 00:05:53.310 --- 10.0.0.1 ping statistics --- 00:05:53.310 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:53.310 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:05:53.310 12:33:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:05:53.310 12:33:26 -- nvmf/common.sh@410 -- # return 0 00:05:53.310 12:33:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:05:53.310 12:33:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:05:53.310 12:33:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:05:53.310 12:33:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:05:53.310 12:33:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:05:53.310 12:33:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:05:53.310 12:33:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:05:53.310 12:33:26 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:05:53.310 12:33:26 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:05:53.310 12:33:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:53.310 12:33:26 -- common/autotest_common.sh@10 -- # set +x 00:05:53.310 12:33:26 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:05:53.310 12:33:26 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:05:53.310 12:33:26 -- target/nvmf_example.sh@34 -- # nvmfpid=3419011 00:05:53.310 12:33:26 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:05:53.310 12:33:26 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:05:53.310 12:33:26 -- target/nvmf_example.sh@36 -- # waitforlisten 3419011 00:05:53.310 12:33:26 -- common/autotest_common.sh@829 -- # '[' -z 3419011 ']' 00:05:53.310 12:33:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:53.310 12:33:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:53.310 12:33:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:53.310 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:53.310 12:33:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:53.310 12:33:26 -- common/autotest_common.sh@10 -- # set +x 00:05:53.310 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.250 12:33:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:54.250 12:33:27 -- common/autotest_common.sh@862 -- # return 0 00:05:54.250 12:33:27 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:05:54.250 12:33:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:54.250 12:33:27 -- common/autotest_common.sh@10 -- # set +x 00:05:54.511 12:33:27 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:05:54.511 12:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:54.511 12:33:27 -- common/autotest_common.sh@10 -- # set +x 00:05:54.511 12:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:54.511 12:33:27 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:05:54.511 12:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:54.511 12:33:27 -- common/autotest_common.sh@10 -- # set +x 00:05:54.511 12:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:54.511 12:33:27 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:05:54.511 12:33:27 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:54.511 12:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:54.511 12:33:27 -- common/autotest_common.sh@10 -- # set +x 00:05:54.511 12:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:54.511 12:33:27 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:05:54.511 12:33:27 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:05:54.511 12:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:54.511 12:33:27 -- common/autotest_common.sh@10 -- # set +x 00:05:54.511 12:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:54.511 12:33:27 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:05:54.511 12:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:54.511 12:33:27 -- common/autotest_common.sh@10 -- # set +x 00:05:54.511 12:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:54.511 12:33:27 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:05:54.511 12:33:27 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:05:54.511 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.513 Initializing NVMe Controllers 00:06:04.513 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:04.513 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:04.513 Initialization complete. Launching workers. 00:06:04.513 ======================================================== 00:06:04.513 Latency(us) 00:06:04.513 Device Information : IOPS MiB/s Average min max 00:06:04.513 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 16229.27 63.40 3943.09 783.16 15104.54 00:06:04.513 ======================================================== 00:06:04.513 Total : 16229.27 63.40 3943.09 783.16 15104.54 00:06:04.513 00:06:04.513 12:33:37 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:04.513 12:33:37 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:04.513 12:33:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:04.513 12:33:37 -- nvmf/common.sh@116 -- # sync 00:06:04.513 12:33:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:04.513 12:33:37 -- nvmf/common.sh@119 -- # set +e 00:06:04.513 12:33:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:04.513 12:33:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:04.513 rmmod nvme_tcp 00:06:04.774 rmmod nvme_fabrics 00:06:04.774 rmmod nvme_keyring 00:06:04.774 12:33:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:04.774 12:33:37 -- nvmf/common.sh@123 -- # set -e 00:06:04.774 12:33:37 -- nvmf/common.sh@124 -- # return 0 00:06:04.774 12:33:37 -- nvmf/common.sh@477 -- # '[' -n 3419011 ']' 00:06:04.774 12:33:37 -- nvmf/common.sh@478 -- # killprocess 3419011 00:06:04.774 12:33:37 -- common/autotest_common.sh@936 -- # '[' -z 3419011 ']' 00:06:04.774 12:33:37 -- common/autotest_common.sh@940 -- # kill -0 3419011 00:06:04.774 12:33:37 -- common/autotest_common.sh@941 -- # uname 00:06:04.774 12:33:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.774 12:33:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3419011 00:06:04.774 12:33:37 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:04.774 12:33:37 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:04.774 12:33:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3419011' 00:06:04.774 killing process with pid 3419011 00:06:04.774 12:33:37 -- common/autotest_common.sh@955 -- # kill 3419011 00:06:04.774 12:33:37 -- common/autotest_common.sh@960 -- # wait 3419011 00:06:05.035 nvmf threads initialize successfully 00:06:05.035 bdev subsystem init successfully 00:06:05.035 created a nvmf target service 00:06:05.035 create targets's poll groups done 00:06:05.035 all subsystems of target started 00:06:05.035 nvmf target is running 00:06:05.035 all subsystems of target stopped 00:06:05.035 destroy targets's poll groups done 00:06:05.035 destroyed the nvmf target service 00:06:05.035 bdev subsystem finish successfully 00:06:05.035 nvmf threads destroy successfully 00:06:05.035 12:33:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:05.035 12:33:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:05.035 12:33:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:05.035 12:33:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:05.035 12:33:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:05.035 12:33:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:05.035 12:33:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:05.035 12:33:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:06.990 12:33:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:06.990 12:33:40 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:06.990 12:33:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:06.990 12:33:40 -- common/autotest_common.sh@10 -- # set +x 00:06:06.990 00:06:06.990 real 0m16.072s 00:06:06.990 user 0m45.248s 00:06:06.990 sys 0m3.269s 00:06:06.990 12:33:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.990 12:33:40 -- common/autotest_common.sh@10 -- # set +x 00:06:06.990 ************************************ 00:06:06.990 END TEST nvmf_example 00:06:06.990 ************************************ 00:06:06.990 12:33:40 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:06.990 12:33:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:06.990 12:33:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.990 12:33:40 -- common/autotest_common.sh@10 -- # set +x 00:06:06.990 ************************************ 00:06:06.990 START TEST nvmf_filesystem 00:06:06.990 ************************************ 00:06:06.990 12:33:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:07.252 * Looking for test storage... 00:06:07.252 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:07.252 12:33:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:07.252 12:33:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:07.252 12:33:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:07.252 12:33:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:07.252 12:33:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:07.252 12:33:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:07.252 12:33:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:07.252 12:33:40 -- scripts/common.sh@335 -- # IFS=.-: 00:06:07.252 12:33:40 -- scripts/common.sh@335 -- # read -ra ver1 00:06:07.252 12:33:40 -- scripts/common.sh@336 -- # IFS=.-: 00:06:07.252 12:33:40 -- scripts/common.sh@336 -- # read -ra ver2 00:06:07.252 12:33:40 -- scripts/common.sh@337 -- # local 'op=<' 00:06:07.252 12:33:40 -- scripts/common.sh@339 -- # ver1_l=2 00:06:07.252 12:33:40 -- scripts/common.sh@340 -- # ver2_l=1 00:06:07.252 12:33:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:07.252 12:33:40 -- scripts/common.sh@343 -- # case "$op" in 00:06:07.252 12:33:40 -- scripts/common.sh@344 -- # : 1 00:06:07.252 12:33:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:07.252 12:33:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:07.252 12:33:40 -- scripts/common.sh@364 -- # decimal 1 00:06:07.252 12:33:40 -- scripts/common.sh@352 -- # local d=1 00:06:07.252 12:33:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:07.252 12:33:40 -- scripts/common.sh@354 -- # echo 1 00:06:07.252 12:33:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:07.252 12:33:40 -- scripts/common.sh@365 -- # decimal 2 00:06:07.252 12:33:40 -- scripts/common.sh@352 -- # local d=2 00:06:07.252 12:33:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:07.252 12:33:40 -- scripts/common.sh@354 -- # echo 2 00:06:07.252 12:33:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:07.252 12:33:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:07.252 12:33:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:07.252 12:33:40 -- scripts/common.sh@367 -- # return 0 00:06:07.252 12:33:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:07.252 12:33:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:07.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.252 --rc genhtml_branch_coverage=1 00:06:07.252 --rc genhtml_function_coverage=1 00:06:07.252 --rc genhtml_legend=1 00:06:07.252 --rc geninfo_all_blocks=1 00:06:07.252 --rc geninfo_unexecuted_blocks=1 00:06:07.252 00:06:07.252 ' 00:06:07.252 12:33:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:07.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.252 --rc genhtml_branch_coverage=1 00:06:07.252 --rc genhtml_function_coverage=1 00:06:07.252 --rc genhtml_legend=1 00:06:07.252 --rc geninfo_all_blocks=1 00:06:07.252 --rc geninfo_unexecuted_blocks=1 00:06:07.252 00:06:07.252 ' 00:06:07.252 12:33:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:07.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.252 --rc genhtml_branch_coverage=1 00:06:07.252 --rc genhtml_function_coverage=1 00:06:07.252 --rc genhtml_legend=1 00:06:07.252 --rc geninfo_all_blocks=1 00:06:07.252 --rc geninfo_unexecuted_blocks=1 00:06:07.252 00:06:07.252 ' 00:06:07.252 12:33:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:07.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.252 --rc genhtml_branch_coverage=1 00:06:07.252 --rc genhtml_function_coverage=1 00:06:07.252 --rc genhtml_legend=1 00:06:07.252 --rc geninfo_all_blocks=1 00:06:07.252 --rc geninfo_unexecuted_blocks=1 00:06:07.252 00:06:07.252 ' 00:06:07.252 12:33:40 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:07.252 12:33:40 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:07.252 12:33:40 -- common/autotest_common.sh@34 -- # set -e 00:06:07.252 12:33:40 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:07.252 12:33:40 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:07.252 12:33:40 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:07.252 12:33:40 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:07.252 12:33:40 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:07.252 12:33:40 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:07.252 12:33:40 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:07.252 12:33:40 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:07.252 12:33:40 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:07.252 12:33:40 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:07.252 12:33:40 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:07.252 12:33:40 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:07.252 12:33:40 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:07.252 12:33:40 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:07.252 12:33:40 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:07.252 12:33:40 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:07.252 12:33:40 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:07.252 12:33:40 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:07.252 12:33:40 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:07.252 12:33:40 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:07.252 12:33:40 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:07.252 12:33:40 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:07.252 12:33:40 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:07.252 12:33:40 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:07.252 12:33:40 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:07.252 12:33:40 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:07.252 12:33:40 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:07.252 12:33:40 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:07.252 12:33:40 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:07.252 12:33:40 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:07.252 12:33:40 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:07.252 12:33:40 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:07.252 12:33:40 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:07.252 12:33:40 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:07.252 12:33:40 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:07.252 12:33:40 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:07.252 12:33:40 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:07.252 12:33:40 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:07.252 12:33:40 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:07.252 12:33:40 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:07.252 12:33:40 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:07.252 12:33:40 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:07.253 12:33:40 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:07.253 12:33:40 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:07.253 12:33:40 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:07.253 12:33:40 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:07.253 12:33:40 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:07.253 12:33:40 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:07.253 12:33:40 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:07.253 12:33:40 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:07.253 12:33:40 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:07.253 12:33:40 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:07.253 12:33:40 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:07.253 12:33:40 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:07.253 12:33:40 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:07.253 12:33:40 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:07.253 12:33:40 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:07.253 12:33:40 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:07.253 12:33:40 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:07.253 12:33:40 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:07.253 12:33:40 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:07.253 12:33:40 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:07.253 12:33:40 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:07.253 12:33:40 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:07.253 12:33:40 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:07.253 12:33:40 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:07.253 12:33:40 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:07.253 12:33:40 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:07.253 12:33:40 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:07.253 12:33:40 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:07.253 12:33:40 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:07.253 12:33:40 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:07.253 12:33:40 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:07.253 12:33:40 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:07.253 12:33:40 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:07.253 12:33:40 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:07.253 12:33:40 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:07.253 12:33:40 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:07.253 12:33:40 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:07.253 12:33:40 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:07.253 12:33:40 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:07.253 12:33:40 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:07.253 12:33:40 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:07.253 12:33:40 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:07.253 12:33:40 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:07.253 12:33:40 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:07.253 12:33:40 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:07.253 12:33:40 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:07.253 12:33:40 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:07.253 12:33:40 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:07.253 12:33:40 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:07.253 12:33:40 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:07.253 12:33:40 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:07.253 12:33:40 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:07.253 12:33:40 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:07.253 12:33:40 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:07.253 12:33:40 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:07.253 12:33:40 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:07.253 12:33:40 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:07.253 #define SPDK_CONFIG_H 00:06:07.253 #define SPDK_CONFIG_APPS 1 00:06:07.253 #define SPDK_CONFIG_ARCH native 00:06:07.253 #undef SPDK_CONFIG_ASAN 00:06:07.253 #undef SPDK_CONFIG_AVAHI 00:06:07.253 #undef SPDK_CONFIG_CET 00:06:07.253 #define SPDK_CONFIG_COVERAGE 1 00:06:07.253 #define SPDK_CONFIG_CROSS_PREFIX 00:06:07.253 #undef SPDK_CONFIG_CRYPTO 00:06:07.253 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:07.253 #undef SPDK_CONFIG_CUSTOMOCF 00:06:07.253 #undef SPDK_CONFIG_DAOS 00:06:07.253 #define SPDK_CONFIG_DAOS_DIR 00:06:07.253 #define SPDK_CONFIG_DEBUG 1 00:06:07.253 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:07.253 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:07.253 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:07.253 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:07.253 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:07.253 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:07.253 #define SPDK_CONFIG_EXAMPLES 1 00:06:07.253 #undef SPDK_CONFIG_FC 00:06:07.253 #define SPDK_CONFIG_FC_PATH 00:06:07.253 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:07.253 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:07.253 #undef SPDK_CONFIG_FUSE 00:06:07.253 #undef SPDK_CONFIG_FUZZER 00:06:07.253 #define SPDK_CONFIG_FUZZER_LIB 00:06:07.253 #undef SPDK_CONFIG_GOLANG 00:06:07.253 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:07.253 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:07.253 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:07.253 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:07.253 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:07.253 #define SPDK_CONFIG_IDXD 1 00:06:07.253 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:07.253 #undef SPDK_CONFIG_IPSEC_MB 00:06:07.253 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:07.253 #define SPDK_CONFIG_ISAL 1 00:06:07.253 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:07.253 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:07.253 #define SPDK_CONFIG_LIBDIR 00:06:07.253 #undef SPDK_CONFIG_LTO 00:06:07.253 #define SPDK_CONFIG_MAX_LCORES 00:06:07.253 #define SPDK_CONFIG_NVME_CUSE 1 00:06:07.253 #undef SPDK_CONFIG_OCF 00:06:07.253 #define SPDK_CONFIG_OCF_PATH 00:06:07.253 #define SPDK_CONFIG_OPENSSL_PATH 00:06:07.253 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:07.253 #undef SPDK_CONFIG_PGO_USE 00:06:07.253 #define SPDK_CONFIG_PREFIX /usr/local 00:06:07.253 #undef SPDK_CONFIG_RAID5F 00:06:07.253 #undef SPDK_CONFIG_RBD 00:06:07.253 #define SPDK_CONFIG_RDMA 1 00:06:07.253 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:07.253 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:07.253 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:07.253 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:07.253 #define SPDK_CONFIG_SHARED 1 00:06:07.253 #undef SPDK_CONFIG_SMA 00:06:07.253 #define SPDK_CONFIG_TESTS 1 00:06:07.253 #undef SPDK_CONFIG_TSAN 00:06:07.253 #define SPDK_CONFIG_UBLK 1 00:06:07.253 #define SPDK_CONFIG_UBSAN 1 00:06:07.253 #undef SPDK_CONFIG_UNIT_TESTS 00:06:07.253 #undef SPDK_CONFIG_URING 00:06:07.253 #define SPDK_CONFIG_URING_PATH 00:06:07.253 #undef SPDK_CONFIG_URING_ZNS 00:06:07.253 #undef SPDK_CONFIG_USDT 00:06:07.253 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:07.253 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:07.253 #undef SPDK_CONFIG_VFIO_USER 00:06:07.253 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:07.253 #define SPDK_CONFIG_VHOST 1 00:06:07.253 #define SPDK_CONFIG_VIRTIO 1 00:06:07.253 #undef SPDK_CONFIG_VTUNE 00:06:07.253 #define SPDK_CONFIG_VTUNE_DIR 00:06:07.253 #define SPDK_CONFIG_WERROR 1 00:06:07.253 #define SPDK_CONFIG_WPDK_DIR 00:06:07.253 #undef SPDK_CONFIG_XNVME 00:06:07.253 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:07.253 12:33:40 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:07.253 12:33:40 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:07.253 12:33:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:07.253 12:33:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:07.253 12:33:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:07.253 12:33:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.253 12:33:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.253 12:33:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.253 12:33:40 -- paths/export.sh@5 -- # export PATH 00:06:07.253 12:33:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.253 12:33:40 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:07.253 12:33:40 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:07.253 12:33:40 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:07.254 12:33:40 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:07.254 12:33:40 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:07.254 12:33:40 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:07.254 12:33:40 -- pm/common@16 -- # TEST_TAG=N/A 00:06:07.254 12:33:40 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:07.254 12:33:40 -- common/autotest_common.sh@52 -- # : 1 00:06:07.254 12:33:40 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:07.254 12:33:40 -- common/autotest_common.sh@56 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:07.254 12:33:40 -- common/autotest_common.sh@58 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:07.254 12:33:40 -- common/autotest_common.sh@60 -- # : 1 00:06:07.254 12:33:40 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:07.254 12:33:40 -- common/autotest_common.sh@62 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:07.254 12:33:40 -- common/autotest_common.sh@64 -- # : 00:06:07.254 12:33:40 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:07.254 12:33:40 -- common/autotest_common.sh@66 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:07.254 12:33:40 -- common/autotest_common.sh@68 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:07.254 12:33:40 -- common/autotest_common.sh@70 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:07.254 12:33:40 -- common/autotest_common.sh@72 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:07.254 12:33:40 -- common/autotest_common.sh@74 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:07.254 12:33:40 -- common/autotest_common.sh@76 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:07.254 12:33:40 -- common/autotest_common.sh@78 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:07.254 12:33:40 -- common/autotest_common.sh@80 -- # : 1 00:06:07.254 12:33:40 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:07.254 12:33:40 -- common/autotest_common.sh@82 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:07.254 12:33:40 -- common/autotest_common.sh@84 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:07.254 12:33:40 -- common/autotest_common.sh@86 -- # : 1 00:06:07.254 12:33:40 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:07.254 12:33:40 -- common/autotest_common.sh@88 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:07.254 12:33:40 -- common/autotest_common.sh@90 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:07.254 12:33:40 -- common/autotest_common.sh@92 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:07.254 12:33:40 -- common/autotest_common.sh@94 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:07.254 12:33:40 -- common/autotest_common.sh@96 -- # : tcp 00:06:07.254 12:33:40 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:07.254 12:33:40 -- common/autotest_common.sh@98 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:07.254 12:33:40 -- common/autotest_common.sh@100 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:07.254 12:33:40 -- common/autotest_common.sh@102 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:07.254 12:33:40 -- common/autotest_common.sh@104 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:07.254 12:33:40 -- common/autotest_common.sh@106 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:07.254 12:33:40 -- common/autotest_common.sh@108 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:07.254 12:33:40 -- common/autotest_common.sh@110 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:07.254 12:33:40 -- common/autotest_common.sh@112 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:07.254 12:33:40 -- common/autotest_common.sh@114 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:07.254 12:33:40 -- common/autotest_common.sh@116 -- # : 1 00:06:07.254 12:33:40 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:07.254 12:33:40 -- common/autotest_common.sh@118 -- # : 00:06:07.254 12:33:40 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:07.254 12:33:40 -- common/autotest_common.sh@120 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:07.254 12:33:40 -- common/autotest_common.sh@122 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:07.254 12:33:40 -- common/autotest_common.sh@124 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:07.254 12:33:40 -- common/autotest_common.sh@126 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:07.254 12:33:40 -- common/autotest_common.sh@128 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:07.254 12:33:40 -- common/autotest_common.sh@130 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:07.254 12:33:40 -- common/autotest_common.sh@132 -- # : 00:06:07.254 12:33:40 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:07.254 12:33:40 -- common/autotest_common.sh@134 -- # : true 00:06:07.254 12:33:40 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:07.254 12:33:40 -- common/autotest_common.sh@136 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:07.254 12:33:40 -- common/autotest_common.sh@138 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:07.254 12:33:40 -- common/autotest_common.sh@140 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:07.254 12:33:40 -- common/autotest_common.sh@142 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:07.254 12:33:40 -- common/autotest_common.sh@144 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:07.254 12:33:40 -- common/autotest_common.sh@146 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:07.254 12:33:40 -- common/autotest_common.sh@148 -- # : e810 00:06:07.254 12:33:40 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:07.254 12:33:40 -- common/autotest_common.sh@150 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:07.254 12:33:40 -- common/autotest_common.sh@152 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:07.254 12:33:40 -- common/autotest_common.sh@154 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:07.254 12:33:40 -- common/autotest_common.sh@156 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:07.254 12:33:40 -- common/autotest_common.sh@158 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:07.254 12:33:40 -- common/autotest_common.sh@160 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:07.254 12:33:40 -- common/autotest_common.sh@163 -- # : 00:06:07.254 12:33:40 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:07.254 12:33:40 -- common/autotest_common.sh@165 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:07.254 12:33:40 -- common/autotest_common.sh@167 -- # : 0 00:06:07.254 12:33:40 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:07.254 12:33:40 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:07.254 12:33:40 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:07.254 12:33:40 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:07.254 12:33:40 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:07.254 12:33:40 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:07.254 12:33:40 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:07.254 12:33:40 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:07.255 12:33:40 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:07.255 12:33:40 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:07.255 12:33:40 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:07.255 12:33:40 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:07.255 12:33:40 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:07.255 12:33:40 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:07.255 12:33:40 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:07.255 12:33:40 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:07.255 12:33:40 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:07.255 12:33:40 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:07.255 12:33:40 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:07.255 12:33:40 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:07.255 12:33:40 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:07.255 12:33:40 -- common/autotest_common.sh@196 -- # cat 00:06:07.255 12:33:40 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:07.255 12:33:40 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:07.255 12:33:40 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:07.255 12:33:40 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:07.255 12:33:40 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:07.255 12:33:40 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:07.255 12:33:40 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:07.255 12:33:40 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:07.255 12:33:40 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:07.255 12:33:40 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:07.255 12:33:40 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:07.255 12:33:40 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:07.255 12:33:40 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:07.255 12:33:40 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:07.255 12:33:40 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:07.255 12:33:40 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:07.255 12:33:40 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:07.255 12:33:40 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:07.255 12:33:40 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:07.255 12:33:40 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:07.255 12:33:40 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:07.255 12:33:40 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:07.255 12:33:40 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:07.255 12:33:40 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:07.255 12:33:40 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:07.255 12:33:40 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:07.255 12:33:40 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:07.255 12:33:40 -- common/autotest_common.sh@259 -- # valgrind= 00:06:07.255 12:33:40 -- common/autotest_common.sh@265 -- # uname -s 00:06:07.255 12:33:40 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:07.255 12:33:40 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:07.255 12:33:40 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:07.255 12:33:40 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:07.255 12:33:40 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:07.255 12:33:40 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:07.255 12:33:40 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:07.255 12:33:40 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:07.255 12:33:40 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:07.255 12:33:40 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:07.255 12:33:40 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:07.255 12:33:40 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:07.255 12:33:40 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:07.255 12:33:40 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:07.255 12:33:40 -- common/autotest_common.sh@319 -- # [[ -z 3420760 ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@319 -- # kill -0 3420760 00:06:07.255 12:33:40 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:07.255 12:33:40 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:07.255 12:33:40 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:07.255 12:33:40 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:07.255 12:33:40 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:07.255 12:33:40 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:07.255 12:33:40 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:07.255 12:33:40 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.EvUryT 00:06:07.255 12:33:40 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:07.255 12:33:40 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:07.255 12:33:40 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.EvUryT/tests/target /tmp/spdk.EvUryT 00:06:07.255 12:33:40 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.255 12:33:40 -- common/autotest_common.sh@328 -- # df -T 00:06:07.255 12:33:40 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:07.255 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:07.255 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=55329239040 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:06:07.255 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=6659289088 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991671296 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:07.255 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:07.255 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993412096 00:06:07.255 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:07.255 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=851968 00:06:07.255 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.256 12:33:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:07.256 12:33:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:07.256 12:33:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:07.256 12:33:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:07.256 12:33:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:07.256 12:33:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:07.256 12:33:40 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:07.256 * Looking for test storage... 00:06:07.256 12:33:40 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:07.256 12:33:40 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:07.256 12:33:40 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:07.256 12:33:40 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:07.256 12:33:40 -- common/autotest_common.sh@373 -- # mount=/ 00:06:07.256 12:33:40 -- common/autotest_common.sh@375 -- # target_space=55329239040 00:06:07.256 12:33:40 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:07.256 12:33:40 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:07.256 12:33:40 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:07.256 12:33:40 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:07.256 12:33:40 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:07.256 12:33:40 -- common/autotest_common.sh@382 -- # new_size=8873881600 00:06:07.256 12:33:40 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:07.256 12:33:40 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:07.256 12:33:40 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:07.256 12:33:40 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:07.256 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:07.256 12:33:40 -- common/autotest_common.sh@390 -- # return 0 00:06:07.256 12:33:40 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:07.256 12:33:40 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:07.256 12:33:40 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:07.256 12:33:40 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:07.256 12:33:40 -- common/autotest_common.sh@1682 -- # true 00:06:07.256 12:33:40 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:07.256 12:33:40 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:07.256 12:33:40 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:07.256 12:33:40 -- common/autotest_common.sh@27 -- # exec 00:06:07.256 12:33:40 -- common/autotest_common.sh@29 -- # exec 00:06:07.256 12:33:40 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:07.256 12:33:40 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:07.256 12:33:40 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:07.256 12:33:40 -- common/autotest_common.sh@18 -- # set -x 00:06:07.256 12:33:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:07.256 12:33:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:07.256 12:33:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:07.515 12:33:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:07.515 12:33:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:07.515 12:33:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:07.515 12:33:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:07.515 12:33:40 -- scripts/common.sh@335 -- # IFS=.-: 00:06:07.515 12:33:40 -- scripts/common.sh@335 -- # read -ra ver1 00:06:07.515 12:33:40 -- scripts/common.sh@336 -- # IFS=.-: 00:06:07.515 12:33:40 -- scripts/common.sh@336 -- # read -ra ver2 00:06:07.515 12:33:40 -- scripts/common.sh@337 -- # local 'op=<' 00:06:07.515 12:33:40 -- scripts/common.sh@339 -- # ver1_l=2 00:06:07.515 12:33:40 -- scripts/common.sh@340 -- # ver2_l=1 00:06:07.515 12:33:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:07.515 12:33:40 -- scripts/common.sh@343 -- # case "$op" in 00:06:07.515 12:33:40 -- scripts/common.sh@344 -- # : 1 00:06:07.515 12:33:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:07.515 12:33:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:07.515 12:33:40 -- scripts/common.sh@364 -- # decimal 1 00:06:07.515 12:33:40 -- scripts/common.sh@352 -- # local d=1 00:06:07.515 12:33:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:07.515 12:33:40 -- scripts/common.sh@354 -- # echo 1 00:06:07.515 12:33:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:07.515 12:33:40 -- scripts/common.sh@365 -- # decimal 2 00:06:07.515 12:33:40 -- scripts/common.sh@352 -- # local d=2 00:06:07.515 12:33:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:07.515 12:33:40 -- scripts/common.sh@354 -- # echo 2 00:06:07.515 12:33:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:07.515 12:33:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:07.515 12:33:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:07.515 12:33:40 -- scripts/common.sh@367 -- # return 0 00:06:07.515 12:33:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:07.515 12:33:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:07.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.515 --rc genhtml_branch_coverage=1 00:06:07.515 --rc genhtml_function_coverage=1 00:06:07.515 --rc genhtml_legend=1 00:06:07.515 --rc geninfo_all_blocks=1 00:06:07.515 --rc geninfo_unexecuted_blocks=1 00:06:07.515 00:06:07.515 ' 00:06:07.515 12:33:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:07.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.515 --rc genhtml_branch_coverage=1 00:06:07.515 --rc genhtml_function_coverage=1 00:06:07.515 --rc genhtml_legend=1 00:06:07.515 --rc geninfo_all_blocks=1 00:06:07.515 --rc geninfo_unexecuted_blocks=1 00:06:07.515 00:06:07.515 ' 00:06:07.515 12:33:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:07.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.515 --rc genhtml_branch_coverage=1 00:06:07.515 --rc genhtml_function_coverage=1 00:06:07.515 --rc genhtml_legend=1 00:06:07.515 --rc geninfo_all_blocks=1 00:06:07.515 --rc geninfo_unexecuted_blocks=1 00:06:07.515 00:06:07.515 ' 00:06:07.515 12:33:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:07.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.515 --rc genhtml_branch_coverage=1 00:06:07.515 --rc genhtml_function_coverage=1 00:06:07.515 --rc genhtml_legend=1 00:06:07.515 --rc geninfo_all_blocks=1 00:06:07.515 --rc geninfo_unexecuted_blocks=1 00:06:07.515 00:06:07.515 ' 00:06:07.515 12:33:40 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:07.515 12:33:40 -- nvmf/common.sh@7 -- # uname -s 00:06:07.515 12:33:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:07.515 12:33:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:07.515 12:33:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:07.515 12:33:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:07.515 12:33:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:07.515 12:33:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:07.515 12:33:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:07.515 12:33:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:07.515 12:33:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:07.515 12:33:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:07.515 12:33:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:07.515 12:33:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:07.515 12:33:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:07.515 12:33:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:07.515 12:33:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:07.515 12:33:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:07.515 12:33:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:07.515 12:33:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:07.515 12:33:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:07.515 12:33:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.515 12:33:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.516 12:33:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.516 12:33:40 -- paths/export.sh@5 -- # export PATH 00:06:07.516 12:33:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:07.516 12:33:40 -- nvmf/common.sh@46 -- # : 0 00:06:07.516 12:33:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:07.516 12:33:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:07.516 12:33:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:07.516 12:33:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:07.516 12:33:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:07.516 12:33:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:07.516 12:33:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:07.516 12:33:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:07.516 12:33:40 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:07.516 12:33:40 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:07.516 12:33:40 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:07.516 12:33:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:07.516 12:33:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:07.516 12:33:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:07.516 12:33:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:07.516 12:33:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:07.516 12:33:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:07.516 12:33:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:07.516 12:33:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:07.516 12:33:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:07.516 12:33:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:07.516 12:33:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:07.516 12:33:40 -- common/autotest_common.sh@10 -- # set +x 00:06:09.422 12:33:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:09.422 12:33:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:09.422 12:33:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:09.422 12:33:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:09.422 12:33:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:09.422 12:33:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:09.422 12:33:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:09.422 12:33:42 -- nvmf/common.sh@294 -- # net_devs=() 00:06:09.422 12:33:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:09.422 12:33:42 -- nvmf/common.sh@295 -- # e810=() 00:06:09.422 12:33:42 -- nvmf/common.sh@295 -- # local -ga e810 00:06:09.422 12:33:42 -- nvmf/common.sh@296 -- # x722=() 00:06:09.422 12:33:42 -- nvmf/common.sh@296 -- # local -ga x722 00:06:09.422 12:33:42 -- nvmf/common.sh@297 -- # mlx=() 00:06:09.422 12:33:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:09.422 12:33:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:09.422 12:33:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:09.422 12:33:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:09.422 12:33:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:09.422 12:33:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:09.422 12:33:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:09.422 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:09.422 12:33:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:09.422 12:33:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:09.422 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:09.422 12:33:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:09.422 12:33:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:09.422 12:33:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:09.423 12:33:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:09.423 12:33:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:09.423 12:33:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:09.423 12:33:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:09.423 12:33:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:09.423 12:33:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:09.423 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:09.423 12:33:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:09.423 12:33:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:09.423 12:33:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:09.423 12:33:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:09.423 12:33:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:09.423 12:33:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:09.423 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:09.423 12:33:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:09.423 12:33:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:09.423 12:33:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:09.423 12:33:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:09.423 12:33:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:09.423 12:33:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:09.423 12:33:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:09.423 12:33:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:09.423 12:33:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:09.423 12:33:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:09.423 12:33:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:09.423 12:33:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:09.423 12:33:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:09.423 12:33:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:09.423 12:33:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:09.423 12:33:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:09.423 12:33:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:09.423 12:33:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:09.423 12:33:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:09.681 12:33:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:09.681 12:33:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:09.681 12:33:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:09.681 12:33:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:09.681 12:33:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:09.681 12:33:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:09.681 12:33:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:09.681 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:09.681 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:06:09.681 00:06:09.681 --- 10.0.0.2 ping statistics --- 00:06:09.681 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:09.681 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:06:09.681 12:33:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:09.681 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:09.681 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:06:09.681 00:06:09.681 --- 10.0.0.1 ping statistics --- 00:06:09.681 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:09.681 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:06:09.681 12:33:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:09.681 12:33:42 -- nvmf/common.sh@410 -- # return 0 00:06:09.681 12:33:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:09.681 12:33:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:09.681 12:33:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:09.681 12:33:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:09.681 12:33:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:09.681 12:33:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:09.681 12:33:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:09.681 12:33:42 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:09.681 12:33:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:09.681 12:33:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.681 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:06:09.681 ************************************ 00:06:09.681 START TEST nvmf_filesystem_no_in_capsule 00:06:09.681 ************************************ 00:06:09.681 12:33:42 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:09.681 12:33:42 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:09.681 12:33:42 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:09.681 12:33:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:09.681 12:33:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:09.681 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:06:09.681 12:33:42 -- nvmf/common.sh@469 -- # nvmfpid=3422409 00:06:09.681 12:33:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:09.681 12:33:42 -- nvmf/common.sh@470 -- # waitforlisten 3422409 00:06:09.681 12:33:42 -- common/autotest_common.sh@829 -- # '[' -z 3422409 ']' 00:06:09.681 12:33:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:09.681 12:33:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.681 12:33:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:09.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:09.681 12:33:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.681 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:06:09.681 [2024-11-20 12:33:42.715685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.681 [2024-11-20 12:33:42.715760] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:09.681 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.681 [2024-11-20 12:33:42.784049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:09.942 [2024-11-20 12:33:42.907981] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:09.942 [2024-11-20 12:33:42.908157] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:09.942 [2024-11-20 12:33:42.908179] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:09.942 [2024-11-20 12:33:42.908194] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:09.942 [2024-11-20 12:33:42.908271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:09.942 [2024-11-20 12:33:42.908300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:09.942 [2024-11-20 12:33:42.908364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:09.942 [2024-11-20 12:33:42.908367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.880 12:33:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:10.880 12:33:43 -- common/autotest_common.sh@862 -- # return 0 00:06:10.880 12:33:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:10.880 12:33:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 12:33:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:10.880 12:33:43 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:10.880 12:33:43 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:10.880 12:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 [2024-11-20 12:33:43.708654] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:10.880 12:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.880 12:33:43 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:10.880 12:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 Malloc1 00:06:10.880 12:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.880 12:33:43 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:10.880 12:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 12:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.880 12:33:43 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:10.880 12:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 12:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.880 12:33:43 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:10.880 12:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 [2024-11-20 12:33:43.894565] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:10.880 12:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.880 12:33:43 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:10.880 12:33:43 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:10.880 12:33:43 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:10.880 12:33:43 -- common/autotest_common.sh@1369 -- # local bs 00:06:10.880 12:33:43 -- common/autotest_common.sh@1370 -- # local nb 00:06:10.880 12:33:43 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:10.880 12:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.880 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:06:10.880 12:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.880 12:33:43 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:10.880 { 00:06:10.880 "name": "Malloc1", 00:06:10.880 "aliases": [ 00:06:10.880 "ac1da3a8-26a6-4235-838d-c0f9ca3634b8" 00:06:10.880 ], 00:06:10.880 "product_name": "Malloc disk", 00:06:10.880 "block_size": 512, 00:06:10.880 "num_blocks": 1048576, 00:06:10.880 "uuid": "ac1da3a8-26a6-4235-838d-c0f9ca3634b8", 00:06:10.880 "assigned_rate_limits": { 00:06:10.880 "rw_ios_per_sec": 0, 00:06:10.880 "rw_mbytes_per_sec": 0, 00:06:10.880 "r_mbytes_per_sec": 0, 00:06:10.880 "w_mbytes_per_sec": 0 00:06:10.880 }, 00:06:10.880 "claimed": true, 00:06:10.880 "claim_type": "exclusive_write", 00:06:10.880 "zoned": false, 00:06:10.880 "supported_io_types": { 00:06:10.880 "read": true, 00:06:10.880 "write": true, 00:06:10.880 "unmap": true, 00:06:10.880 "write_zeroes": true, 00:06:10.880 "flush": true, 00:06:10.880 "reset": true, 00:06:10.880 "compare": false, 00:06:10.880 "compare_and_write": false, 00:06:10.880 "abort": true, 00:06:10.880 "nvme_admin": false, 00:06:10.880 "nvme_io": false 00:06:10.880 }, 00:06:10.880 "memory_domains": [ 00:06:10.880 { 00:06:10.880 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:10.880 "dma_device_type": 2 00:06:10.880 } 00:06:10.880 ], 00:06:10.880 "driver_specific": {} 00:06:10.880 } 00:06:10.880 ]' 00:06:10.880 12:33:43 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:10.880 12:33:43 -- common/autotest_common.sh@1372 -- # bs=512 00:06:10.880 12:33:43 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:11.140 12:33:43 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:11.140 12:33:43 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:11.140 12:33:43 -- common/autotest_common.sh@1377 -- # echo 512 00:06:11.140 12:33:43 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:11.140 12:33:43 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:11.710 12:33:44 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:11.711 12:33:44 -- common/autotest_common.sh@1187 -- # local i=0 00:06:11.711 12:33:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:11.711 12:33:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:11.711 12:33:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:13.617 12:33:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:13.617 12:33:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:13.617 12:33:46 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:13.617 12:33:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:13.617 12:33:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:13.617 12:33:46 -- common/autotest_common.sh@1197 -- # return 0 00:06:13.617 12:33:46 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:13.617 12:33:46 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:13.617 12:33:46 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:13.617 12:33:46 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:13.617 12:33:46 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:13.617 12:33:46 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:13.617 12:33:46 -- setup/common.sh@80 -- # echo 536870912 00:06:13.617 12:33:46 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:13.617 12:33:46 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:13.617 12:33:46 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:13.617 12:33:46 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:13.876 12:33:46 -- target/filesystem.sh@69 -- # partprobe 00:06:14.816 12:33:47 -- target/filesystem.sh@70 -- # sleep 1 00:06:15.753 12:33:48 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:15.753 12:33:48 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:15.753 12:33:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:15.754 12:33:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.754 12:33:48 -- common/autotest_common.sh@10 -- # set +x 00:06:15.754 ************************************ 00:06:15.754 START TEST filesystem_ext4 00:06:15.754 ************************************ 00:06:15.754 12:33:48 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:15.754 12:33:48 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:15.754 12:33:48 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:15.754 12:33:48 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:15.754 12:33:48 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:15.754 12:33:48 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:15.754 12:33:48 -- common/autotest_common.sh@914 -- # local i=0 00:06:15.754 12:33:48 -- common/autotest_common.sh@915 -- # local force 00:06:15.754 12:33:48 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:15.754 12:33:48 -- common/autotest_common.sh@918 -- # force=-F 00:06:15.754 12:33:48 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:15.754 mke2fs 1.47.0 (5-Feb-2023) 00:06:15.754 Discarding device blocks: 0/522240 done 00:06:15.754 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:15.754 Filesystem UUID: d3c6c801-0741-45e5-afc6-c1e941b21a89 00:06:15.754 Superblock backups stored on blocks: 00:06:15.754 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:15.754 00:06:15.754 Allocating group tables: 0/64 done 00:06:15.754 Writing inode tables: 0/64 done 00:06:16.014 Creating journal (8192 blocks): done 00:06:16.014 Writing superblocks and filesystem accounting information: 0/64 done 00:06:16.014 00:06:16.014 12:33:48 -- common/autotest_common.sh@931 -- # return 0 00:06:16.014 12:33:48 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:21.293 12:33:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:21.293 12:33:54 -- target/filesystem.sh@25 -- # sync 00:06:21.293 12:33:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:21.293 12:33:54 -- target/filesystem.sh@27 -- # sync 00:06:21.293 12:33:54 -- target/filesystem.sh@29 -- # i=0 00:06:21.293 12:33:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:21.553 12:33:54 -- target/filesystem.sh@37 -- # kill -0 3422409 00:06:21.553 12:33:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:21.553 12:33:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:21.553 12:33:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:21.553 12:33:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:21.553 00:06:21.553 real 0m5.769s 00:06:21.553 user 0m0.030s 00:06:21.553 sys 0m0.052s 00:06:21.553 12:33:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.553 12:33:54 -- common/autotest_common.sh@10 -- # set +x 00:06:21.553 ************************************ 00:06:21.553 END TEST filesystem_ext4 00:06:21.553 ************************************ 00:06:21.553 12:33:54 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:21.553 12:33:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:21.553 12:33:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.553 12:33:54 -- common/autotest_common.sh@10 -- # set +x 00:06:21.553 ************************************ 00:06:21.553 START TEST filesystem_btrfs 00:06:21.553 ************************************ 00:06:21.553 12:33:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:21.553 12:33:54 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:21.553 12:33:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:21.553 12:33:54 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:21.553 12:33:54 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:21.553 12:33:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:21.553 12:33:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:21.553 12:33:54 -- common/autotest_common.sh@915 -- # local force 00:06:21.553 12:33:54 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:21.553 12:33:54 -- common/autotest_common.sh@920 -- # force=-f 00:06:21.554 12:33:54 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:21.554 btrfs-progs v6.8.1 00:06:21.554 See https://btrfs.readthedocs.io for more information. 00:06:21.554 00:06:21.554 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:21.554 NOTE: several default settings have changed in version 5.15, please make sure 00:06:21.554 this does not affect your deployments: 00:06:21.554 - DUP for metadata (-m dup) 00:06:21.554 - enabled no-holes (-O no-holes) 00:06:21.554 - enabled free-space-tree (-R free-space-tree) 00:06:21.554 00:06:21.554 Label: (null) 00:06:21.554 UUID: 0ac49b03-e2d3-402d-86cd-80c48e3a9f38 00:06:21.554 Node size: 16384 00:06:21.554 Sector size: 4096 (CPU page size: 4096) 00:06:21.554 Filesystem size: 510.00MiB 00:06:21.554 Block group profiles: 00:06:21.554 Data: single 8.00MiB 00:06:21.554 Metadata: DUP 32.00MiB 00:06:21.554 System: DUP 8.00MiB 00:06:21.554 SSD detected: yes 00:06:21.554 Zoned device: no 00:06:21.554 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:21.554 Checksum: crc32c 00:06:21.554 Number of devices: 1 00:06:21.554 Devices: 00:06:21.554 ID SIZE PATH 00:06:21.554 1 510.00MiB /dev/nvme0n1p1 00:06:21.554 00:06:21.554 12:33:54 -- common/autotest_common.sh@931 -- # return 0 00:06:21.554 12:33:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:22.493 12:33:55 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:22.493 12:33:55 -- target/filesystem.sh@25 -- # sync 00:06:22.493 12:33:55 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:22.493 12:33:55 -- target/filesystem.sh@27 -- # sync 00:06:22.493 12:33:55 -- target/filesystem.sh@29 -- # i=0 00:06:22.493 12:33:55 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:22.753 12:33:55 -- target/filesystem.sh@37 -- # kill -0 3422409 00:06:22.753 12:33:55 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:22.753 12:33:55 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:22.753 12:33:55 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:22.753 12:33:55 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:22.753 00:06:22.753 real 0m1.182s 00:06:22.753 user 0m0.014s 00:06:22.753 sys 0m0.110s 00:06:22.753 12:33:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.753 12:33:55 -- common/autotest_common.sh@10 -- # set +x 00:06:22.753 ************************************ 00:06:22.753 END TEST filesystem_btrfs 00:06:22.753 ************************************ 00:06:22.753 12:33:55 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:22.753 12:33:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:22.753 12:33:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.753 12:33:55 -- common/autotest_common.sh@10 -- # set +x 00:06:22.753 ************************************ 00:06:22.753 START TEST filesystem_xfs 00:06:22.753 ************************************ 00:06:22.753 12:33:55 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:22.753 12:33:55 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:22.753 12:33:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:22.753 12:33:55 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:22.753 12:33:55 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:22.753 12:33:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:22.753 12:33:55 -- common/autotest_common.sh@914 -- # local i=0 00:06:22.753 12:33:55 -- common/autotest_common.sh@915 -- # local force 00:06:22.753 12:33:55 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:22.753 12:33:55 -- common/autotest_common.sh@920 -- # force=-f 00:06:22.753 12:33:55 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:22.753 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:22.753 = sectsz=512 attr=2, projid32bit=1 00:06:22.753 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:22.753 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:22.753 data = bsize=4096 blocks=130560, imaxpct=25 00:06:22.753 = sunit=0 swidth=0 blks 00:06:22.753 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:22.753 log =internal log bsize=4096 blocks=16384, version=2 00:06:22.753 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:22.753 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:23.694 Discarding blocks...Done. 00:06:23.694 12:33:56 -- common/autotest_common.sh@931 -- # return 0 00:06:23.694 12:33:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:26.233 12:33:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:26.233 12:33:58 -- target/filesystem.sh@25 -- # sync 00:06:26.233 12:33:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:26.233 12:33:58 -- target/filesystem.sh@27 -- # sync 00:06:26.233 12:33:58 -- target/filesystem.sh@29 -- # i=0 00:06:26.233 12:33:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:26.233 12:33:58 -- target/filesystem.sh@37 -- # kill -0 3422409 00:06:26.233 12:33:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:26.233 12:33:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:26.233 12:33:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:26.233 12:33:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:26.233 00:06:26.233 real 0m3.301s 00:06:26.233 user 0m0.015s 00:06:26.233 sys 0m0.058s 00:06:26.233 12:33:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.233 12:33:58 -- common/autotest_common.sh@10 -- # set +x 00:06:26.233 ************************************ 00:06:26.233 END TEST filesystem_xfs 00:06:26.233 ************************************ 00:06:26.233 12:33:58 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:26.233 12:33:59 -- target/filesystem.sh@93 -- # sync 00:06:26.233 12:33:59 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:26.233 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:26.233 12:33:59 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:26.233 12:33:59 -- common/autotest_common.sh@1208 -- # local i=0 00:06:26.233 12:33:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:26.233 12:33:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:26.233 12:33:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:26.233 12:33:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:26.233 12:33:59 -- common/autotest_common.sh@1220 -- # return 0 00:06:26.494 12:33:59 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:26.494 12:33:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:26.494 12:33:59 -- common/autotest_common.sh@10 -- # set +x 00:06:26.494 12:33:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:26.494 12:33:59 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:26.494 12:33:59 -- target/filesystem.sh@101 -- # killprocess 3422409 00:06:26.494 12:33:59 -- common/autotest_common.sh@936 -- # '[' -z 3422409 ']' 00:06:26.494 12:33:59 -- common/autotest_common.sh@940 -- # kill -0 3422409 00:06:26.494 12:33:59 -- common/autotest_common.sh@941 -- # uname 00:06:26.494 12:33:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:26.494 12:33:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3422409 00:06:26.494 12:33:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:26.494 12:33:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:26.494 12:33:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3422409' 00:06:26.494 killing process with pid 3422409 00:06:26.494 12:33:59 -- common/autotest_common.sh@955 -- # kill 3422409 00:06:26.494 12:33:59 -- common/autotest_common.sh@960 -- # wait 3422409 00:06:27.063 12:33:59 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:27.063 00:06:27.063 real 0m17.215s 00:06:27.063 user 1m6.441s 00:06:27.063 sys 0m2.211s 00:06:27.063 12:33:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.063 12:33:59 -- common/autotest_common.sh@10 -- # set +x 00:06:27.063 ************************************ 00:06:27.063 END TEST nvmf_filesystem_no_in_capsule 00:06:27.063 ************************************ 00:06:27.063 12:33:59 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:27.063 12:33:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:27.063 12:33:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.063 12:33:59 -- common/autotest_common.sh@10 -- # set +x 00:06:27.063 ************************************ 00:06:27.063 START TEST nvmf_filesystem_in_capsule 00:06:27.063 ************************************ 00:06:27.063 12:33:59 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:06:27.063 12:33:59 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:27.063 12:33:59 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:27.063 12:33:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:27.063 12:33:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:27.063 12:33:59 -- common/autotest_common.sh@10 -- # set +x 00:06:27.063 12:33:59 -- nvmf/common.sh@469 -- # nvmfpid=3424771 00:06:27.063 12:33:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:27.063 12:33:59 -- nvmf/common.sh@470 -- # waitforlisten 3424771 00:06:27.063 12:33:59 -- common/autotest_common.sh@829 -- # '[' -z 3424771 ']' 00:06:27.063 12:33:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.063 12:33:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.063 12:33:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.063 12:33:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.063 12:33:59 -- common/autotest_common.sh@10 -- # set +x 00:06:27.063 [2024-11-20 12:33:59.961402] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.063 [2024-11-20 12:33:59.961496] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:27.063 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.063 [2024-11-20 12:34:00.035913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.063 [2024-11-20 12:34:00.157654] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.063 [2024-11-20 12:34:00.157826] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:27.063 [2024-11-20 12:34:00.157845] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:27.063 [2024-11-20 12:34:00.157859] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:27.063 [2024-11-20 12:34:00.157923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.063 [2024-11-20 12:34:00.157981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.063 [2024-11-20 12:34:00.158016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.063 [2024-11-20 12:34:00.158020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.003 12:34:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.003 12:34:01 -- common/autotest_common.sh@862 -- # return 0 00:06:28.003 12:34:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:28.003 12:34:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:28.003 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.003 12:34:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:28.003 12:34:01 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:28.003 12:34:01 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:28.003 12:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.003 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.003 [2024-11-20 12:34:01.039970] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:28.003 12:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.003 12:34:01 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:28.003 12:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.003 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.261 Malloc1 00:06:28.261 12:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.261 12:34:01 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:28.261 12:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.261 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.261 12:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.261 12:34:01 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:28.261 12:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.261 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.261 12:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.261 12:34:01 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:28.261 12:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.261 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.261 [2024-11-20 12:34:01.219574] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:28.261 12:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.261 12:34:01 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:28.261 12:34:01 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:28.261 12:34:01 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:28.261 12:34:01 -- common/autotest_common.sh@1369 -- # local bs 00:06:28.261 12:34:01 -- common/autotest_common.sh@1370 -- # local nb 00:06:28.261 12:34:01 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:28.261 12:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.261 12:34:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.261 12:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.261 12:34:01 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:28.261 { 00:06:28.261 "name": "Malloc1", 00:06:28.261 "aliases": [ 00:06:28.261 "d29028ed-a319-4e8f-ab57-ff2ceb12c3cc" 00:06:28.261 ], 00:06:28.261 "product_name": "Malloc disk", 00:06:28.261 "block_size": 512, 00:06:28.261 "num_blocks": 1048576, 00:06:28.261 "uuid": "d29028ed-a319-4e8f-ab57-ff2ceb12c3cc", 00:06:28.261 "assigned_rate_limits": { 00:06:28.261 "rw_ios_per_sec": 0, 00:06:28.261 "rw_mbytes_per_sec": 0, 00:06:28.261 "r_mbytes_per_sec": 0, 00:06:28.261 "w_mbytes_per_sec": 0 00:06:28.261 }, 00:06:28.261 "claimed": true, 00:06:28.261 "claim_type": "exclusive_write", 00:06:28.261 "zoned": false, 00:06:28.261 "supported_io_types": { 00:06:28.261 "read": true, 00:06:28.261 "write": true, 00:06:28.261 "unmap": true, 00:06:28.261 "write_zeroes": true, 00:06:28.261 "flush": true, 00:06:28.261 "reset": true, 00:06:28.261 "compare": false, 00:06:28.261 "compare_and_write": false, 00:06:28.261 "abort": true, 00:06:28.261 "nvme_admin": false, 00:06:28.261 "nvme_io": false 00:06:28.261 }, 00:06:28.261 "memory_domains": [ 00:06:28.261 { 00:06:28.261 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:28.261 "dma_device_type": 2 00:06:28.261 } 00:06:28.261 ], 00:06:28.261 "driver_specific": {} 00:06:28.261 } 00:06:28.261 ]' 00:06:28.261 12:34:01 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:28.261 12:34:01 -- common/autotest_common.sh@1372 -- # bs=512 00:06:28.261 12:34:01 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:28.261 12:34:01 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:28.261 12:34:01 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:28.261 12:34:01 -- common/autotest_common.sh@1377 -- # echo 512 00:06:28.261 12:34:01 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:28.261 12:34:01 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:29.202 12:34:01 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:29.202 12:34:01 -- common/autotest_common.sh@1187 -- # local i=0 00:06:29.202 12:34:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:29.202 12:34:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:29.202 12:34:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:31.109 12:34:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:31.109 12:34:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:31.109 12:34:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:31.109 12:34:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:31.109 12:34:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:31.109 12:34:04 -- common/autotest_common.sh@1197 -- # return 0 00:06:31.109 12:34:04 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:31.109 12:34:04 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:31.109 12:34:04 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:31.109 12:34:04 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:31.109 12:34:04 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:31.109 12:34:04 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:31.109 12:34:04 -- setup/common.sh@80 -- # echo 536870912 00:06:31.109 12:34:04 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:31.109 12:34:04 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:31.109 12:34:04 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:31.109 12:34:04 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:31.109 12:34:04 -- target/filesystem.sh@69 -- # partprobe 00:06:32.048 12:34:04 -- target/filesystem.sh@70 -- # sleep 1 00:06:32.988 12:34:05 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:32.988 12:34:05 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:32.988 12:34:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:32.988 12:34:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.988 12:34:05 -- common/autotest_common.sh@10 -- # set +x 00:06:32.988 ************************************ 00:06:32.988 START TEST filesystem_in_capsule_ext4 00:06:32.988 ************************************ 00:06:32.988 12:34:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:32.988 12:34:05 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:32.988 12:34:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:32.988 12:34:05 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:32.988 12:34:05 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:32.988 12:34:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:32.988 12:34:05 -- common/autotest_common.sh@914 -- # local i=0 00:06:32.988 12:34:05 -- common/autotest_common.sh@915 -- # local force 00:06:32.988 12:34:05 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:32.988 12:34:05 -- common/autotest_common.sh@918 -- # force=-F 00:06:32.988 12:34:05 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:32.988 mke2fs 1.47.0 (5-Feb-2023) 00:06:32.988 Discarding device blocks: 0/522240 done 00:06:32.988 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:32.988 Filesystem UUID: 981c5a37-fc3e-476a-9a6b-81c897debfcc 00:06:32.988 Superblock backups stored on blocks: 00:06:32.988 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:32.988 00:06:32.988 Allocating group tables: 0/64 done 00:06:32.988 Writing inode tables: 0/64 done 00:06:36.279 Creating journal (8192 blocks): done 00:06:36.280 Writing superblocks and filesystem accounting information: 0/64 done 00:06:36.280 00:06:36.280 12:34:08 -- common/autotest_common.sh@931 -- # return 0 00:06:36.280 12:34:08 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:41.560 12:34:14 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:41.560 12:34:14 -- target/filesystem.sh@25 -- # sync 00:06:41.560 12:34:14 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:41.560 12:34:14 -- target/filesystem.sh@27 -- # sync 00:06:41.560 12:34:14 -- target/filesystem.sh@29 -- # i=0 00:06:41.560 12:34:14 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:41.560 12:34:14 -- target/filesystem.sh@37 -- # kill -0 3424771 00:06:41.560 12:34:14 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:41.560 12:34:14 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:41.560 12:34:14 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:41.560 12:34:14 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:41.560 00:06:41.560 real 0m8.338s 00:06:41.560 user 0m0.019s 00:06:41.560 sys 0m0.066s 00:06:41.560 12:34:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.560 12:34:14 -- common/autotest_common.sh@10 -- # set +x 00:06:41.560 ************************************ 00:06:41.560 END TEST filesystem_in_capsule_ext4 00:06:41.560 ************************************ 00:06:41.560 12:34:14 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:41.560 12:34:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:41.560 12:34:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.560 12:34:14 -- common/autotest_common.sh@10 -- # set +x 00:06:41.560 ************************************ 00:06:41.560 START TEST filesystem_in_capsule_btrfs 00:06:41.560 ************************************ 00:06:41.560 12:34:14 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:41.560 12:34:14 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:41.560 12:34:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:41.560 12:34:14 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:41.560 12:34:14 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:41.560 12:34:14 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:41.560 12:34:14 -- common/autotest_common.sh@914 -- # local i=0 00:06:41.560 12:34:14 -- common/autotest_common.sh@915 -- # local force 00:06:41.560 12:34:14 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:41.560 12:34:14 -- common/autotest_common.sh@920 -- # force=-f 00:06:41.560 12:34:14 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:41.560 btrfs-progs v6.8.1 00:06:41.560 See https://btrfs.readthedocs.io for more information. 00:06:41.560 00:06:41.560 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:41.560 NOTE: several default settings have changed in version 5.15, please make sure 00:06:41.560 this does not affect your deployments: 00:06:41.560 - DUP for metadata (-m dup) 00:06:41.560 - enabled no-holes (-O no-holes) 00:06:41.560 - enabled free-space-tree (-R free-space-tree) 00:06:41.560 00:06:41.560 Label: (null) 00:06:41.560 UUID: 2d820043-0b31-4377-a997-1efeb54d1f14 00:06:41.560 Node size: 16384 00:06:41.560 Sector size: 4096 (CPU page size: 4096) 00:06:41.560 Filesystem size: 510.00MiB 00:06:41.560 Block group profiles: 00:06:41.560 Data: single 8.00MiB 00:06:41.560 Metadata: DUP 32.00MiB 00:06:41.560 System: DUP 8.00MiB 00:06:41.560 SSD detected: yes 00:06:41.560 Zoned device: no 00:06:41.560 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:41.560 Checksum: crc32c 00:06:41.560 Number of devices: 1 00:06:41.560 Devices: 00:06:41.560 ID SIZE PATH 00:06:41.560 1 510.00MiB /dev/nvme0n1p1 00:06:41.560 00:06:41.560 12:34:14 -- common/autotest_common.sh@931 -- # return 0 00:06:41.560 12:34:14 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:42.497 12:34:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:42.497 12:34:15 -- target/filesystem.sh@25 -- # sync 00:06:42.497 12:34:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:42.497 12:34:15 -- target/filesystem.sh@27 -- # sync 00:06:42.497 12:34:15 -- target/filesystem.sh@29 -- # i=0 00:06:42.497 12:34:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:42.497 12:34:15 -- target/filesystem.sh@37 -- # kill -0 3424771 00:06:42.497 12:34:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:42.497 12:34:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:42.497 12:34:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:42.497 12:34:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:42.497 00:06:42.497 real 0m1.188s 00:06:42.497 user 0m0.021s 00:06:42.497 sys 0m0.100s 00:06:42.497 12:34:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.497 12:34:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.497 ************************************ 00:06:42.497 END TEST filesystem_in_capsule_btrfs 00:06:42.497 ************************************ 00:06:42.497 12:34:15 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:06:42.497 12:34:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:42.497 12:34:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.497 12:34:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.497 ************************************ 00:06:42.497 START TEST filesystem_in_capsule_xfs 00:06:42.497 ************************************ 00:06:42.497 12:34:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:42.497 12:34:15 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:42.497 12:34:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:42.497 12:34:15 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:42.497 12:34:15 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:42.497 12:34:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:42.497 12:34:15 -- common/autotest_common.sh@914 -- # local i=0 00:06:42.497 12:34:15 -- common/autotest_common.sh@915 -- # local force 00:06:42.497 12:34:15 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:42.497 12:34:15 -- common/autotest_common.sh@920 -- # force=-f 00:06:42.497 12:34:15 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:42.497 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:42.497 = sectsz=512 attr=2, projid32bit=1 00:06:42.497 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:42.497 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:42.497 data = bsize=4096 blocks=130560, imaxpct=25 00:06:42.497 = sunit=0 swidth=0 blks 00:06:42.497 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:42.497 log =internal log bsize=4096 blocks=16384, version=2 00:06:42.497 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:42.497 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:43.433 Discarding blocks...Done. 00:06:43.433 12:34:16 -- common/autotest_common.sh@931 -- # return 0 00:06:43.434 12:34:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:45.338 12:34:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:45.598 12:34:18 -- target/filesystem.sh@25 -- # sync 00:06:45.598 12:34:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:45.598 12:34:18 -- target/filesystem.sh@27 -- # sync 00:06:45.598 12:34:18 -- target/filesystem.sh@29 -- # i=0 00:06:45.598 12:34:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:45.598 12:34:18 -- target/filesystem.sh@37 -- # kill -0 3424771 00:06:45.598 12:34:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:45.598 12:34:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:45.598 12:34:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:45.598 12:34:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:45.598 00:06:45.598 real 0m3.054s 00:06:45.598 user 0m0.017s 00:06:45.598 sys 0m0.060s 00:06:45.598 12:34:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.598 12:34:18 -- common/autotest_common.sh@10 -- # set +x 00:06:45.598 ************************************ 00:06:45.598 END TEST filesystem_in_capsule_xfs 00:06:45.598 ************************************ 00:06:45.598 12:34:18 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:45.598 12:34:18 -- target/filesystem.sh@93 -- # sync 00:06:45.598 12:34:18 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:45.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:45.598 12:34:18 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:45.598 12:34:18 -- common/autotest_common.sh@1208 -- # local i=0 00:06:45.598 12:34:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:45.598 12:34:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:45.598 12:34:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:45.598 12:34:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:45.598 12:34:18 -- common/autotest_common.sh@1220 -- # return 0 00:06:45.598 12:34:18 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:45.598 12:34:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.598 12:34:18 -- common/autotest_common.sh@10 -- # set +x 00:06:45.598 12:34:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.598 12:34:18 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:45.598 12:34:18 -- target/filesystem.sh@101 -- # killprocess 3424771 00:06:45.598 12:34:18 -- common/autotest_common.sh@936 -- # '[' -z 3424771 ']' 00:06:45.598 12:34:18 -- common/autotest_common.sh@940 -- # kill -0 3424771 00:06:45.598 12:34:18 -- common/autotest_common.sh@941 -- # uname 00:06:45.598 12:34:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:45.598 12:34:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3424771 00:06:45.598 12:34:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:45.598 12:34:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:45.598 12:34:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3424771' 00:06:45.598 killing process with pid 3424771 00:06:45.598 12:34:18 -- common/autotest_common.sh@955 -- # kill 3424771 00:06:45.598 12:34:18 -- common/autotest_common.sh@960 -- # wait 3424771 00:06:46.166 12:34:19 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:46.166 00:06:46.166 real 0m19.257s 00:06:46.166 user 1m14.519s 00:06:46.166 sys 0m2.337s 00:06:46.166 12:34:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.166 12:34:19 -- common/autotest_common.sh@10 -- # set +x 00:06:46.166 ************************************ 00:06:46.166 END TEST nvmf_filesystem_in_capsule 00:06:46.166 ************************************ 00:06:46.166 12:34:19 -- target/filesystem.sh@108 -- # nvmftestfini 00:06:46.166 12:34:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:46.166 12:34:19 -- nvmf/common.sh@116 -- # sync 00:06:46.166 12:34:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:46.166 12:34:19 -- nvmf/common.sh@119 -- # set +e 00:06:46.166 12:34:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:46.166 12:34:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:46.166 rmmod nvme_tcp 00:06:46.166 rmmod nvme_fabrics 00:06:46.166 rmmod nvme_keyring 00:06:46.166 12:34:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:46.166 12:34:19 -- nvmf/common.sh@123 -- # set -e 00:06:46.166 12:34:19 -- nvmf/common.sh@124 -- # return 0 00:06:46.166 12:34:19 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:06:46.166 12:34:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:46.166 12:34:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:46.166 12:34:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:46.166 12:34:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:46.166 12:34:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:46.166 12:34:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:46.166 12:34:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:46.166 12:34:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:48.773 12:34:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:48.773 00:06:48.773 real 0m41.229s 00:06:48.773 user 2m22.044s 00:06:48.773 sys 0m6.241s 00:06:48.773 12:34:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.773 12:34:21 -- common/autotest_common.sh@10 -- # set +x 00:06:48.773 ************************************ 00:06:48.773 END TEST nvmf_filesystem 00:06:48.773 ************************************ 00:06:48.773 12:34:21 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:06:48.773 12:34:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:48.773 12:34:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.773 12:34:21 -- common/autotest_common.sh@10 -- # set +x 00:06:48.773 ************************************ 00:06:48.773 START TEST nvmf_discovery 00:06:48.773 ************************************ 00:06:48.773 12:34:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:06:48.773 * Looking for test storage... 00:06:48.773 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.773 12:34:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:48.773 12:34:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:48.773 12:34:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:48.773 12:34:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:48.773 12:34:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:48.773 12:34:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:48.773 12:34:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:48.773 12:34:21 -- scripts/common.sh@335 -- # IFS=.-: 00:06:48.773 12:34:21 -- scripts/common.sh@335 -- # read -ra ver1 00:06:48.773 12:34:21 -- scripts/common.sh@336 -- # IFS=.-: 00:06:48.773 12:34:21 -- scripts/common.sh@336 -- # read -ra ver2 00:06:48.773 12:34:21 -- scripts/common.sh@337 -- # local 'op=<' 00:06:48.773 12:34:21 -- scripts/common.sh@339 -- # ver1_l=2 00:06:48.773 12:34:21 -- scripts/common.sh@340 -- # ver2_l=1 00:06:48.773 12:34:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:48.773 12:34:21 -- scripts/common.sh@343 -- # case "$op" in 00:06:48.773 12:34:21 -- scripts/common.sh@344 -- # : 1 00:06:48.773 12:34:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:48.773 12:34:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:48.773 12:34:21 -- scripts/common.sh@364 -- # decimal 1 00:06:48.773 12:34:21 -- scripts/common.sh@352 -- # local d=1 00:06:48.773 12:34:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:48.774 12:34:21 -- scripts/common.sh@354 -- # echo 1 00:06:48.774 12:34:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:48.774 12:34:21 -- scripts/common.sh@365 -- # decimal 2 00:06:48.774 12:34:21 -- scripts/common.sh@352 -- # local d=2 00:06:48.774 12:34:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:48.774 12:34:21 -- scripts/common.sh@354 -- # echo 2 00:06:48.774 12:34:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:48.774 12:34:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:48.774 12:34:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:48.774 12:34:21 -- scripts/common.sh@367 -- # return 0 00:06:48.774 12:34:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:48.774 12:34:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:48.774 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.774 --rc genhtml_branch_coverage=1 00:06:48.774 --rc genhtml_function_coverage=1 00:06:48.774 --rc genhtml_legend=1 00:06:48.774 --rc geninfo_all_blocks=1 00:06:48.774 --rc geninfo_unexecuted_blocks=1 00:06:48.774 00:06:48.774 ' 00:06:48.774 12:34:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:48.774 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.774 --rc genhtml_branch_coverage=1 00:06:48.774 --rc genhtml_function_coverage=1 00:06:48.774 --rc genhtml_legend=1 00:06:48.774 --rc geninfo_all_blocks=1 00:06:48.774 --rc geninfo_unexecuted_blocks=1 00:06:48.774 00:06:48.774 ' 00:06:48.774 12:34:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:48.774 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.774 --rc genhtml_branch_coverage=1 00:06:48.774 --rc genhtml_function_coverage=1 00:06:48.774 --rc genhtml_legend=1 00:06:48.774 --rc geninfo_all_blocks=1 00:06:48.774 --rc geninfo_unexecuted_blocks=1 00:06:48.774 00:06:48.774 ' 00:06:48.774 12:34:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:48.774 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.774 --rc genhtml_branch_coverage=1 00:06:48.774 --rc genhtml_function_coverage=1 00:06:48.774 --rc genhtml_legend=1 00:06:48.774 --rc geninfo_all_blocks=1 00:06:48.774 --rc geninfo_unexecuted_blocks=1 00:06:48.774 00:06:48.774 ' 00:06:48.774 12:34:21 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:48.774 12:34:21 -- nvmf/common.sh@7 -- # uname -s 00:06:48.774 12:34:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:48.774 12:34:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:48.774 12:34:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:48.774 12:34:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:48.774 12:34:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:48.774 12:34:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:48.774 12:34:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:48.774 12:34:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:48.774 12:34:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:48.774 12:34:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:48.774 12:34:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:48.774 12:34:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:48.774 12:34:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:48.774 12:34:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:48.774 12:34:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:48.774 12:34:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:48.774 12:34:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:48.774 12:34:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:48.774 12:34:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:48.774 12:34:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.774 12:34:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.774 12:34:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.774 12:34:21 -- paths/export.sh@5 -- # export PATH 00:06:48.774 12:34:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.774 12:34:21 -- nvmf/common.sh@46 -- # : 0 00:06:48.774 12:34:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:48.774 12:34:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:48.774 12:34:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:48.774 12:34:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:48.774 12:34:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:48.774 12:34:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:48.774 12:34:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:48.774 12:34:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:48.774 12:34:21 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:06:48.774 12:34:21 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:06:48.774 12:34:21 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:06:48.774 12:34:21 -- target/discovery.sh@15 -- # hash nvme 00:06:48.774 12:34:21 -- target/discovery.sh@20 -- # nvmftestinit 00:06:48.774 12:34:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:48.774 12:34:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:48.774 12:34:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:48.774 12:34:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:48.774 12:34:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:48.774 12:34:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:48.774 12:34:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:48.774 12:34:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:48.774 12:34:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:48.774 12:34:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:48.774 12:34:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:48.774 12:34:21 -- common/autotest_common.sh@10 -- # set +x 00:06:50.679 12:34:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:50.679 12:34:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:50.679 12:34:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:50.679 12:34:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:50.679 12:34:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:50.679 12:34:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:50.679 12:34:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:50.679 12:34:23 -- nvmf/common.sh@294 -- # net_devs=() 00:06:50.679 12:34:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:50.679 12:34:23 -- nvmf/common.sh@295 -- # e810=() 00:06:50.679 12:34:23 -- nvmf/common.sh@295 -- # local -ga e810 00:06:50.679 12:34:23 -- nvmf/common.sh@296 -- # x722=() 00:06:50.679 12:34:23 -- nvmf/common.sh@296 -- # local -ga x722 00:06:50.679 12:34:23 -- nvmf/common.sh@297 -- # mlx=() 00:06:50.679 12:34:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:50.679 12:34:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:50.679 12:34:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:50.679 12:34:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:50.679 12:34:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:50.679 12:34:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:50.679 12:34:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:50.679 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:50.679 12:34:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:50.679 12:34:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:50.679 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:50.679 12:34:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:50.679 12:34:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:50.679 12:34:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:50.679 12:34:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:50.679 12:34:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:50.679 12:34:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:50.679 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:50.679 12:34:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:50.679 12:34:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:50.679 12:34:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:50.679 12:34:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:50.679 12:34:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:50.679 12:34:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:50.679 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:50.679 12:34:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:50.679 12:34:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:50.679 12:34:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:50.679 12:34:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:50.679 12:34:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:50.679 12:34:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:50.679 12:34:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:50.679 12:34:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:50.679 12:34:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:50.679 12:34:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:50.679 12:34:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:50.679 12:34:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:50.679 12:34:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:50.679 12:34:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:50.679 12:34:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:50.679 12:34:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:50.679 12:34:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:50.679 12:34:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:50.679 12:34:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:50.679 12:34:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:50.679 12:34:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:50.679 12:34:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:50.937 12:34:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:50.937 12:34:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:50.937 12:34:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:50.937 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:50.937 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:06:50.937 00:06:50.937 --- 10.0.0.2 ping statistics --- 00:06:50.937 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:50.937 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:06:50.937 12:34:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:50.937 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:50.937 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:06:50.937 00:06:50.937 --- 10.0.0.1 ping statistics --- 00:06:50.937 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:50.937 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:06:50.937 12:34:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:50.937 12:34:23 -- nvmf/common.sh@410 -- # return 0 00:06:50.937 12:34:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:50.937 12:34:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:50.937 12:34:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:50.937 12:34:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:50.937 12:34:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:50.937 12:34:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:50.937 12:34:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:50.937 12:34:23 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:06:50.937 12:34:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:50.937 12:34:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:50.938 12:34:23 -- common/autotest_common.sh@10 -- # set +x 00:06:50.938 12:34:23 -- nvmf/common.sh@469 -- # nvmfpid=3429216 00:06:50.938 12:34:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:50.938 12:34:23 -- nvmf/common.sh@470 -- # waitforlisten 3429216 00:06:50.938 12:34:23 -- common/autotest_common.sh@829 -- # '[' -z 3429216 ']' 00:06:50.938 12:34:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:50.938 12:34:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.938 12:34:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:50.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:50.938 12:34:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.938 12:34:23 -- common/autotest_common.sh@10 -- # set +x 00:06:50.938 [2024-11-20 12:34:23.890278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.938 [2024-11-20 12:34:23.890363] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:50.938 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.938 [2024-11-20 12:34:23.966347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:51.197 [2024-11-20 12:34:24.088461] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.197 [2024-11-20 12:34:24.088610] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:51.197 [2024-11-20 12:34:24.088629] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:51.197 [2024-11-20 12:34:24.088643] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:51.197 [2024-11-20 12:34:24.088726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:51.197 [2024-11-20 12:34:24.088794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:51.197 [2024-11-20 12:34:24.088797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.197 [2024-11-20 12:34:24.088744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:52.135 12:34:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.135 12:34:24 -- common/autotest_common.sh@862 -- # return 0 00:06:52.135 12:34:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:52.135 12:34:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:52.135 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.135 12:34:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:52.135 12:34:24 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:52.135 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.135 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.135 [2024-11-20 12:34:24.929793] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:52.135 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.135 12:34:24 -- target/discovery.sh@26 -- # seq 1 4 00:06:52.135 12:34:24 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:52.135 12:34:24 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:06:52.135 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.135 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.135 Null1 00:06:52.135 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.135 12:34:24 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:52.135 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.135 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.135 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.135 12:34:24 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:06:52.135 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.135 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.135 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.135 12:34:24 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:52.135 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.135 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 [2024-11-20 12:34:24.970186] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:52.136 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:24 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:52.136 12:34:24 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:06:52.136 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 Null2 00:06:52.136 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:24 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:06:52.136 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:24 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:06:52.136 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:24 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:06:52.136 12:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:52.136 12:34:25 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 Null3 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:52.136 12:34:25 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 Null4 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:06:52.136 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.136 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.136 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.136 12:34:25 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:06:52.395 00:06:52.395 Discovery Log Number of Records 6, Generation counter 6 00:06:52.395 =====Discovery Log Entry 0====== 00:06:52.395 trtype: tcp 00:06:52.395 adrfam: ipv4 00:06:52.395 subtype: current discovery subsystem 00:06:52.395 treq: not required 00:06:52.395 portid: 0 00:06:52.395 trsvcid: 4420 00:06:52.395 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:06:52.395 traddr: 10.0.0.2 00:06:52.395 eflags: explicit discovery connections, duplicate discovery information 00:06:52.395 sectype: none 00:06:52.395 =====Discovery Log Entry 1====== 00:06:52.395 trtype: tcp 00:06:52.395 adrfam: ipv4 00:06:52.395 subtype: nvme subsystem 00:06:52.395 treq: not required 00:06:52.395 portid: 0 00:06:52.395 trsvcid: 4420 00:06:52.395 subnqn: nqn.2016-06.io.spdk:cnode1 00:06:52.395 traddr: 10.0.0.2 00:06:52.395 eflags: none 00:06:52.395 sectype: none 00:06:52.395 =====Discovery Log Entry 2====== 00:06:52.395 trtype: tcp 00:06:52.395 adrfam: ipv4 00:06:52.395 subtype: nvme subsystem 00:06:52.395 treq: not required 00:06:52.395 portid: 0 00:06:52.395 trsvcid: 4420 00:06:52.395 subnqn: nqn.2016-06.io.spdk:cnode2 00:06:52.395 traddr: 10.0.0.2 00:06:52.395 eflags: none 00:06:52.395 sectype: none 00:06:52.395 =====Discovery Log Entry 3====== 00:06:52.395 trtype: tcp 00:06:52.395 adrfam: ipv4 00:06:52.395 subtype: nvme subsystem 00:06:52.395 treq: not required 00:06:52.395 portid: 0 00:06:52.395 trsvcid: 4420 00:06:52.395 subnqn: nqn.2016-06.io.spdk:cnode3 00:06:52.395 traddr: 10.0.0.2 00:06:52.395 eflags: none 00:06:52.395 sectype: none 00:06:52.395 =====Discovery Log Entry 4====== 00:06:52.395 trtype: tcp 00:06:52.395 adrfam: ipv4 00:06:52.395 subtype: nvme subsystem 00:06:52.395 treq: not required 00:06:52.395 portid: 0 00:06:52.395 trsvcid: 4420 00:06:52.395 subnqn: nqn.2016-06.io.spdk:cnode4 00:06:52.395 traddr: 10.0.0.2 00:06:52.395 eflags: none 00:06:52.395 sectype: none 00:06:52.395 =====Discovery Log Entry 5====== 00:06:52.395 trtype: tcp 00:06:52.395 adrfam: ipv4 00:06:52.395 subtype: discovery subsystem referral 00:06:52.395 treq: not required 00:06:52.395 portid: 0 00:06:52.395 trsvcid: 4430 00:06:52.395 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:06:52.395 traddr: 10.0.0.2 00:06:52.395 eflags: none 00:06:52.395 sectype: none 00:06:52.395 12:34:25 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:06:52.395 Perform nvmf subsystem discovery via RPC 00:06:52.395 12:34:25 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:06:52.395 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.395 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.395 [2024-11-20 12:34:25.307105] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:06:52.395 [ 00:06:52.395 { 00:06:52.395 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:06:52.395 "subtype": "Discovery", 00:06:52.395 "listen_addresses": [ 00:06:52.395 { 00:06:52.395 "transport": "TCP", 00:06:52.395 "trtype": "TCP", 00:06:52.395 "adrfam": "IPv4", 00:06:52.395 "traddr": "10.0.0.2", 00:06:52.395 "trsvcid": "4420" 00:06:52.395 } 00:06:52.395 ], 00:06:52.395 "allow_any_host": true, 00:06:52.395 "hosts": [] 00:06:52.395 }, 00:06:52.395 { 00:06:52.395 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:06:52.395 "subtype": "NVMe", 00:06:52.395 "listen_addresses": [ 00:06:52.395 { 00:06:52.395 "transport": "TCP", 00:06:52.395 "trtype": "TCP", 00:06:52.395 "adrfam": "IPv4", 00:06:52.395 "traddr": "10.0.0.2", 00:06:52.395 "trsvcid": "4420" 00:06:52.395 } 00:06:52.395 ], 00:06:52.395 "allow_any_host": true, 00:06:52.395 "hosts": [], 00:06:52.395 "serial_number": "SPDK00000000000001", 00:06:52.395 "model_number": "SPDK bdev Controller", 00:06:52.396 "max_namespaces": 32, 00:06:52.396 "min_cntlid": 1, 00:06:52.396 "max_cntlid": 65519, 00:06:52.396 "namespaces": [ 00:06:52.396 { 00:06:52.396 "nsid": 1, 00:06:52.396 "bdev_name": "Null1", 00:06:52.396 "name": "Null1", 00:06:52.396 "nguid": "DAFC6FE25EE3492A8F3C1DB220B19979", 00:06:52.396 "uuid": "dafc6fe2-5ee3-492a-8f3c-1db220b19979" 00:06:52.396 } 00:06:52.396 ] 00:06:52.396 }, 00:06:52.396 { 00:06:52.396 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:06:52.396 "subtype": "NVMe", 00:06:52.396 "listen_addresses": [ 00:06:52.396 { 00:06:52.396 "transport": "TCP", 00:06:52.396 "trtype": "TCP", 00:06:52.396 "adrfam": "IPv4", 00:06:52.396 "traddr": "10.0.0.2", 00:06:52.396 "trsvcid": "4420" 00:06:52.396 } 00:06:52.396 ], 00:06:52.396 "allow_any_host": true, 00:06:52.396 "hosts": [], 00:06:52.396 "serial_number": "SPDK00000000000002", 00:06:52.396 "model_number": "SPDK bdev Controller", 00:06:52.396 "max_namespaces": 32, 00:06:52.396 "min_cntlid": 1, 00:06:52.396 "max_cntlid": 65519, 00:06:52.396 "namespaces": [ 00:06:52.396 { 00:06:52.396 "nsid": 1, 00:06:52.396 "bdev_name": "Null2", 00:06:52.396 "name": "Null2", 00:06:52.396 "nguid": "CD4B3FE87CFB483FBB2E863C17D45CBD", 00:06:52.396 "uuid": "cd4b3fe8-7cfb-483f-bb2e-863c17d45cbd" 00:06:52.396 } 00:06:52.396 ] 00:06:52.396 }, 00:06:52.396 { 00:06:52.396 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:06:52.396 "subtype": "NVMe", 00:06:52.396 "listen_addresses": [ 00:06:52.396 { 00:06:52.396 "transport": "TCP", 00:06:52.396 "trtype": "TCP", 00:06:52.396 "adrfam": "IPv4", 00:06:52.396 "traddr": "10.0.0.2", 00:06:52.396 "trsvcid": "4420" 00:06:52.396 } 00:06:52.396 ], 00:06:52.396 "allow_any_host": true, 00:06:52.396 "hosts": [], 00:06:52.396 "serial_number": "SPDK00000000000003", 00:06:52.396 "model_number": "SPDK bdev Controller", 00:06:52.396 "max_namespaces": 32, 00:06:52.396 "min_cntlid": 1, 00:06:52.396 "max_cntlid": 65519, 00:06:52.396 "namespaces": [ 00:06:52.396 { 00:06:52.396 "nsid": 1, 00:06:52.396 "bdev_name": "Null3", 00:06:52.396 "name": "Null3", 00:06:52.396 "nguid": "248CB724929C47EBA2FB40F9A5DB5C0D", 00:06:52.396 "uuid": "248cb724-929c-47eb-a2fb-40f9a5db5c0d" 00:06:52.396 } 00:06:52.396 ] 00:06:52.396 }, 00:06:52.396 { 00:06:52.396 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:06:52.396 "subtype": "NVMe", 00:06:52.396 "listen_addresses": [ 00:06:52.396 { 00:06:52.396 "transport": "TCP", 00:06:52.396 "trtype": "TCP", 00:06:52.396 "adrfam": "IPv4", 00:06:52.396 "traddr": "10.0.0.2", 00:06:52.396 "trsvcid": "4420" 00:06:52.396 } 00:06:52.396 ], 00:06:52.396 "allow_any_host": true, 00:06:52.396 "hosts": [], 00:06:52.396 "serial_number": "SPDK00000000000004", 00:06:52.396 "model_number": "SPDK bdev Controller", 00:06:52.396 "max_namespaces": 32, 00:06:52.396 "min_cntlid": 1, 00:06:52.396 "max_cntlid": 65519, 00:06:52.396 "namespaces": [ 00:06:52.396 { 00:06:52.396 "nsid": 1, 00:06:52.396 "bdev_name": "Null4", 00:06:52.396 "name": "Null4", 00:06:52.396 "nguid": "D7D6F952DD904EFCAC6BE77CA2CAED06", 00:06:52.396 "uuid": "d7d6f952-dd90-4efc-ac6b-e77ca2caed06" 00:06:52.396 } 00:06:52.396 ] 00:06:52.396 } 00:06:52.396 ] 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@42 -- # seq 1 4 00:06:52.396 12:34:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:52.396 12:34:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:52.396 12:34:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:52.396 12:34:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:52.396 12:34:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:06:52.396 12:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.396 12:34:25 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:06:52.396 12:34:25 -- common/autotest_common.sh@10 -- # set +x 00:06:52.396 12:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.396 12:34:25 -- target/discovery.sh@49 -- # check_bdevs= 00:06:52.396 12:34:25 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:06:52.396 12:34:25 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:06:52.396 12:34:25 -- target/discovery.sh@57 -- # nvmftestfini 00:06:52.396 12:34:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:52.396 12:34:25 -- nvmf/common.sh@116 -- # sync 00:06:52.396 12:34:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:52.396 12:34:25 -- nvmf/common.sh@119 -- # set +e 00:06:52.396 12:34:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:52.396 12:34:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:52.396 rmmod nvme_tcp 00:06:52.396 rmmod nvme_fabrics 00:06:52.396 rmmod nvme_keyring 00:06:52.396 12:34:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:52.396 12:34:25 -- nvmf/common.sh@123 -- # set -e 00:06:52.396 12:34:25 -- nvmf/common.sh@124 -- # return 0 00:06:52.396 12:34:25 -- nvmf/common.sh@477 -- # '[' -n 3429216 ']' 00:06:52.396 12:34:25 -- nvmf/common.sh@478 -- # killprocess 3429216 00:06:52.396 12:34:25 -- common/autotest_common.sh@936 -- # '[' -z 3429216 ']' 00:06:52.396 12:34:25 -- common/autotest_common.sh@940 -- # kill -0 3429216 00:06:52.396 12:34:25 -- common/autotest_common.sh@941 -- # uname 00:06:52.396 12:34:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:52.396 12:34:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3429216 00:06:52.655 12:34:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:52.655 12:34:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:52.655 12:34:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3429216' 00:06:52.655 killing process with pid 3429216 00:06:52.655 12:34:25 -- common/autotest_common.sh@955 -- # kill 3429216 00:06:52.655 [2024-11-20 12:34:25.533184] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:06:52.655 12:34:25 -- common/autotest_common.sh@960 -- # wait 3429216 00:06:52.916 12:34:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:52.916 12:34:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:52.916 12:34:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:52.916 12:34:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:52.916 12:34:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:52.916 12:34:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:52.916 12:34:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:52.916 12:34:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:54.824 12:34:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:54.824 00:06:54.824 real 0m6.539s 00:06:54.824 user 0m7.901s 00:06:54.824 sys 0m1.967s 00:06:54.824 12:34:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.824 12:34:27 -- common/autotest_common.sh@10 -- # set +x 00:06:54.824 ************************************ 00:06:54.824 END TEST nvmf_discovery 00:06:54.824 ************************************ 00:06:54.824 12:34:27 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:06:54.824 12:34:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:54.824 12:34:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.824 12:34:27 -- common/autotest_common.sh@10 -- # set +x 00:06:54.824 ************************************ 00:06:54.824 START TEST nvmf_referrals 00:06:54.824 ************************************ 00:06:54.824 12:34:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:06:55.083 * Looking for test storage... 00:06:55.083 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.083 12:34:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:55.083 12:34:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:55.083 12:34:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:55.083 12:34:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:55.083 12:34:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:55.083 12:34:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:55.083 12:34:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:55.083 12:34:28 -- scripts/common.sh@335 -- # IFS=.-: 00:06:55.083 12:34:28 -- scripts/common.sh@335 -- # read -ra ver1 00:06:55.083 12:34:28 -- scripts/common.sh@336 -- # IFS=.-: 00:06:55.083 12:34:28 -- scripts/common.sh@336 -- # read -ra ver2 00:06:55.083 12:34:28 -- scripts/common.sh@337 -- # local 'op=<' 00:06:55.083 12:34:28 -- scripts/common.sh@339 -- # ver1_l=2 00:06:55.083 12:34:28 -- scripts/common.sh@340 -- # ver2_l=1 00:06:55.083 12:34:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:55.083 12:34:28 -- scripts/common.sh@343 -- # case "$op" in 00:06:55.083 12:34:28 -- scripts/common.sh@344 -- # : 1 00:06:55.083 12:34:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:55.083 12:34:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:55.083 12:34:28 -- scripts/common.sh@364 -- # decimal 1 00:06:55.083 12:34:28 -- scripts/common.sh@352 -- # local d=1 00:06:55.083 12:34:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:55.083 12:34:28 -- scripts/common.sh@354 -- # echo 1 00:06:55.083 12:34:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:55.083 12:34:28 -- scripts/common.sh@365 -- # decimal 2 00:06:55.083 12:34:28 -- scripts/common.sh@352 -- # local d=2 00:06:55.083 12:34:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:55.083 12:34:28 -- scripts/common.sh@354 -- # echo 2 00:06:55.083 12:34:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:55.083 12:34:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:55.083 12:34:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:55.083 12:34:28 -- scripts/common.sh@367 -- # return 0 00:06:55.083 12:34:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:55.083 12:34:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:55.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.083 --rc genhtml_branch_coverage=1 00:06:55.083 --rc genhtml_function_coverage=1 00:06:55.083 --rc genhtml_legend=1 00:06:55.083 --rc geninfo_all_blocks=1 00:06:55.083 --rc geninfo_unexecuted_blocks=1 00:06:55.083 00:06:55.083 ' 00:06:55.083 12:34:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:55.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.083 --rc genhtml_branch_coverage=1 00:06:55.083 --rc genhtml_function_coverage=1 00:06:55.083 --rc genhtml_legend=1 00:06:55.083 --rc geninfo_all_blocks=1 00:06:55.083 --rc geninfo_unexecuted_blocks=1 00:06:55.083 00:06:55.083 ' 00:06:55.083 12:34:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:55.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.083 --rc genhtml_branch_coverage=1 00:06:55.083 --rc genhtml_function_coverage=1 00:06:55.083 --rc genhtml_legend=1 00:06:55.083 --rc geninfo_all_blocks=1 00:06:55.083 --rc geninfo_unexecuted_blocks=1 00:06:55.083 00:06:55.083 ' 00:06:55.083 12:34:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:55.083 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.083 --rc genhtml_branch_coverage=1 00:06:55.083 --rc genhtml_function_coverage=1 00:06:55.083 --rc genhtml_legend=1 00:06:55.083 --rc geninfo_all_blocks=1 00:06:55.083 --rc geninfo_unexecuted_blocks=1 00:06:55.083 00:06:55.083 ' 00:06:55.083 12:34:28 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:55.083 12:34:28 -- nvmf/common.sh@7 -- # uname -s 00:06:55.083 12:34:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:55.083 12:34:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:55.083 12:34:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:55.083 12:34:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:55.083 12:34:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:55.083 12:34:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:55.083 12:34:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:55.084 12:34:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:55.084 12:34:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:55.084 12:34:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:55.084 12:34:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:55.084 12:34:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:55.084 12:34:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:55.084 12:34:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:55.084 12:34:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:55.084 12:34:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:55.084 12:34:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:55.084 12:34:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:55.084 12:34:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:55.084 12:34:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.084 12:34:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.084 12:34:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.084 12:34:28 -- paths/export.sh@5 -- # export PATH 00:06:55.084 12:34:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.084 12:34:28 -- nvmf/common.sh@46 -- # : 0 00:06:55.084 12:34:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:55.084 12:34:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:55.084 12:34:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:55.084 12:34:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:55.084 12:34:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:55.084 12:34:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:55.084 12:34:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:55.084 12:34:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:55.084 12:34:28 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:06:55.084 12:34:28 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:06:55.084 12:34:28 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:06:55.084 12:34:28 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:06:55.084 12:34:28 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:06:55.084 12:34:28 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:06:55.084 12:34:28 -- target/referrals.sh@37 -- # nvmftestinit 00:06:55.084 12:34:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:55.084 12:34:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:55.084 12:34:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:55.084 12:34:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:55.084 12:34:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:55.084 12:34:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:55.084 12:34:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:55.084 12:34:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:55.084 12:34:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:55.084 12:34:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:55.084 12:34:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:55.084 12:34:28 -- common/autotest_common.sh@10 -- # set +x 00:06:56.991 12:34:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:56.991 12:34:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:56.991 12:34:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:56.991 12:34:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:56.991 12:34:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:56.991 12:34:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:56.991 12:34:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:56.991 12:34:30 -- nvmf/common.sh@294 -- # net_devs=() 00:06:56.991 12:34:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:56.991 12:34:30 -- nvmf/common.sh@295 -- # e810=() 00:06:56.991 12:34:30 -- nvmf/common.sh@295 -- # local -ga e810 00:06:56.991 12:34:30 -- nvmf/common.sh@296 -- # x722=() 00:06:56.991 12:34:30 -- nvmf/common.sh@296 -- # local -ga x722 00:06:56.991 12:34:30 -- nvmf/common.sh@297 -- # mlx=() 00:06:56.991 12:34:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:56.991 12:34:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:56.991 12:34:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:56.991 12:34:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:56.991 12:34:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:56.991 12:34:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:56.991 12:34:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:56.991 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:56.991 12:34:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:56.991 12:34:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:56.991 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:56.991 12:34:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:56.991 12:34:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:56.991 12:34:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:56.991 12:34:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:56.991 12:34:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:57.251 12:34:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:57.251 12:34:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:57.251 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:57.251 12:34:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:57.251 12:34:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:57.251 12:34:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:57.251 12:34:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:57.251 12:34:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:57.251 12:34:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:57.251 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:57.251 12:34:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:57.251 12:34:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:57.251 12:34:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:57.251 12:34:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:57.251 12:34:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:57.251 12:34:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:57.251 12:34:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:57.251 12:34:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:57.251 12:34:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:57.251 12:34:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:57.251 12:34:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:57.251 12:34:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:57.251 12:34:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:57.251 12:34:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:57.251 12:34:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:57.251 12:34:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:57.251 12:34:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:57.251 12:34:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:57.251 12:34:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:57.251 12:34:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:57.251 12:34:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:57.251 12:34:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:57.251 12:34:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:57.251 12:34:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:57.251 12:34:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:57.251 12:34:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:57.251 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:57.251 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:06:57.251 00:06:57.251 --- 10.0.0.2 ping statistics --- 00:06:57.251 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:57.251 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:06:57.251 12:34:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:57.251 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:57.251 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:06:57.251 00:06:57.251 --- 10.0.0.1 ping statistics --- 00:06:57.251 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:57.251 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:06:57.251 12:34:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:57.251 12:34:30 -- nvmf/common.sh@410 -- # return 0 00:06:57.251 12:34:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:57.251 12:34:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:57.251 12:34:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:57.251 12:34:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:57.251 12:34:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:57.251 12:34:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:57.251 12:34:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:57.251 12:34:30 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:06:57.251 12:34:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:57.251 12:34:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:57.251 12:34:30 -- common/autotest_common.sh@10 -- # set +x 00:06:57.251 12:34:30 -- nvmf/common.sh@469 -- # nvmfpid=3431468 00:06:57.251 12:34:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:57.251 12:34:30 -- nvmf/common.sh@470 -- # waitforlisten 3431468 00:06:57.251 12:34:30 -- common/autotest_common.sh@829 -- # '[' -z 3431468 ']' 00:06:57.251 12:34:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:57.251 12:34:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:57.251 12:34:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:57.251 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:57.251 12:34:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:57.251 12:34:30 -- common/autotest_common.sh@10 -- # set +x 00:06:57.251 [2024-11-20 12:34:30.318129] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.251 [2024-11-20 12:34:30.318200] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:57.251 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.510 [2024-11-20 12:34:30.386580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:57.510 [2024-11-20 12:34:30.507040] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:57.510 [2024-11-20 12:34:30.507202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:57.510 [2024-11-20 12:34:30.507222] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:57.510 [2024-11-20 12:34:30.507237] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:57.510 [2024-11-20 12:34:30.507296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:57.510 [2024-11-20 12:34:30.507349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:57.510 [2024-11-20 12:34:30.507401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:57.510 [2024-11-20 12:34:30.507405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.447 12:34:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:58.447 12:34:31 -- common/autotest_common.sh@862 -- # return 0 00:06:58.447 12:34:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:58.447 12:34:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 12:34:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:58.447 12:34:31 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 [2024-11-20 12:34:31.348685] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 [2024-11-20 12:34:31.360892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:58.447 12:34:31 -- target/referrals.sh@48 -- # jq length 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:06:58.447 12:34:31 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:06:58.447 12:34:31 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:06:58.447 12:34:31 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:58.447 12:34:31 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:06:58.447 12:34:31 -- target/referrals.sh@21 -- # sort 00:06:58.447 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.447 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.447 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.447 12:34:31 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:06:58.448 12:34:31 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:06:58.448 12:34:31 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:06:58.448 12:34:31 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:58.448 12:34:31 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:58.448 12:34:31 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:58.448 12:34:31 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:58.448 12:34:31 -- target/referrals.sh@26 -- # sort 00:06:58.707 12:34:31 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:06:58.707 12:34:31 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:06:58.707 12:34:31 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:06:58.707 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.707 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.707 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.707 12:34:31 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:06:58.707 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.707 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.707 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.707 12:34:31 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:06:58.707 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.707 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.707 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.707 12:34:31 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:58.707 12:34:31 -- target/referrals.sh@56 -- # jq length 00:06:58.707 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.707 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.707 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.707 12:34:31 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:06:58.707 12:34:31 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:06:58.707 12:34:31 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:58.707 12:34:31 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:58.707 12:34:31 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:58.707 12:34:31 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:58.707 12:34:31 -- target/referrals.sh@26 -- # sort 00:06:58.968 12:34:31 -- target/referrals.sh@26 -- # echo 00:06:58.968 12:34:31 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:06:58.968 12:34:31 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:06:58.968 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.968 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.968 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.968 12:34:31 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:06:58.968 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.968 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.968 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.968 12:34:31 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:06:58.968 12:34:31 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:06:58.968 12:34:31 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:58.968 12:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.968 12:34:31 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:06:58.968 12:34:31 -- common/autotest_common.sh@10 -- # set +x 00:06:58.968 12:34:31 -- target/referrals.sh@21 -- # sort 00:06:58.968 12:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.968 12:34:31 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:06:58.968 12:34:31 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:06:58.968 12:34:31 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:06:58.968 12:34:31 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:58.968 12:34:31 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:58.968 12:34:31 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:58.968 12:34:31 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:58.968 12:34:31 -- target/referrals.sh@26 -- # sort 00:06:59.228 12:34:32 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:06:59.228 12:34:32 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:06:59.228 12:34:32 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:06:59.228 12:34:32 -- target/referrals.sh@67 -- # jq -r .subnqn 00:06:59.228 12:34:32 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:06:59.228 12:34:32 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:59.228 12:34:32 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:06:59.228 12:34:32 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:06:59.228 12:34:32 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:06:59.228 12:34:32 -- target/referrals.sh@68 -- # jq -r .subnqn 00:06:59.228 12:34:32 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:06:59.228 12:34:32 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:59.228 12:34:32 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:06:59.487 12:34:32 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:06:59.487 12:34:32 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:06:59.487 12:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.487 12:34:32 -- common/autotest_common.sh@10 -- # set +x 00:06:59.487 12:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.487 12:34:32 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:06:59.487 12:34:32 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:06:59.487 12:34:32 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:59.487 12:34:32 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:06:59.487 12:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.487 12:34:32 -- common/autotest_common.sh@10 -- # set +x 00:06:59.487 12:34:32 -- target/referrals.sh@21 -- # sort 00:06:59.487 12:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.487 12:34:32 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:06:59.487 12:34:32 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:06:59.487 12:34:32 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:06:59.487 12:34:32 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:59.487 12:34:32 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:59.487 12:34:32 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:59.487 12:34:32 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:59.487 12:34:32 -- target/referrals.sh@26 -- # sort 00:06:59.747 12:34:32 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:06:59.747 12:34:32 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:06:59.747 12:34:32 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:06:59.747 12:34:32 -- target/referrals.sh@75 -- # jq -r .subnqn 00:06:59.747 12:34:32 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:06:59.747 12:34:32 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:59.747 12:34:32 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:06:59.747 12:34:32 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:06:59.747 12:34:32 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:06:59.747 12:34:32 -- target/referrals.sh@76 -- # jq -r .subnqn 00:06:59.747 12:34:32 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:00.005 12:34:32 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:00.005 12:34:32 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:00.005 12:34:33 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:00.005 12:34:33 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:00.005 12:34:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.005 12:34:33 -- common/autotest_common.sh@10 -- # set +x 00:07:00.005 12:34:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.005 12:34:33 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:00.005 12:34:33 -- target/referrals.sh@82 -- # jq length 00:07:00.005 12:34:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.005 12:34:33 -- common/autotest_common.sh@10 -- # set +x 00:07:00.005 12:34:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.005 12:34:33 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:00.005 12:34:33 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:00.005 12:34:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:00.005 12:34:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:00.005 12:34:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:00.005 12:34:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:00.005 12:34:33 -- target/referrals.sh@26 -- # sort 00:07:00.265 12:34:33 -- target/referrals.sh@26 -- # echo 00:07:00.265 12:34:33 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:00.265 12:34:33 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:00.265 12:34:33 -- target/referrals.sh@86 -- # nvmftestfini 00:07:00.265 12:34:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:00.265 12:34:33 -- nvmf/common.sh@116 -- # sync 00:07:00.265 12:34:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:00.265 12:34:33 -- nvmf/common.sh@119 -- # set +e 00:07:00.265 12:34:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:00.265 12:34:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:00.265 rmmod nvme_tcp 00:07:00.265 rmmod nvme_fabrics 00:07:00.265 rmmod nvme_keyring 00:07:00.265 12:34:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:00.265 12:34:33 -- nvmf/common.sh@123 -- # set -e 00:07:00.265 12:34:33 -- nvmf/common.sh@124 -- # return 0 00:07:00.265 12:34:33 -- nvmf/common.sh@477 -- # '[' -n 3431468 ']' 00:07:00.265 12:34:33 -- nvmf/common.sh@478 -- # killprocess 3431468 00:07:00.265 12:34:33 -- common/autotest_common.sh@936 -- # '[' -z 3431468 ']' 00:07:00.265 12:34:33 -- common/autotest_common.sh@940 -- # kill -0 3431468 00:07:00.265 12:34:33 -- common/autotest_common.sh@941 -- # uname 00:07:00.265 12:34:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:00.265 12:34:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3431468 00:07:00.265 12:34:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:00.265 12:34:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:00.265 12:34:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3431468' 00:07:00.265 killing process with pid 3431468 00:07:00.265 12:34:33 -- common/autotest_common.sh@955 -- # kill 3431468 00:07:00.265 12:34:33 -- common/autotest_common.sh@960 -- # wait 3431468 00:07:00.834 12:34:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:00.834 12:34:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:00.834 12:34:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:00.834 12:34:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:00.834 12:34:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:00.834 12:34:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:00.834 12:34:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:00.834 12:34:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:02.743 12:34:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:02.743 00:07:02.743 real 0m7.800s 00:07:02.743 user 0m14.063s 00:07:02.743 sys 0m2.264s 00:07:02.743 12:34:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.743 12:34:35 -- common/autotest_common.sh@10 -- # set +x 00:07:02.743 ************************************ 00:07:02.743 END TEST nvmf_referrals 00:07:02.743 ************************************ 00:07:02.743 12:34:35 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:02.743 12:34:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:02.743 12:34:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.743 12:34:35 -- common/autotest_common.sh@10 -- # set +x 00:07:02.743 ************************************ 00:07:02.743 START TEST nvmf_connect_disconnect 00:07:02.743 ************************************ 00:07:02.743 12:34:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:02.743 * Looking for test storage... 00:07:02.743 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:02.743 12:34:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:02.743 12:34:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:02.743 12:34:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:03.001 12:34:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:03.001 12:34:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:03.001 12:34:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:03.001 12:34:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:03.001 12:34:35 -- scripts/common.sh@335 -- # IFS=.-: 00:07:03.001 12:34:35 -- scripts/common.sh@335 -- # read -ra ver1 00:07:03.001 12:34:35 -- scripts/common.sh@336 -- # IFS=.-: 00:07:03.001 12:34:35 -- scripts/common.sh@336 -- # read -ra ver2 00:07:03.001 12:34:35 -- scripts/common.sh@337 -- # local 'op=<' 00:07:03.001 12:34:35 -- scripts/common.sh@339 -- # ver1_l=2 00:07:03.001 12:34:35 -- scripts/common.sh@340 -- # ver2_l=1 00:07:03.001 12:34:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:03.001 12:34:35 -- scripts/common.sh@343 -- # case "$op" in 00:07:03.001 12:34:35 -- scripts/common.sh@344 -- # : 1 00:07:03.001 12:34:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:03.001 12:34:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:03.001 12:34:35 -- scripts/common.sh@364 -- # decimal 1 00:07:03.001 12:34:35 -- scripts/common.sh@352 -- # local d=1 00:07:03.001 12:34:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:03.001 12:34:35 -- scripts/common.sh@354 -- # echo 1 00:07:03.001 12:34:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:03.001 12:34:35 -- scripts/common.sh@365 -- # decimal 2 00:07:03.001 12:34:35 -- scripts/common.sh@352 -- # local d=2 00:07:03.001 12:34:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:03.001 12:34:35 -- scripts/common.sh@354 -- # echo 2 00:07:03.001 12:34:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:03.001 12:34:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:03.001 12:34:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:03.001 12:34:35 -- scripts/common.sh@367 -- # return 0 00:07:03.001 12:34:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:03.001 12:34:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:03.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.001 --rc genhtml_branch_coverage=1 00:07:03.001 --rc genhtml_function_coverage=1 00:07:03.001 --rc genhtml_legend=1 00:07:03.001 --rc geninfo_all_blocks=1 00:07:03.001 --rc geninfo_unexecuted_blocks=1 00:07:03.001 00:07:03.001 ' 00:07:03.001 12:34:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:03.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.001 --rc genhtml_branch_coverage=1 00:07:03.001 --rc genhtml_function_coverage=1 00:07:03.001 --rc genhtml_legend=1 00:07:03.001 --rc geninfo_all_blocks=1 00:07:03.001 --rc geninfo_unexecuted_blocks=1 00:07:03.001 00:07:03.001 ' 00:07:03.001 12:34:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:03.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.001 --rc genhtml_branch_coverage=1 00:07:03.001 --rc genhtml_function_coverage=1 00:07:03.001 --rc genhtml_legend=1 00:07:03.001 --rc geninfo_all_blocks=1 00:07:03.001 --rc geninfo_unexecuted_blocks=1 00:07:03.001 00:07:03.001 ' 00:07:03.001 12:34:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:03.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.001 --rc genhtml_branch_coverage=1 00:07:03.001 --rc genhtml_function_coverage=1 00:07:03.001 --rc genhtml_legend=1 00:07:03.001 --rc geninfo_all_blocks=1 00:07:03.001 --rc geninfo_unexecuted_blocks=1 00:07:03.001 00:07:03.001 ' 00:07:03.001 12:34:35 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:03.001 12:34:35 -- nvmf/common.sh@7 -- # uname -s 00:07:03.001 12:34:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:03.001 12:34:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:03.001 12:34:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:03.001 12:34:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:03.001 12:34:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:03.001 12:34:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:03.001 12:34:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:03.001 12:34:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:03.001 12:34:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:03.001 12:34:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:03.001 12:34:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.001 12:34:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.002 12:34:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:03.002 12:34:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:03.002 12:34:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:03.002 12:34:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:03.002 12:34:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:03.002 12:34:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:03.002 12:34:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:03.002 12:34:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.002 12:34:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.002 12:34:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.002 12:34:35 -- paths/export.sh@5 -- # export PATH 00:07:03.002 12:34:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.002 12:34:35 -- nvmf/common.sh@46 -- # : 0 00:07:03.002 12:34:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:03.002 12:34:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:03.002 12:34:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:03.002 12:34:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:03.002 12:34:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:03.002 12:34:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:03.002 12:34:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:03.002 12:34:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:03.002 12:34:35 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:03.002 12:34:35 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:03.002 12:34:35 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:03.002 12:34:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:03.002 12:34:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:03.002 12:34:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:03.002 12:34:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:03.002 12:34:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:03.002 12:34:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:03.002 12:34:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:03.002 12:34:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.002 12:34:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:03.002 12:34:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:03.002 12:34:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:03.002 12:34:35 -- common/autotest_common.sh@10 -- # set +x 00:07:04.914 12:34:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:04.914 12:34:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:04.914 12:34:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:04.914 12:34:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:04.914 12:34:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:04.914 12:34:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:04.914 12:34:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:04.914 12:34:37 -- nvmf/common.sh@294 -- # net_devs=() 00:07:04.914 12:34:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:04.914 12:34:37 -- nvmf/common.sh@295 -- # e810=() 00:07:04.914 12:34:37 -- nvmf/common.sh@295 -- # local -ga e810 00:07:04.914 12:34:37 -- nvmf/common.sh@296 -- # x722=() 00:07:04.914 12:34:37 -- nvmf/common.sh@296 -- # local -ga x722 00:07:04.914 12:34:37 -- nvmf/common.sh@297 -- # mlx=() 00:07:04.914 12:34:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:04.914 12:34:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:04.914 12:34:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:04.914 12:34:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:04.914 12:34:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:04.914 12:34:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:04.914 12:34:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:04.914 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:04.914 12:34:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:04.914 12:34:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:04.914 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:04.914 12:34:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:04.914 12:34:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:04.914 12:34:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:04.914 12:34:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:04.914 12:34:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:04.914 12:34:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:04.914 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:04.914 12:34:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:04.914 12:34:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:04.914 12:34:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:04.914 12:34:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:04.914 12:34:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:04.914 12:34:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:04.914 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:04.914 12:34:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:04.914 12:34:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:04.914 12:34:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:04.914 12:34:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:04.914 12:34:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:04.914 12:34:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:04.914 12:34:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:04.914 12:34:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:04.914 12:34:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:04.914 12:34:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:04.914 12:34:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:04.914 12:34:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:04.914 12:34:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:04.914 12:34:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:04.914 12:34:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:04.914 12:34:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:04.914 12:34:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:04.914 12:34:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:04.914 12:34:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:04.914 12:34:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:04.914 12:34:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:04.914 12:34:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:04.914 12:34:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:04.914 12:34:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:05.175 12:34:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:05.175 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:05.175 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:07:05.175 00:07:05.175 --- 10.0.0.2 ping statistics --- 00:07:05.175 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.175 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:07:05.175 12:34:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:05.175 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:05.175 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:07:05.175 00:07:05.175 --- 10.0.0.1 ping statistics --- 00:07:05.175 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.175 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:07:05.175 12:34:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:05.175 12:34:38 -- nvmf/common.sh@410 -- # return 0 00:07:05.175 12:34:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:05.175 12:34:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:05.175 12:34:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:05.175 12:34:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:05.175 12:34:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:05.175 12:34:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:05.175 12:34:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:05.175 12:34:38 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:05.175 12:34:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:05.175 12:34:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:05.175 12:34:38 -- common/autotest_common.sh@10 -- # set +x 00:07:05.175 12:34:38 -- nvmf/common.sh@469 -- # nvmfpid=3433923 00:07:05.175 12:34:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:05.175 12:34:38 -- nvmf/common.sh@470 -- # waitforlisten 3433923 00:07:05.175 12:34:38 -- common/autotest_common.sh@829 -- # '[' -z 3433923 ']' 00:07:05.175 12:34:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.175 12:34:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:05.175 12:34:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.175 12:34:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:05.175 12:34:38 -- common/autotest_common.sh@10 -- # set +x 00:07:05.175 [2024-11-20 12:34:38.105223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.175 [2024-11-20 12:34:38.105299] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:05.175 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.175 [2024-11-20 12:34:38.182011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:05.436 [2024-11-20 12:34:38.306574] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.436 [2024-11-20 12:34:38.306743] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:05.436 [2024-11-20 12:34:38.306764] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:05.436 [2024-11-20 12:34:38.306778] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:05.436 [2024-11-20 12:34:38.306842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.436 [2024-11-20 12:34:38.306897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.436 [2024-11-20 12:34:38.306924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:05.436 [2024-11-20 12:34:38.306927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.372 12:34:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.372 12:34:39 -- common/autotest_common.sh@862 -- # return 0 00:07:06.372 12:34:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:06.372 12:34:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:06.372 12:34:39 -- common/autotest_common.sh@10 -- # set +x 00:07:06.372 12:34:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:06.372 12:34:39 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:06.372 12:34:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.372 12:34:39 -- common/autotest_common.sh@10 -- # set +x 00:07:06.372 [2024-11-20 12:34:39.187877] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:06.372 12:34:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.372 12:34:39 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:06.372 12:34:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.372 12:34:39 -- common/autotest_common.sh@10 -- # set +x 00:07:06.372 12:34:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.372 12:34:39 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:06.372 12:34:39 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:06.372 12:34:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.372 12:34:39 -- common/autotest_common.sh@10 -- # set +x 00:07:06.372 12:34:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.373 12:34:39 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:06.373 12:34:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.373 12:34:39 -- common/autotest_common.sh@10 -- # set +x 00:07:06.373 12:34:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.373 12:34:39 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:06.373 12:34:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.373 12:34:39 -- common/autotest_common.sh@10 -- # set +x 00:07:06.373 [2024-11-20 12:34:39.249450] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:06.373 12:34:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.373 12:34:39 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:06.373 12:34:39 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:06.373 12:34:39 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:06.373 12:34:39 -- target/connect_disconnect.sh@34 -- # set +x 00:07:08.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:10.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:13.354 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:15.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:17.796 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:20.336 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:22.880 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:24.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:27.432 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:29.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:31.870 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:34.410 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:36.970 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:38.877 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:41.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:43.949 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:45.857 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.396 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.304 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:52.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:54.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.830 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:01.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.878 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.783 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.857 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.285 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.264 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.811 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.815 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.350 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.250 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.784 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.781 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.222 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.130 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.269 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.161 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.137 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.214 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.636 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.611 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.603 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.137 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.677 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.586 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.123 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.585 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.145 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.593 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.127 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.572 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.460 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.534 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.439 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.439 12:38:30 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:10:57.439 12:38:30 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:10:57.439 12:38:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:10:57.439 12:38:30 -- nvmf/common.sh@116 -- # sync 00:10:57.439 12:38:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:10:57.439 12:38:30 -- nvmf/common.sh@119 -- # set +e 00:10:57.439 12:38:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:10:57.439 12:38:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:10:57.439 rmmod nvme_tcp 00:10:57.439 rmmod nvme_fabrics 00:10:57.439 rmmod nvme_keyring 00:10:57.439 12:38:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:10:57.439 12:38:30 -- nvmf/common.sh@123 -- # set -e 00:10:57.439 12:38:30 -- nvmf/common.sh@124 -- # return 0 00:10:57.439 12:38:30 -- nvmf/common.sh@477 -- # '[' -n 3433923 ']' 00:10:57.439 12:38:30 -- nvmf/common.sh@478 -- # killprocess 3433923 00:10:57.439 12:38:30 -- common/autotest_common.sh@936 -- # '[' -z 3433923 ']' 00:10:57.439 12:38:30 -- common/autotest_common.sh@940 -- # kill -0 3433923 00:10:57.440 12:38:30 -- common/autotest_common.sh@941 -- # uname 00:10:57.440 12:38:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:57.440 12:38:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3433923 00:10:57.440 12:38:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:57.440 12:38:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:57.440 12:38:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3433923' 00:10:57.440 killing process with pid 3433923 00:10:57.440 12:38:30 -- common/autotest_common.sh@955 -- # kill 3433923 00:10:57.440 12:38:30 -- common/autotest_common.sh@960 -- # wait 3433923 00:10:57.698 12:38:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:10:57.698 12:38:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:10:57.698 12:38:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:10:57.698 12:38:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:10:57.698 12:38:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:10:57.698 12:38:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:57.698 12:38:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:57.698 12:38:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:00.238 12:38:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:00.238 00:11:00.238 real 3m57.102s 00:11:00.238 user 15m4.959s 00:11:00.238 sys 0m33.808s 00:11:00.238 12:38:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:00.238 12:38:32 -- common/autotest_common.sh@10 -- # set +x 00:11:00.238 ************************************ 00:11:00.238 END TEST nvmf_connect_disconnect 00:11:00.238 ************************************ 00:11:00.238 12:38:32 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:00.238 12:38:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:00.238 12:38:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:00.238 12:38:32 -- common/autotest_common.sh@10 -- # set +x 00:11:00.238 ************************************ 00:11:00.238 START TEST nvmf_multitarget 00:11:00.238 ************************************ 00:11:00.238 12:38:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:00.238 * Looking for test storage... 00:11:00.238 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:00.238 12:38:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:00.238 12:38:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:00.238 12:38:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:00.238 12:38:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:00.238 12:38:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:00.238 12:38:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:00.238 12:38:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:00.238 12:38:32 -- scripts/common.sh@335 -- # IFS=.-: 00:11:00.238 12:38:32 -- scripts/common.sh@335 -- # read -ra ver1 00:11:00.238 12:38:32 -- scripts/common.sh@336 -- # IFS=.-: 00:11:00.238 12:38:32 -- scripts/common.sh@336 -- # read -ra ver2 00:11:00.238 12:38:32 -- scripts/common.sh@337 -- # local 'op=<' 00:11:00.238 12:38:32 -- scripts/common.sh@339 -- # ver1_l=2 00:11:00.238 12:38:32 -- scripts/common.sh@340 -- # ver2_l=1 00:11:00.238 12:38:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:00.238 12:38:32 -- scripts/common.sh@343 -- # case "$op" in 00:11:00.238 12:38:32 -- scripts/common.sh@344 -- # : 1 00:11:00.238 12:38:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:00.238 12:38:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:00.238 12:38:32 -- scripts/common.sh@364 -- # decimal 1 00:11:00.238 12:38:32 -- scripts/common.sh@352 -- # local d=1 00:11:00.238 12:38:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:00.238 12:38:32 -- scripts/common.sh@354 -- # echo 1 00:11:00.238 12:38:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:00.238 12:38:32 -- scripts/common.sh@365 -- # decimal 2 00:11:00.238 12:38:32 -- scripts/common.sh@352 -- # local d=2 00:11:00.238 12:38:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:00.238 12:38:32 -- scripts/common.sh@354 -- # echo 2 00:11:00.238 12:38:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:00.238 12:38:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:00.238 12:38:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:00.238 12:38:32 -- scripts/common.sh@367 -- # return 0 00:11:00.238 12:38:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:00.238 12:38:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:00.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:00.238 --rc genhtml_branch_coverage=1 00:11:00.238 --rc genhtml_function_coverage=1 00:11:00.238 --rc genhtml_legend=1 00:11:00.238 --rc geninfo_all_blocks=1 00:11:00.238 --rc geninfo_unexecuted_blocks=1 00:11:00.238 00:11:00.238 ' 00:11:00.238 12:38:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:00.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:00.238 --rc genhtml_branch_coverage=1 00:11:00.238 --rc genhtml_function_coverage=1 00:11:00.238 --rc genhtml_legend=1 00:11:00.238 --rc geninfo_all_blocks=1 00:11:00.238 --rc geninfo_unexecuted_blocks=1 00:11:00.238 00:11:00.238 ' 00:11:00.238 12:38:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:00.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:00.238 --rc genhtml_branch_coverage=1 00:11:00.238 --rc genhtml_function_coverage=1 00:11:00.238 --rc genhtml_legend=1 00:11:00.238 --rc geninfo_all_blocks=1 00:11:00.238 --rc geninfo_unexecuted_blocks=1 00:11:00.238 00:11:00.238 ' 00:11:00.238 12:38:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:00.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:00.238 --rc genhtml_branch_coverage=1 00:11:00.238 --rc genhtml_function_coverage=1 00:11:00.238 --rc genhtml_legend=1 00:11:00.238 --rc geninfo_all_blocks=1 00:11:00.238 --rc geninfo_unexecuted_blocks=1 00:11:00.238 00:11:00.238 ' 00:11:00.238 12:38:32 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:00.238 12:38:32 -- nvmf/common.sh@7 -- # uname -s 00:11:00.238 12:38:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:00.238 12:38:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:00.238 12:38:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:00.238 12:38:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:00.238 12:38:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:00.238 12:38:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:00.238 12:38:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:00.238 12:38:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:00.238 12:38:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:00.238 12:38:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:00.238 12:38:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:00.238 12:38:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:00.238 12:38:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:00.238 12:38:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:00.238 12:38:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:00.238 12:38:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:00.238 12:38:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:00.238 12:38:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:00.238 12:38:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:00.238 12:38:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:00.238 12:38:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:00.238 12:38:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:00.239 12:38:33 -- paths/export.sh@5 -- # export PATH 00:11:00.239 12:38:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:00.239 12:38:33 -- nvmf/common.sh@46 -- # : 0 00:11:00.239 12:38:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:00.239 12:38:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:00.239 12:38:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:00.239 12:38:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:00.239 12:38:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:00.239 12:38:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:00.239 12:38:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:00.239 12:38:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:00.239 12:38:33 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:00.239 12:38:33 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:00.239 12:38:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:00.239 12:38:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:00.239 12:38:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:00.239 12:38:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:00.239 12:38:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:00.239 12:38:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:00.239 12:38:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:00.239 12:38:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:00.239 12:38:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:00.239 12:38:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:00.239 12:38:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:00.239 12:38:33 -- common/autotest_common.sh@10 -- # set +x 00:11:02.147 12:38:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:02.147 12:38:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:02.147 12:38:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:02.147 12:38:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:02.147 12:38:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:02.147 12:38:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:02.147 12:38:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:02.147 12:38:35 -- nvmf/common.sh@294 -- # net_devs=() 00:11:02.147 12:38:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:02.147 12:38:35 -- nvmf/common.sh@295 -- # e810=() 00:11:02.147 12:38:35 -- nvmf/common.sh@295 -- # local -ga e810 00:11:02.147 12:38:35 -- nvmf/common.sh@296 -- # x722=() 00:11:02.147 12:38:35 -- nvmf/common.sh@296 -- # local -ga x722 00:11:02.147 12:38:35 -- nvmf/common.sh@297 -- # mlx=() 00:11:02.147 12:38:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:02.147 12:38:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:02.147 12:38:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:02.148 12:38:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:02.148 12:38:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:02.148 12:38:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:02.148 12:38:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:02.148 12:38:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:02.148 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:02.148 12:38:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:02.148 12:38:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:02.148 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:02.148 12:38:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:02.148 12:38:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:02.148 12:38:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:02.148 12:38:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:02.148 12:38:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:02.148 12:38:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:02.148 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:02.148 12:38:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:02.148 12:38:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:02.148 12:38:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:02.148 12:38:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:02.148 12:38:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:02.148 12:38:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:02.148 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:02.148 12:38:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:02.148 12:38:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:02.148 12:38:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:02.148 12:38:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:02.148 12:38:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:02.148 12:38:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:02.148 12:38:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:02.148 12:38:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:02.148 12:38:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:02.148 12:38:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:02.148 12:38:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:02.148 12:38:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:02.148 12:38:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:02.148 12:38:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:02.148 12:38:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:02.148 12:38:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:02.148 12:38:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:02.148 12:38:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:02.148 12:38:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:02.148 12:38:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:02.148 12:38:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:02.148 12:38:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:02.148 12:38:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:02.148 12:38:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:02.148 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:02.148 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:11:02.148 00:11:02.148 --- 10.0.0.2 ping statistics --- 00:11:02.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:02.148 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:11:02.148 12:38:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:02.148 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:02.148 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:11:02.148 00:11:02.148 --- 10.0.0.1 ping statistics --- 00:11:02.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:02.148 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:11:02.148 12:38:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:02.148 12:38:35 -- nvmf/common.sh@410 -- # return 0 00:11:02.148 12:38:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:02.148 12:38:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:02.148 12:38:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:02.148 12:38:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:02.148 12:38:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:02.148 12:38:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:02.148 12:38:35 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:02.148 12:38:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:02.148 12:38:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:02.148 12:38:35 -- common/autotest_common.sh@10 -- # set +x 00:11:02.148 12:38:35 -- nvmf/common.sh@469 -- # nvmfpid=3465962 00:11:02.148 12:38:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:02.148 12:38:35 -- nvmf/common.sh@470 -- # waitforlisten 3465962 00:11:02.148 12:38:35 -- common/autotest_common.sh@829 -- # '[' -z 3465962 ']' 00:11:02.148 12:38:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:02.148 12:38:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:02.148 12:38:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:02.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:02.148 12:38:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:02.148 12:38:35 -- common/autotest_common.sh@10 -- # set +x 00:11:02.148 [2024-11-20 12:38:35.243359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:02.148 [2024-11-20 12:38:35.243448] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:02.408 EAL: No free 2048 kB hugepages reported on node 1 00:11:02.408 [2024-11-20 12:38:35.321299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:02.408 [2024-11-20 12:38:35.446146] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:02.408 [2024-11-20 12:38:35.446325] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:02.408 [2024-11-20 12:38:35.446346] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:02.408 [2024-11-20 12:38:35.446371] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:02.408 [2024-11-20 12:38:35.446462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:02.408 [2024-11-20 12:38:35.446521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:02.408 [2024-11-20 12:38:35.449094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:02.408 [2024-11-20 12:38:35.449100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:03.345 12:38:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:03.345 12:38:36 -- common/autotest_common.sh@862 -- # return 0 00:11:03.345 12:38:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:03.345 12:38:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:03.345 12:38:36 -- common/autotest_common.sh@10 -- # set +x 00:11:03.345 12:38:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:03.345 12:38:36 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:03.345 12:38:36 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:03.345 12:38:36 -- target/multitarget.sh@21 -- # jq length 00:11:03.345 12:38:36 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:03.345 12:38:36 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:03.632 "nvmf_tgt_1" 00:11:03.632 12:38:36 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:03.632 "nvmf_tgt_2" 00:11:03.632 12:38:36 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:03.632 12:38:36 -- target/multitarget.sh@28 -- # jq length 00:11:03.912 12:38:36 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:03.912 12:38:36 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:03.912 true 00:11:03.912 12:38:36 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:03.912 true 00:11:03.912 12:38:36 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:03.912 12:38:36 -- target/multitarget.sh@35 -- # jq length 00:11:04.169 12:38:37 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:04.169 12:38:37 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:04.169 12:38:37 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:04.169 12:38:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:04.169 12:38:37 -- nvmf/common.sh@116 -- # sync 00:11:04.169 12:38:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:04.169 12:38:37 -- nvmf/common.sh@119 -- # set +e 00:11:04.169 12:38:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:04.169 12:38:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:04.169 rmmod nvme_tcp 00:11:04.169 rmmod nvme_fabrics 00:11:04.169 rmmod nvme_keyring 00:11:04.169 12:38:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:04.169 12:38:37 -- nvmf/common.sh@123 -- # set -e 00:11:04.169 12:38:37 -- nvmf/common.sh@124 -- # return 0 00:11:04.169 12:38:37 -- nvmf/common.sh@477 -- # '[' -n 3465962 ']' 00:11:04.169 12:38:37 -- nvmf/common.sh@478 -- # killprocess 3465962 00:11:04.169 12:38:37 -- common/autotest_common.sh@936 -- # '[' -z 3465962 ']' 00:11:04.169 12:38:37 -- common/autotest_common.sh@940 -- # kill -0 3465962 00:11:04.169 12:38:37 -- common/autotest_common.sh@941 -- # uname 00:11:04.169 12:38:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:04.169 12:38:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3465962 00:11:04.169 12:38:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:04.169 12:38:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:04.169 12:38:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3465962' 00:11:04.169 killing process with pid 3465962 00:11:04.169 12:38:37 -- common/autotest_common.sh@955 -- # kill 3465962 00:11:04.169 12:38:37 -- common/autotest_common.sh@960 -- # wait 3465962 00:11:04.426 12:38:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:04.426 12:38:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:04.426 12:38:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:04.426 12:38:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:04.426 12:38:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:04.426 12:38:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:04.426 12:38:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:04.426 12:38:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:06.955 12:38:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:06.955 00:11:06.955 real 0m6.627s 00:11:06.955 user 0m9.665s 00:11:06.955 sys 0m2.004s 00:11:06.955 12:38:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:06.955 12:38:39 -- common/autotest_common.sh@10 -- # set +x 00:11:06.955 ************************************ 00:11:06.955 END TEST nvmf_multitarget 00:11:06.955 ************************************ 00:11:06.955 12:38:39 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:06.955 12:38:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:06.955 12:38:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:06.955 12:38:39 -- common/autotest_common.sh@10 -- # set +x 00:11:06.955 ************************************ 00:11:06.955 START TEST nvmf_rpc 00:11:06.955 ************************************ 00:11:06.955 12:38:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:06.955 * Looking for test storage... 00:11:06.955 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:06.955 12:38:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:06.955 12:38:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:06.955 12:38:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:06.955 12:38:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:06.955 12:38:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:06.955 12:38:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:06.955 12:38:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:06.955 12:38:39 -- scripts/common.sh@335 -- # IFS=.-: 00:11:06.955 12:38:39 -- scripts/common.sh@335 -- # read -ra ver1 00:11:06.955 12:38:39 -- scripts/common.sh@336 -- # IFS=.-: 00:11:06.955 12:38:39 -- scripts/common.sh@336 -- # read -ra ver2 00:11:06.955 12:38:39 -- scripts/common.sh@337 -- # local 'op=<' 00:11:06.955 12:38:39 -- scripts/common.sh@339 -- # ver1_l=2 00:11:06.955 12:38:39 -- scripts/common.sh@340 -- # ver2_l=1 00:11:06.955 12:38:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:06.955 12:38:39 -- scripts/common.sh@343 -- # case "$op" in 00:11:06.955 12:38:39 -- scripts/common.sh@344 -- # : 1 00:11:06.955 12:38:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:06.955 12:38:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:06.955 12:38:39 -- scripts/common.sh@364 -- # decimal 1 00:11:06.955 12:38:39 -- scripts/common.sh@352 -- # local d=1 00:11:06.955 12:38:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:06.955 12:38:39 -- scripts/common.sh@354 -- # echo 1 00:11:06.955 12:38:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:06.955 12:38:39 -- scripts/common.sh@365 -- # decimal 2 00:11:06.955 12:38:39 -- scripts/common.sh@352 -- # local d=2 00:11:06.955 12:38:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:06.955 12:38:39 -- scripts/common.sh@354 -- # echo 2 00:11:06.955 12:38:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:06.955 12:38:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:06.955 12:38:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:06.955 12:38:39 -- scripts/common.sh@367 -- # return 0 00:11:06.955 12:38:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:06.955 12:38:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:06.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.955 --rc genhtml_branch_coverage=1 00:11:06.955 --rc genhtml_function_coverage=1 00:11:06.955 --rc genhtml_legend=1 00:11:06.955 --rc geninfo_all_blocks=1 00:11:06.955 --rc geninfo_unexecuted_blocks=1 00:11:06.955 00:11:06.955 ' 00:11:06.955 12:38:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:06.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.955 --rc genhtml_branch_coverage=1 00:11:06.955 --rc genhtml_function_coverage=1 00:11:06.955 --rc genhtml_legend=1 00:11:06.955 --rc geninfo_all_blocks=1 00:11:06.955 --rc geninfo_unexecuted_blocks=1 00:11:06.955 00:11:06.955 ' 00:11:06.955 12:38:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:06.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.955 --rc genhtml_branch_coverage=1 00:11:06.955 --rc genhtml_function_coverage=1 00:11:06.955 --rc genhtml_legend=1 00:11:06.955 --rc geninfo_all_blocks=1 00:11:06.955 --rc geninfo_unexecuted_blocks=1 00:11:06.955 00:11:06.955 ' 00:11:06.955 12:38:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:06.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.955 --rc genhtml_branch_coverage=1 00:11:06.955 --rc genhtml_function_coverage=1 00:11:06.955 --rc genhtml_legend=1 00:11:06.955 --rc geninfo_all_blocks=1 00:11:06.955 --rc geninfo_unexecuted_blocks=1 00:11:06.955 00:11:06.955 ' 00:11:06.955 12:38:39 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:06.955 12:38:39 -- nvmf/common.sh@7 -- # uname -s 00:11:06.955 12:38:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:06.955 12:38:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:06.955 12:38:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:06.955 12:38:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:06.955 12:38:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:06.955 12:38:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:06.955 12:38:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:06.955 12:38:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:06.955 12:38:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:06.955 12:38:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:06.956 12:38:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:06.956 12:38:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:06.956 12:38:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:06.956 12:38:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:06.956 12:38:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:06.956 12:38:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:06.956 12:38:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:06.956 12:38:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:06.956 12:38:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:06.956 12:38:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.956 12:38:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.956 12:38:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.956 12:38:39 -- paths/export.sh@5 -- # export PATH 00:11:06.956 12:38:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.956 12:38:39 -- nvmf/common.sh@46 -- # : 0 00:11:06.956 12:38:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:06.956 12:38:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:06.956 12:38:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:06.956 12:38:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:06.956 12:38:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:06.956 12:38:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:06.956 12:38:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:06.956 12:38:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:06.956 12:38:39 -- target/rpc.sh@11 -- # loops=5 00:11:06.956 12:38:39 -- target/rpc.sh@23 -- # nvmftestinit 00:11:06.956 12:38:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:06.956 12:38:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:06.956 12:38:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:06.956 12:38:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:06.956 12:38:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:06.956 12:38:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:06.956 12:38:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:06.956 12:38:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:06.956 12:38:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:06.956 12:38:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:06.956 12:38:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:06.956 12:38:39 -- common/autotest_common.sh@10 -- # set +x 00:11:08.859 12:38:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:08.859 12:38:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:08.859 12:38:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:08.859 12:38:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:08.859 12:38:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:08.859 12:38:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:08.859 12:38:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:08.859 12:38:41 -- nvmf/common.sh@294 -- # net_devs=() 00:11:08.859 12:38:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:08.859 12:38:41 -- nvmf/common.sh@295 -- # e810=() 00:11:08.859 12:38:41 -- nvmf/common.sh@295 -- # local -ga e810 00:11:08.859 12:38:41 -- nvmf/common.sh@296 -- # x722=() 00:11:08.859 12:38:41 -- nvmf/common.sh@296 -- # local -ga x722 00:11:08.859 12:38:41 -- nvmf/common.sh@297 -- # mlx=() 00:11:08.859 12:38:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:08.859 12:38:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:08.859 12:38:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:08.859 12:38:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:08.859 12:38:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:08.859 12:38:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:08.859 12:38:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:08.859 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:08.859 12:38:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:08.859 12:38:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:08.859 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:08.859 12:38:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:08.859 12:38:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:08.859 12:38:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:08.860 12:38:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:08.860 12:38:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:08.860 12:38:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:08.860 12:38:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:08.860 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:08.860 12:38:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:08.860 12:38:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:08.860 12:38:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:08.860 12:38:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:08.860 12:38:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:08.860 12:38:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:08.860 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:08.860 12:38:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:08.860 12:38:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:08.860 12:38:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:08.860 12:38:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:08.860 12:38:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:08.860 12:38:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:08.860 12:38:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:08.860 12:38:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:08.860 12:38:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:08.860 12:38:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:08.860 12:38:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:08.860 12:38:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:08.860 12:38:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:08.860 12:38:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:08.860 12:38:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:08.860 12:38:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:08.860 12:38:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:08.860 12:38:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:08.860 12:38:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:08.860 12:38:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:08.860 12:38:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:08.860 12:38:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:08.860 12:38:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:08.860 12:38:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:08.860 12:38:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:08.860 12:38:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:08.860 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:08.860 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:11:08.860 00:11:08.860 --- 10.0.0.2 ping statistics --- 00:11:08.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:08.860 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:11:08.860 12:38:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:08.860 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:08.860 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:11:08.860 00:11:08.860 --- 10.0.0.1 ping statistics --- 00:11:08.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:08.860 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:11:08.860 12:38:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:08.860 12:38:41 -- nvmf/common.sh@410 -- # return 0 00:11:08.860 12:38:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:08.860 12:38:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:08.860 12:38:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:08.860 12:38:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:08.860 12:38:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:08.860 12:38:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:08.860 12:38:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:08.860 12:38:41 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:08.860 12:38:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:08.860 12:38:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:08.860 12:38:41 -- common/autotest_common.sh@10 -- # set +x 00:11:08.860 12:38:41 -- nvmf/common.sh@469 -- # nvmfpid=3468207 00:11:08.860 12:38:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:08.860 12:38:41 -- nvmf/common.sh@470 -- # waitforlisten 3468207 00:11:08.860 12:38:41 -- common/autotest_common.sh@829 -- # '[' -z 3468207 ']' 00:11:08.860 12:38:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:08.860 12:38:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:08.860 12:38:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:08.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:08.860 12:38:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:08.860 12:38:41 -- common/autotest_common.sh@10 -- # set +x 00:11:08.860 [2024-11-20 12:38:41.951847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:08.860 [2024-11-20 12:38:41.951937] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:09.120 EAL: No free 2048 kB hugepages reported on node 1 00:11:09.120 [2024-11-20 12:38:42.030786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:09.120 [2024-11-20 12:38:42.154060] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:09.120 [2024-11-20 12:38:42.154237] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:09.120 [2024-11-20 12:38:42.154257] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:09.120 [2024-11-20 12:38:42.154272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:09.120 [2024-11-20 12:38:42.154346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:09.120 [2024-11-20 12:38:42.154375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:09.120 [2024-11-20 12:38:42.154436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:09.120 [2024-11-20 12:38:42.154439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:10.056 12:38:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:10.056 12:38:42 -- common/autotest_common.sh@862 -- # return 0 00:11:10.056 12:38:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:10.056 12:38:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:10.056 12:38:42 -- common/autotest_common.sh@10 -- # set +x 00:11:10.057 12:38:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:10.057 12:38:42 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:10.057 12:38:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.057 12:38:42 -- common/autotest_common.sh@10 -- # set +x 00:11:10.057 12:38:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.057 12:38:43 -- target/rpc.sh@26 -- # stats='{ 00:11:10.057 "tick_rate": 2700000000, 00:11:10.057 "poll_groups": [ 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_0", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [] 00:11:10.057 }, 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_1", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [] 00:11:10.057 }, 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_2", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [] 00:11:10.057 }, 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_3", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [] 00:11:10.057 } 00:11:10.057 ] 00:11:10.057 }' 00:11:10.057 12:38:43 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:10.057 12:38:43 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:10.057 12:38:43 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:10.057 12:38:43 -- target/rpc.sh@15 -- # wc -l 00:11:10.057 12:38:43 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:10.057 12:38:43 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:10.057 12:38:43 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:10.057 12:38:43 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:10.057 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.057 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.057 [2024-11-20 12:38:43.073948] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:10.057 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.057 12:38:43 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:10.057 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.057 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.057 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.057 12:38:43 -- target/rpc.sh@33 -- # stats='{ 00:11:10.057 "tick_rate": 2700000000, 00:11:10.057 "poll_groups": [ 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_0", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [ 00:11:10.057 { 00:11:10.057 "trtype": "TCP" 00:11:10.057 } 00:11:10.057 ] 00:11:10.057 }, 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_1", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [ 00:11:10.057 { 00:11:10.057 "trtype": "TCP" 00:11:10.057 } 00:11:10.057 ] 00:11:10.057 }, 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_2", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [ 00:11:10.057 { 00:11:10.057 "trtype": "TCP" 00:11:10.057 } 00:11:10.057 ] 00:11:10.057 }, 00:11:10.057 { 00:11:10.057 "name": "nvmf_tgt_poll_group_3", 00:11:10.057 "admin_qpairs": 0, 00:11:10.057 "io_qpairs": 0, 00:11:10.057 "current_admin_qpairs": 0, 00:11:10.057 "current_io_qpairs": 0, 00:11:10.057 "pending_bdev_io": 0, 00:11:10.057 "completed_nvme_io": 0, 00:11:10.057 "transports": [ 00:11:10.057 { 00:11:10.057 "trtype": "TCP" 00:11:10.057 } 00:11:10.057 ] 00:11:10.057 } 00:11:10.057 ] 00:11:10.057 }' 00:11:10.057 12:38:43 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:10.057 12:38:43 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:10.057 12:38:43 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:10.057 12:38:43 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:10.057 12:38:43 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:10.057 12:38:43 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:10.057 12:38:43 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:10.057 12:38:43 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:10.057 12:38:43 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:10.317 12:38:43 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:10.317 12:38:43 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:10.317 12:38:43 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:10.317 12:38:43 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:10.317 12:38:43 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:10.317 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.317 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.317 Malloc1 00:11:10.317 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.317 12:38:43 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:10.317 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.317 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.317 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.317 12:38:43 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:10.317 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.317 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.317 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.317 12:38:43 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:10.317 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.317 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.317 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.317 12:38:43 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:10.317 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.317 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.317 [2024-11-20 12:38:43.226402] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:10.317 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.317 12:38:43 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:10.317 12:38:43 -- common/autotest_common.sh@650 -- # local es=0 00:11:10.317 12:38:43 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:10.317 12:38:43 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:10.317 12:38:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:10.317 12:38:43 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:10.317 12:38:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:10.317 12:38:43 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:10.317 12:38:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:10.317 12:38:43 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:10.317 12:38:43 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:10.317 12:38:43 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:10.317 [2024-11-20 12:38:43.248847] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:10.317 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:10.317 could not add new controller: failed to write to nvme-fabrics device 00:11:10.317 12:38:43 -- common/autotest_common.sh@653 -- # es=1 00:11:10.317 12:38:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:10.317 12:38:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:10.317 12:38:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:10.317 12:38:43 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:10.317 12:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.317 12:38:43 -- common/autotest_common.sh@10 -- # set +x 00:11:10.317 12:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.317 12:38:43 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:10.887 12:38:43 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:10.887 12:38:43 -- common/autotest_common.sh@1187 -- # local i=0 00:11:10.887 12:38:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:10.887 12:38:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:10.887 12:38:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:12.793 12:38:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:12.793 12:38:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:12.793 12:38:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:12.793 12:38:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:12.793 12:38:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:12.793 12:38:45 -- common/autotest_common.sh@1197 -- # return 0 00:11:13.053 12:38:45 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:13.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.053 12:38:45 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:13.053 12:38:45 -- common/autotest_common.sh@1208 -- # local i=0 00:11:13.053 12:38:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:13.053 12:38:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:13.053 12:38:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:13.053 12:38:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:13.053 12:38:46 -- common/autotest_common.sh@1220 -- # return 0 00:11:13.053 12:38:46 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:13.053 12:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:13.053 12:38:46 -- common/autotest_common.sh@10 -- # set +x 00:11:13.053 12:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:13.053 12:38:46 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:13.053 12:38:46 -- common/autotest_common.sh@650 -- # local es=0 00:11:13.053 12:38:46 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:13.053 12:38:46 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:13.053 12:38:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:13.053 12:38:46 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:13.053 12:38:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:13.053 12:38:46 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:13.053 12:38:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:13.053 12:38:46 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:13.053 12:38:46 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:13.053 12:38:46 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:13.053 [2024-11-20 12:38:46.038992] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:13.053 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:13.053 could not add new controller: failed to write to nvme-fabrics device 00:11:13.053 12:38:46 -- common/autotest_common.sh@653 -- # es=1 00:11:13.053 12:38:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:13.053 12:38:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:13.053 12:38:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:13.053 12:38:46 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:13.053 12:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:13.053 12:38:46 -- common/autotest_common.sh@10 -- # set +x 00:11:13.053 12:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:13.053 12:38:46 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:13.991 12:38:46 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:13.991 12:38:46 -- common/autotest_common.sh@1187 -- # local i=0 00:11:13.991 12:38:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:13.991 12:38:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:13.991 12:38:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:15.899 12:38:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:15.899 12:38:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:15.899 12:38:48 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:15.899 12:38:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:15.899 12:38:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:15.899 12:38:48 -- common/autotest_common.sh@1197 -- # return 0 00:11:15.899 12:38:48 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:15.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.899 12:38:48 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:15.899 12:38:48 -- common/autotest_common.sh@1208 -- # local i=0 00:11:15.899 12:38:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:15.899 12:38:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:15.899 12:38:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:15.899 12:38:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:15.899 12:38:48 -- common/autotest_common.sh@1220 -- # return 0 00:11:15.899 12:38:48 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:15.899 12:38:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:15.899 12:38:48 -- common/autotest_common.sh@10 -- # set +x 00:11:15.899 12:38:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:15.899 12:38:48 -- target/rpc.sh@81 -- # seq 1 5 00:11:15.899 12:38:48 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:15.899 12:38:48 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:15.899 12:38:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:15.899 12:38:48 -- common/autotest_common.sh@10 -- # set +x 00:11:15.899 12:38:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:15.899 12:38:48 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:15.899 12:38:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:15.899 12:38:48 -- common/autotest_common.sh@10 -- # set +x 00:11:15.899 [2024-11-20 12:38:48.949846] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:15.899 12:38:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:15.899 12:38:48 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:15.899 12:38:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:15.899 12:38:48 -- common/autotest_common.sh@10 -- # set +x 00:11:15.899 12:38:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:15.899 12:38:48 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:15.899 12:38:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:15.899 12:38:48 -- common/autotest_common.sh@10 -- # set +x 00:11:15.899 12:38:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:15.899 12:38:48 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:16.836 12:38:49 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:16.836 12:38:49 -- common/autotest_common.sh@1187 -- # local i=0 00:11:16.836 12:38:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:16.836 12:38:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:16.836 12:38:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:18.748 12:38:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:18.748 12:38:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:18.748 12:38:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:18.748 12:38:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:18.748 12:38:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:18.748 12:38:51 -- common/autotest_common.sh@1197 -- # return 0 00:11:18.748 12:38:51 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:18.748 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.748 12:38:51 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:18.748 12:38:51 -- common/autotest_common.sh@1208 -- # local i=0 00:11:18.748 12:38:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:18.748 12:38:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:18.748 12:38:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:18.748 12:38:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:18.748 12:38:51 -- common/autotest_common.sh@1220 -- # return 0 00:11:18.748 12:38:51 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:18.748 12:38:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:18.748 12:38:51 -- common/autotest_common.sh@10 -- # set +x 00:11:18.748 12:38:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:18.748 12:38:51 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:18.748 12:38:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:18.748 12:38:51 -- common/autotest_common.sh@10 -- # set +x 00:11:18.748 12:38:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:18.748 12:38:51 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:18.748 12:38:51 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:18.748 12:38:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:18.748 12:38:51 -- common/autotest_common.sh@10 -- # set +x 00:11:18.748 12:38:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:18.748 12:38:51 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:18.748 12:38:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:18.748 12:38:51 -- common/autotest_common.sh@10 -- # set +x 00:11:18.748 [2024-11-20 12:38:51.777163] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:18.748 12:38:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:18.748 12:38:51 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:18.748 12:38:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:18.748 12:38:51 -- common/autotest_common.sh@10 -- # set +x 00:11:18.748 12:38:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:18.748 12:38:51 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:18.748 12:38:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:18.748 12:38:51 -- common/autotest_common.sh@10 -- # set +x 00:11:18.748 12:38:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:18.748 12:38:51 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:19.316 12:38:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:19.316 12:38:52 -- common/autotest_common.sh@1187 -- # local i=0 00:11:19.316 12:38:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:19.316 12:38:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:19.316 12:38:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:21.854 12:38:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:21.854 12:38:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:21.854 12:38:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:21.854 12:38:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:21.854 12:38:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:21.854 12:38:54 -- common/autotest_common.sh@1197 -- # return 0 00:11:21.854 12:38:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:21.854 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.854 12:38:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:21.854 12:38:54 -- common/autotest_common.sh@1208 -- # local i=0 00:11:21.854 12:38:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:21.854 12:38:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:21.854 12:38:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:21.854 12:38:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:21.854 12:38:54 -- common/autotest_common.sh@1220 -- # return 0 00:11:21.854 12:38:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:21.854 12:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.854 12:38:54 -- common/autotest_common.sh@10 -- # set +x 00:11:21.854 12:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.854 12:38:54 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:21.854 12:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.854 12:38:54 -- common/autotest_common.sh@10 -- # set +x 00:11:21.854 12:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.854 12:38:54 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:21.854 12:38:54 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:21.854 12:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.854 12:38:54 -- common/autotest_common.sh@10 -- # set +x 00:11:21.854 12:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.854 12:38:54 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:21.854 12:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.854 12:38:54 -- common/autotest_common.sh@10 -- # set +x 00:11:21.854 [2024-11-20 12:38:54.527257] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:21.854 12:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.854 12:38:54 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:21.854 12:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.854 12:38:54 -- common/autotest_common.sh@10 -- # set +x 00:11:21.854 12:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.854 12:38:54 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:21.854 12:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.854 12:38:54 -- common/autotest_common.sh@10 -- # set +x 00:11:21.854 12:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.854 12:38:54 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:22.423 12:38:55 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:22.423 12:38:55 -- common/autotest_common.sh@1187 -- # local i=0 00:11:22.423 12:38:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:22.423 12:38:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:22.423 12:38:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:24.330 12:38:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:24.330 12:38:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:24.330 12:38:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:24.330 12:38:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:24.330 12:38:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:24.330 12:38:57 -- common/autotest_common.sh@1197 -- # return 0 00:11:24.330 12:38:57 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:24.330 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.330 12:38:57 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:24.330 12:38:57 -- common/autotest_common.sh@1208 -- # local i=0 00:11:24.330 12:38:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:24.330 12:38:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:24.330 12:38:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:24.330 12:38:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:24.330 12:38:57 -- common/autotest_common.sh@1220 -- # return 0 00:11:24.330 12:38:57 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:24.330 12:38:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.330 12:38:57 -- common/autotest_common.sh@10 -- # set +x 00:11:24.330 12:38:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.330 12:38:57 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:24.330 12:38:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.330 12:38:57 -- common/autotest_common.sh@10 -- # set +x 00:11:24.330 12:38:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.330 12:38:57 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:24.330 12:38:57 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:24.330 12:38:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.330 12:38:57 -- common/autotest_common.sh@10 -- # set +x 00:11:24.330 12:38:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.330 12:38:57 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:24.330 12:38:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.330 12:38:57 -- common/autotest_common.sh@10 -- # set +x 00:11:24.330 [2024-11-20 12:38:57.351003] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:24.330 12:38:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.330 12:38:57 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:24.330 12:38:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.330 12:38:57 -- common/autotest_common.sh@10 -- # set +x 00:11:24.330 12:38:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.330 12:38:57 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:24.330 12:38:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.330 12:38:57 -- common/autotest_common.sh@10 -- # set +x 00:11:24.330 12:38:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.330 12:38:57 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:24.898 12:38:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:24.898 12:38:57 -- common/autotest_common.sh@1187 -- # local i=0 00:11:24.898 12:38:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:24.898 12:38:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:24.898 12:38:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:27.433 12:38:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:27.433 12:38:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:27.433 12:38:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:27.433 12:38:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:27.433 12:38:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:27.433 12:38:59 -- common/autotest_common.sh@1197 -- # return 0 00:11:27.433 12:38:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:27.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.433 12:39:00 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:27.433 12:39:00 -- common/autotest_common.sh@1208 -- # local i=0 00:11:27.433 12:39:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:27.433 12:39:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:27.433 12:39:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:27.433 12:39:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:27.433 12:39:00 -- common/autotest_common.sh@1220 -- # return 0 00:11:27.433 12:39:00 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:27.433 12:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.433 12:39:00 -- common/autotest_common.sh@10 -- # set +x 00:11:27.433 12:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.433 12:39:00 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:27.433 12:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.433 12:39:00 -- common/autotest_common.sh@10 -- # set +x 00:11:27.433 12:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.433 12:39:00 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:27.433 12:39:00 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:27.433 12:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.433 12:39:00 -- common/autotest_common.sh@10 -- # set +x 00:11:27.433 12:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.433 12:39:00 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:27.433 12:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.433 12:39:00 -- common/autotest_common.sh@10 -- # set +x 00:11:27.433 [2024-11-20 12:39:00.129378] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:27.433 12:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.433 12:39:00 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:27.433 12:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.433 12:39:00 -- common/autotest_common.sh@10 -- # set +x 00:11:27.433 12:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.433 12:39:00 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:27.433 12:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.433 12:39:00 -- common/autotest_common.sh@10 -- # set +x 00:11:27.433 12:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.433 12:39:00 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:27.692 12:39:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:27.692 12:39:00 -- common/autotest_common.sh@1187 -- # local i=0 00:11:27.692 12:39:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:27.692 12:39:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:27.692 12:39:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:30.228 12:39:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:30.228 12:39:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:30.228 12:39:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:30.228 12:39:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:30.229 12:39:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:30.229 12:39:02 -- common/autotest_common.sh@1197 -- # return 0 00:11:30.229 12:39:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:30.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.229 12:39:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:30.229 12:39:02 -- common/autotest_common.sh@1208 -- # local i=0 00:11:30.229 12:39:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:30.229 12:39:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:30.229 12:39:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:30.229 12:39:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:30.229 12:39:02 -- common/autotest_common.sh@1220 -- # return 0 00:11:30.229 12:39:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@99 -- # seq 1 5 00:11:30.229 12:39:02 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:30.229 12:39:02 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 [2024-11-20 12:39:02.896433] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:30.229 12:39:02 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 [2024-11-20 12:39:02.944467] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:30.229 12:39:02 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 [2024-11-20 12:39:02.992610] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:30.229 12:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:02 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:30.229 12:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:02 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:30.229 12:39:03 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 [2024-11-20 12:39:03.040760] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:30.229 12:39:03 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 [2024-11-20 12:39:03.088932] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.229 12:39:03 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:30.229 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.229 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.229 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.230 12:39:03 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:30.230 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.230 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.230 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.230 12:39:03 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.230 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.230 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.230 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.230 12:39:03 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:30.230 12:39:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.230 12:39:03 -- common/autotest_common.sh@10 -- # set +x 00:11:30.230 12:39:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.230 12:39:03 -- target/rpc.sh@110 -- # stats='{ 00:11:30.230 "tick_rate": 2700000000, 00:11:30.230 "poll_groups": [ 00:11:30.230 { 00:11:30.230 "name": "nvmf_tgt_poll_group_0", 00:11:30.230 "admin_qpairs": 2, 00:11:30.230 "io_qpairs": 84, 00:11:30.230 "current_admin_qpairs": 0, 00:11:30.230 "current_io_qpairs": 0, 00:11:30.230 "pending_bdev_io": 0, 00:11:30.230 "completed_nvme_io": 86, 00:11:30.230 "transports": [ 00:11:30.230 { 00:11:30.230 "trtype": "TCP" 00:11:30.230 } 00:11:30.230 ] 00:11:30.230 }, 00:11:30.230 { 00:11:30.230 "name": "nvmf_tgt_poll_group_1", 00:11:30.230 "admin_qpairs": 2, 00:11:30.230 "io_qpairs": 84, 00:11:30.230 "current_admin_qpairs": 0, 00:11:30.230 "current_io_qpairs": 0, 00:11:30.230 "pending_bdev_io": 0, 00:11:30.230 "completed_nvme_io": 233, 00:11:30.230 "transports": [ 00:11:30.230 { 00:11:30.230 "trtype": "TCP" 00:11:30.230 } 00:11:30.230 ] 00:11:30.230 }, 00:11:30.230 { 00:11:30.230 "name": "nvmf_tgt_poll_group_2", 00:11:30.230 "admin_qpairs": 1, 00:11:30.230 "io_qpairs": 84, 00:11:30.230 "current_admin_qpairs": 0, 00:11:30.230 "current_io_qpairs": 0, 00:11:30.230 "pending_bdev_io": 0, 00:11:30.230 "completed_nvme_io": 184, 00:11:30.230 "transports": [ 00:11:30.230 { 00:11:30.230 "trtype": "TCP" 00:11:30.230 } 00:11:30.230 ] 00:11:30.230 }, 00:11:30.230 { 00:11:30.230 "name": "nvmf_tgt_poll_group_3", 00:11:30.230 "admin_qpairs": 2, 00:11:30.230 "io_qpairs": 84, 00:11:30.230 "current_admin_qpairs": 0, 00:11:30.230 "current_io_qpairs": 0, 00:11:30.230 "pending_bdev_io": 0, 00:11:30.230 "completed_nvme_io": 183, 00:11:30.230 "transports": [ 00:11:30.230 { 00:11:30.230 "trtype": "TCP" 00:11:30.230 } 00:11:30.230 ] 00:11:30.230 } 00:11:30.230 ] 00:11:30.230 }' 00:11:30.230 12:39:03 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:30.230 12:39:03 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:30.230 12:39:03 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:30.230 12:39:03 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:30.230 12:39:03 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:30.230 12:39:03 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:30.230 12:39:03 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:30.230 12:39:03 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:30.230 12:39:03 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:30.230 12:39:03 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:30.230 12:39:03 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:30.230 12:39:03 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:30.230 12:39:03 -- target/rpc.sh@123 -- # nvmftestfini 00:11:30.230 12:39:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:30.230 12:39:03 -- nvmf/common.sh@116 -- # sync 00:11:30.230 12:39:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:30.230 12:39:03 -- nvmf/common.sh@119 -- # set +e 00:11:30.230 12:39:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:30.230 12:39:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:30.230 rmmod nvme_tcp 00:11:30.230 rmmod nvme_fabrics 00:11:30.230 rmmod nvme_keyring 00:11:30.230 12:39:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:30.230 12:39:03 -- nvmf/common.sh@123 -- # set -e 00:11:30.230 12:39:03 -- nvmf/common.sh@124 -- # return 0 00:11:30.230 12:39:03 -- nvmf/common.sh@477 -- # '[' -n 3468207 ']' 00:11:30.230 12:39:03 -- nvmf/common.sh@478 -- # killprocess 3468207 00:11:30.230 12:39:03 -- common/autotest_common.sh@936 -- # '[' -z 3468207 ']' 00:11:30.230 12:39:03 -- common/autotest_common.sh@940 -- # kill -0 3468207 00:11:30.230 12:39:03 -- common/autotest_common.sh@941 -- # uname 00:11:30.230 12:39:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:30.230 12:39:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3468207 00:11:30.488 12:39:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:30.488 12:39:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:30.488 12:39:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3468207' 00:11:30.488 killing process with pid 3468207 00:11:30.488 12:39:03 -- common/autotest_common.sh@955 -- # kill 3468207 00:11:30.488 12:39:03 -- common/autotest_common.sh@960 -- # wait 3468207 00:11:30.749 12:39:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:30.749 12:39:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:30.749 12:39:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:30.749 12:39:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:30.749 12:39:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:30.749 12:39:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:30.749 12:39:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:30.749 12:39:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:32.657 12:39:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:32.657 00:11:32.657 real 0m26.160s 00:11:32.657 user 1m25.154s 00:11:32.657 sys 0m4.362s 00:11:32.657 12:39:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:32.657 12:39:05 -- common/autotest_common.sh@10 -- # set +x 00:11:32.657 ************************************ 00:11:32.657 END TEST nvmf_rpc 00:11:32.657 ************************************ 00:11:32.657 12:39:05 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:32.657 12:39:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:32.657 12:39:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:32.657 12:39:05 -- common/autotest_common.sh@10 -- # set +x 00:11:32.657 ************************************ 00:11:32.657 START TEST nvmf_invalid 00:11:32.657 ************************************ 00:11:32.657 12:39:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:32.657 * Looking for test storage... 00:11:32.657 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:32.657 12:39:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:32.657 12:39:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:32.657 12:39:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:32.917 12:39:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:32.917 12:39:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:32.917 12:39:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:32.917 12:39:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:32.917 12:39:05 -- scripts/common.sh@335 -- # IFS=.-: 00:11:32.917 12:39:05 -- scripts/common.sh@335 -- # read -ra ver1 00:11:32.917 12:39:05 -- scripts/common.sh@336 -- # IFS=.-: 00:11:32.917 12:39:05 -- scripts/common.sh@336 -- # read -ra ver2 00:11:32.917 12:39:05 -- scripts/common.sh@337 -- # local 'op=<' 00:11:32.917 12:39:05 -- scripts/common.sh@339 -- # ver1_l=2 00:11:32.917 12:39:05 -- scripts/common.sh@340 -- # ver2_l=1 00:11:32.917 12:39:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:32.917 12:39:05 -- scripts/common.sh@343 -- # case "$op" in 00:11:32.917 12:39:05 -- scripts/common.sh@344 -- # : 1 00:11:32.917 12:39:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:32.917 12:39:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:32.917 12:39:05 -- scripts/common.sh@364 -- # decimal 1 00:11:32.917 12:39:05 -- scripts/common.sh@352 -- # local d=1 00:11:32.917 12:39:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:32.917 12:39:05 -- scripts/common.sh@354 -- # echo 1 00:11:32.917 12:39:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:32.917 12:39:05 -- scripts/common.sh@365 -- # decimal 2 00:11:32.917 12:39:05 -- scripts/common.sh@352 -- # local d=2 00:11:32.917 12:39:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:32.917 12:39:05 -- scripts/common.sh@354 -- # echo 2 00:11:32.917 12:39:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:32.917 12:39:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:32.917 12:39:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:32.917 12:39:05 -- scripts/common.sh@367 -- # return 0 00:11:32.917 12:39:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:32.917 12:39:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:32.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:32.917 --rc genhtml_branch_coverage=1 00:11:32.917 --rc genhtml_function_coverage=1 00:11:32.917 --rc genhtml_legend=1 00:11:32.917 --rc geninfo_all_blocks=1 00:11:32.917 --rc geninfo_unexecuted_blocks=1 00:11:32.917 00:11:32.917 ' 00:11:32.917 12:39:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:32.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:32.917 --rc genhtml_branch_coverage=1 00:11:32.917 --rc genhtml_function_coverage=1 00:11:32.917 --rc genhtml_legend=1 00:11:32.917 --rc geninfo_all_blocks=1 00:11:32.917 --rc geninfo_unexecuted_blocks=1 00:11:32.917 00:11:32.917 ' 00:11:32.917 12:39:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:32.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:32.917 --rc genhtml_branch_coverage=1 00:11:32.917 --rc genhtml_function_coverage=1 00:11:32.917 --rc genhtml_legend=1 00:11:32.917 --rc geninfo_all_blocks=1 00:11:32.917 --rc geninfo_unexecuted_blocks=1 00:11:32.917 00:11:32.917 ' 00:11:32.917 12:39:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:32.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:32.917 --rc genhtml_branch_coverage=1 00:11:32.918 --rc genhtml_function_coverage=1 00:11:32.918 --rc genhtml_legend=1 00:11:32.918 --rc geninfo_all_blocks=1 00:11:32.918 --rc geninfo_unexecuted_blocks=1 00:11:32.918 00:11:32.918 ' 00:11:32.918 12:39:05 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:32.918 12:39:05 -- nvmf/common.sh@7 -- # uname -s 00:11:32.918 12:39:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:32.918 12:39:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:32.918 12:39:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:32.918 12:39:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:32.918 12:39:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:32.918 12:39:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:32.918 12:39:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:32.918 12:39:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:32.918 12:39:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:32.918 12:39:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:32.918 12:39:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:32.918 12:39:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:32.918 12:39:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:32.918 12:39:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:32.918 12:39:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:32.918 12:39:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:32.918 12:39:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:32.918 12:39:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:32.918 12:39:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:32.918 12:39:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.918 12:39:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.918 12:39:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.918 12:39:05 -- paths/export.sh@5 -- # export PATH 00:11:32.918 12:39:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.918 12:39:05 -- nvmf/common.sh@46 -- # : 0 00:11:32.918 12:39:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:32.918 12:39:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:32.918 12:39:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:32.918 12:39:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:32.918 12:39:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:32.918 12:39:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:32.918 12:39:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:32.918 12:39:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:32.918 12:39:05 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:32.918 12:39:05 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:32.918 12:39:05 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:32.918 12:39:05 -- target/invalid.sh@14 -- # target=foobar 00:11:32.918 12:39:05 -- target/invalid.sh@16 -- # RANDOM=0 00:11:32.918 12:39:05 -- target/invalid.sh@34 -- # nvmftestinit 00:11:32.918 12:39:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:32.918 12:39:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:32.918 12:39:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:32.918 12:39:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:32.918 12:39:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:32.918 12:39:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:32.918 12:39:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:32.918 12:39:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:32.918 12:39:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:32.918 12:39:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:32.918 12:39:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:32.918 12:39:05 -- common/autotest_common.sh@10 -- # set +x 00:11:34.822 12:39:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:34.822 12:39:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:34.822 12:39:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:34.822 12:39:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:34.822 12:39:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:34.822 12:39:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:34.822 12:39:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:34.822 12:39:07 -- nvmf/common.sh@294 -- # net_devs=() 00:11:34.822 12:39:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:34.822 12:39:07 -- nvmf/common.sh@295 -- # e810=() 00:11:34.822 12:39:07 -- nvmf/common.sh@295 -- # local -ga e810 00:11:34.822 12:39:07 -- nvmf/common.sh@296 -- # x722=() 00:11:34.822 12:39:07 -- nvmf/common.sh@296 -- # local -ga x722 00:11:34.822 12:39:07 -- nvmf/common.sh@297 -- # mlx=() 00:11:34.822 12:39:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:34.822 12:39:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:34.822 12:39:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:34.822 12:39:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:34.822 12:39:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:34.822 12:39:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:34.822 12:39:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:34.822 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:34.822 12:39:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:34.822 12:39:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:34.822 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:34.822 12:39:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:34.822 12:39:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:34.822 12:39:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:34.822 12:39:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:34.822 12:39:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:34.822 12:39:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:34.823 12:39:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:34.823 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:34.823 12:39:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:34.823 12:39:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:34.823 12:39:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:34.823 12:39:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:34.823 12:39:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:34.823 12:39:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:34.823 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:34.823 12:39:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:34.823 12:39:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:34.823 12:39:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:34.823 12:39:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:34.823 12:39:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:34.823 12:39:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:34.823 12:39:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:34.823 12:39:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:34.823 12:39:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:34.823 12:39:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:34.823 12:39:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:34.823 12:39:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:34.823 12:39:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:34.823 12:39:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:34.823 12:39:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:34.823 12:39:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:34.823 12:39:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:34.823 12:39:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:34.823 12:39:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:35.080 12:39:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:35.080 12:39:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:35.080 12:39:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:35.080 12:39:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:35.080 12:39:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:35.080 12:39:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:35.080 12:39:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:35.080 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:35.080 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:11:35.080 00:11:35.080 --- 10.0.0.2 ping statistics --- 00:11:35.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:35.080 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:11:35.080 12:39:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:35.080 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:35.080 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:11:35.080 00:11:35.080 --- 10.0.0.1 ping statistics --- 00:11:35.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:35.080 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:11:35.080 12:39:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:35.080 12:39:08 -- nvmf/common.sh@410 -- # return 0 00:11:35.080 12:39:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:35.080 12:39:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:35.080 12:39:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:35.080 12:39:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:35.080 12:39:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:35.080 12:39:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:35.080 12:39:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:35.080 12:39:08 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:35.080 12:39:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:35.080 12:39:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:35.080 12:39:08 -- common/autotest_common.sh@10 -- # set +x 00:11:35.080 12:39:08 -- nvmf/common.sh@469 -- # nvmfpid=3473467 00:11:35.080 12:39:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:35.080 12:39:08 -- nvmf/common.sh@470 -- # waitforlisten 3473467 00:11:35.080 12:39:08 -- common/autotest_common.sh@829 -- # '[' -z 3473467 ']' 00:11:35.080 12:39:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:35.080 12:39:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:35.080 12:39:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:35.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:35.080 12:39:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:35.080 12:39:08 -- common/autotest_common.sh@10 -- # set +x 00:11:35.080 [2024-11-20 12:39:08.104199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:35.080 [2024-11-20 12:39:08.104288] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:35.080 EAL: No free 2048 kB hugepages reported on node 1 00:11:35.080 [2024-11-20 12:39:08.177779] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:35.369 [2024-11-20 12:39:08.296985] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:35.369 [2024-11-20 12:39:08.297163] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:35.369 [2024-11-20 12:39:08.297185] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:35.369 [2024-11-20 12:39:08.297200] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:35.369 [2024-11-20 12:39:08.297258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:35.369 [2024-11-20 12:39:08.297317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:35.369 [2024-11-20 12:39:08.297370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:35.369 [2024-11-20 12:39:08.297375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:36.321 12:39:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:36.321 12:39:09 -- common/autotest_common.sh@862 -- # return 0 00:11:36.321 12:39:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:36.321 12:39:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:36.321 12:39:09 -- common/autotest_common.sh@10 -- # set +x 00:11:36.321 12:39:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:36.321 12:39:09 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:36.321 12:39:09 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode25197 00:11:36.321 [2024-11-20 12:39:09.401619] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:36.321 12:39:09 -- target/invalid.sh@40 -- # out='request: 00:11:36.321 { 00:11:36.321 "nqn": "nqn.2016-06.io.spdk:cnode25197", 00:11:36.321 "tgt_name": "foobar", 00:11:36.321 "method": "nvmf_create_subsystem", 00:11:36.321 "req_id": 1 00:11:36.321 } 00:11:36.321 Got JSON-RPC error response 00:11:36.321 response: 00:11:36.321 { 00:11:36.321 "code": -32603, 00:11:36.321 "message": "Unable to find target foobar" 00:11:36.321 }' 00:11:36.321 12:39:09 -- target/invalid.sh@41 -- # [[ request: 00:11:36.321 { 00:11:36.321 "nqn": "nqn.2016-06.io.spdk:cnode25197", 00:11:36.321 "tgt_name": "foobar", 00:11:36.321 "method": "nvmf_create_subsystem", 00:11:36.321 "req_id": 1 00:11:36.321 } 00:11:36.321 Got JSON-RPC error response 00:11:36.321 response: 00:11:36.321 { 00:11:36.321 "code": -32603, 00:11:36.321 "message": "Unable to find target foobar" 00:11:36.321 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:36.321 12:39:09 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:36.321 12:39:09 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode23844 00:11:36.580 [2024-11-20 12:39:09.662504] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23844: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:36.580 12:39:09 -- target/invalid.sh@45 -- # out='request: 00:11:36.580 { 00:11:36.580 "nqn": "nqn.2016-06.io.spdk:cnode23844", 00:11:36.580 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:36.580 "method": "nvmf_create_subsystem", 00:11:36.580 "req_id": 1 00:11:36.580 } 00:11:36.580 Got JSON-RPC error response 00:11:36.580 response: 00:11:36.580 { 00:11:36.580 "code": -32602, 00:11:36.580 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:36.580 }' 00:11:36.580 12:39:09 -- target/invalid.sh@46 -- # [[ request: 00:11:36.580 { 00:11:36.580 "nqn": "nqn.2016-06.io.spdk:cnode23844", 00:11:36.580 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:36.580 "method": "nvmf_create_subsystem", 00:11:36.580 "req_id": 1 00:11:36.580 } 00:11:36.580 Got JSON-RPC error response 00:11:36.580 response: 00:11:36.580 { 00:11:36.580 "code": -32602, 00:11:36.580 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:36.580 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:36.580 12:39:09 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:36.839 12:39:09 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode22241 00:11:36.839 [2024-11-20 12:39:09.919327] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22241: invalid model number 'SPDK_Controller' 00:11:36.839 12:39:09 -- target/invalid.sh@50 -- # out='request: 00:11:36.839 { 00:11:36.839 "nqn": "nqn.2016-06.io.spdk:cnode22241", 00:11:36.839 "model_number": "SPDK_Controller\u001f", 00:11:36.839 "method": "nvmf_create_subsystem", 00:11:36.839 "req_id": 1 00:11:36.839 } 00:11:36.839 Got JSON-RPC error response 00:11:36.839 response: 00:11:36.839 { 00:11:36.839 "code": -32602, 00:11:36.839 "message": "Invalid MN SPDK_Controller\u001f" 00:11:36.839 }' 00:11:36.839 12:39:09 -- target/invalid.sh@51 -- # [[ request: 00:11:36.839 { 00:11:36.839 "nqn": "nqn.2016-06.io.spdk:cnode22241", 00:11:36.839 "model_number": "SPDK_Controller\u001f", 00:11:36.839 "method": "nvmf_create_subsystem", 00:11:36.839 "req_id": 1 00:11:36.839 } 00:11:36.839 Got JSON-RPC error response 00:11:36.839 response: 00:11:36.839 { 00:11:36.839 "code": -32602, 00:11:36.839 "message": "Invalid MN SPDK_Controller\u001f" 00:11:36.839 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:36.839 12:39:09 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:36.839 12:39:09 -- target/invalid.sh@19 -- # local length=21 ll 00:11:36.839 12:39:09 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:36.839 12:39:09 -- target/invalid.sh@21 -- # local chars 00:11:36.839 12:39:09 -- target/invalid.sh@22 -- # local string 00:11:36.839 12:39:09 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:36.839 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 110 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=n 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 76 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=L 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 105 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x69' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=i 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 77 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=M 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 59 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=';' 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 106 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=j 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 96 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+='`' 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 113 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x71' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=q 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 46 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=. 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 54 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x36' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=6 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 84 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=T 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 52 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x34' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=4 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 47 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=/ 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 73 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x49' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+=I 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # printf %x 61 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:11:37.098 12:39:09 -- target/invalid.sh@25 -- # string+== 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:09 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:10 -- target/invalid.sh@25 -- # printf %x 119 00:11:37.098 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x77' 00:11:37.098 12:39:10 -- target/invalid.sh@25 -- # string+=w 00:11:37.098 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.098 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.098 12:39:10 -- target/invalid.sh@25 -- # printf %x 75 00:11:37.098 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:11:37.098 12:39:10 -- target/invalid.sh@25 -- # string+=K 00:11:37.098 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # printf %x 124 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # string+='|' 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # printf %x 36 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x24' 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # string+='$' 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # printf %x 125 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # string+='}' 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # printf %x 90 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:11:37.099 12:39:10 -- target/invalid.sh@25 -- # string+=Z 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.099 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.099 12:39:10 -- target/invalid.sh@28 -- # [[ n == \- ]] 00:11:37.099 12:39:10 -- target/invalid.sh@31 -- # echo 'nLiM;j`q.6T4/I=wK|$}Z' 00:11:37.099 12:39:10 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'nLiM;j`q.6T4/I=wK|$}Z' nqn.2016-06.io.spdk:cnode27787 00:11:37.357 [2024-11-20 12:39:10.268580] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27787: invalid serial number 'nLiM;j`q.6T4/I=wK|$}Z' 00:11:37.357 12:39:10 -- target/invalid.sh@54 -- # out='request: 00:11:37.357 { 00:11:37.357 "nqn": "nqn.2016-06.io.spdk:cnode27787", 00:11:37.357 "serial_number": "nLiM;j`q.6T4/I=wK|$}Z", 00:11:37.357 "method": "nvmf_create_subsystem", 00:11:37.357 "req_id": 1 00:11:37.357 } 00:11:37.357 Got JSON-RPC error response 00:11:37.357 response: 00:11:37.357 { 00:11:37.357 "code": -32602, 00:11:37.357 "message": "Invalid SN nLiM;j`q.6T4/I=wK|$}Z" 00:11:37.357 }' 00:11:37.357 12:39:10 -- target/invalid.sh@55 -- # [[ request: 00:11:37.357 { 00:11:37.357 "nqn": "nqn.2016-06.io.spdk:cnode27787", 00:11:37.358 "serial_number": "nLiM;j`q.6T4/I=wK|$}Z", 00:11:37.358 "method": "nvmf_create_subsystem", 00:11:37.358 "req_id": 1 00:11:37.358 } 00:11:37.358 Got JSON-RPC error response 00:11:37.358 response: 00:11:37.358 { 00:11:37.358 "code": -32602, 00:11:37.358 "message": "Invalid SN nLiM;j`q.6T4/I=wK|$}Z" 00:11:37.358 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:37.358 12:39:10 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:37.358 12:39:10 -- target/invalid.sh@19 -- # local length=41 ll 00:11:37.358 12:39:10 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:37.358 12:39:10 -- target/invalid.sh@21 -- # local chars 00:11:37.358 12:39:10 -- target/invalid.sh@22 -- # local string 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 120 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x78' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=x 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 55 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x37' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=7 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 92 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='\' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 83 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x53' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=S 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 70 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x46' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=F 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 111 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=o 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 57 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x39' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=9 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 37 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x25' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=% 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 42 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='*' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 103 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=g 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 80 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x50' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=P 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 41 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x29' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=')' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 91 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='[' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 42 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='*' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 121 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=y 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 127 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=$'\177' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 87 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x57' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=W 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 71 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x47' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=G 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 87 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x57' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=W 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 35 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x23' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='#' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 35 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x23' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='#' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 41 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x29' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=')' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 32 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=' ' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 100 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x64' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=d 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 109 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=m 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 63 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+='?' 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 55 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x37' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=7 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.358 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # printf %x 101 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x65' 00:11:37.358 12:39:10 -- target/invalid.sh@25 -- # string+=e 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 111 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=o 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 54 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x36' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=6 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 75 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=K 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 38 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x26' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+='&' 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 96 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+='`' 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 89 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x59' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=Y 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 115 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x73' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=s 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 121 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=y 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 36 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x24' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+='$' 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 117 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x75' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=u 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 57 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x39' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=9 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 121 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=y 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # printf %x 79 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:37.359 12:39:10 -- target/invalid.sh@25 -- # string+=O 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:37.359 12:39:10 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:37.359 12:39:10 -- target/invalid.sh@28 -- # [[ x == \- ]] 00:11:37.359 12:39:10 -- target/invalid.sh@31 -- # echo 'x7\SFo9%*gP)[*yWGW##) dm?7eo6K&`Ysy$u9yO' 00:11:37.359 12:39:10 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'x7\SFo9%*gP)[*yWGW##) dm?7eo6K&`Ysy$u9yO' nqn.2016-06.io.spdk:cnode22725 00:11:37.617 [2024-11-20 12:39:10.641910] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22725: invalid model number 'x7\SFo9%*gP)[*yWGW##) dm?7eo6K&`Ysy$u9yO' 00:11:37.617 12:39:10 -- target/invalid.sh@58 -- # out='request: 00:11:37.617 { 00:11:37.617 "nqn": "nqn.2016-06.io.spdk:cnode22725", 00:11:37.617 "model_number": "x7\\SFo9%*gP)[*y\u007fWGW##) dm?7eo6K&`Ysy$u9yO", 00:11:37.617 "method": "nvmf_create_subsystem", 00:11:37.617 "req_id": 1 00:11:37.617 } 00:11:37.617 Got JSON-RPC error response 00:11:37.617 response: 00:11:37.617 { 00:11:37.617 "code": -32602, 00:11:37.617 "message": "Invalid MN x7\\SFo9%*gP)[*y\u007fWGW##) dm?7eo6K&`Ysy$u9yO" 00:11:37.617 }' 00:11:37.617 12:39:10 -- target/invalid.sh@59 -- # [[ request: 00:11:37.617 { 00:11:37.617 "nqn": "nqn.2016-06.io.spdk:cnode22725", 00:11:37.617 "model_number": "x7\\SFo9%*gP)[*y\u007fWGW##) dm?7eo6K&`Ysy$u9yO", 00:11:37.617 "method": "nvmf_create_subsystem", 00:11:37.617 "req_id": 1 00:11:37.617 } 00:11:37.617 Got JSON-RPC error response 00:11:37.617 response: 00:11:37.617 { 00:11:37.617 "code": -32602, 00:11:37.617 "message": "Invalid MN x7\\SFo9%*gP)[*y\u007fWGW##) dm?7eo6K&`Ysy$u9yO" 00:11:37.617 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:37.617 12:39:10 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:11:37.874 [2024-11-20 12:39:10.890801] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:37.874 12:39:10 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:11:38.132 12:39:11 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:11:38.132 12:39:11 -- target/invalid.sh@67 -- # echo '' 00:11:38.132 12:39:11 -- target/invalid.sh@67 -- # head -n 1 00:11:38.132 12:39:11 -- target/invalid.sh@67 -- # IP= 00:11:38.132 12:39:11 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:11:38.390 [2024-11-20 12:39:11.396540] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:11:38.390 12:39:11 -- target/invalid.sh@69 -- # out='request: 00:11:38.390 { 00:11:38.390 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:38.390 "listen_address": { 00:11:38.390 "trtype": "tcp", 00:11:38.390 "traddr": "", 00:11:38.390 "trsvcid": "4421" 00:11:38.390 }, 00:11:38.390 "method": "nvmf_subsystem_remove_listener", 00:11:38.390 "req_id": 1 00:11:38.390 } 00:11:38.390 Got JSON-RPC error response 00:11:38.390 response: 00:11:38.390 { 00:11:38.390 "code": -32602, 00:11:38.390 "message": "Invalid parameters" 00:11:38.390 }' 00:11:38.390 12:39:11 -- target/invalid.sh@70 -- # [[ request: 00:11:38.390 { 00:11:38.390 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:38.390 "listen_address": { 00:11:38.390 "trtype": "tcp", 00:11:38.390 "traddr": "", 00:11:38.390 "trsvcid": "4421" 00:11:38.390 }, 00:11:38.390 "method": "nvmf_subsystem_remove_listener", 00:11:38.390 "req_id": 1 00:11:38.390 } 00:11:38.390 Got JSON-RPC error response 00:11:38.390 response: 00:11:38.390 { 00:11:38.390 "code": -32602, 00:11:38.390 "message": "Invalid parameters" 00:11:38.390 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:11:38.390 12:39:11 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3324 -i 0 00:11:38.648 [2024-11-20 12:39:11.649304] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3324: invalid cntlid range [0-65519] 00:11:38.649 12:39:11 -- target/invalid.sh@73 -- # out='request: 00:11:38.649 { 00:11:38.649 "nqn": "nqn.2016-06.io.spdk:cnode3324", 00:11:38.649 "min_cntlid": 0, 00:11:38.649 "method": "nvmf_create_subsystem", 00:11:38.649 "req_id": 1 00:11:38.649 } 00:11:38.649 Got JSON-RPC error response 00:11:38.649 response: 00:11:38.649 { 00:11:38.649 "code": -32602, 00:11:38.649 "message": "Invalid cntlid range [0-65519]" 00:11:38.649 }' 00:11:38.649 12:39:11 -- target/invalid.sh@74 -- # [[ request: 00:11:38.649 { 00:11:38.649 "nqn": "nqn.2016-06.io.spdk:cnode3324", 00:11:38.649 "min_cntlid": 0, 00:11:38.649 "method": "nvmf_create_subsystem", 00:11:38.649 "req_id": 1 00:11:38.649 } 00:11:38.649 Got JSON-RPC error response 00:11:38.649 response: 00:11:38.649 { 00:11:38.649 "code": -32602, 00:11:38.649 "message": "Invalid cntlid range [0-65519]" 00:11:38.649 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:38.649 12:39:11 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23494 -i 65520 00:11:38.906 [2024-11-20 12:39:11.910197] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23494: invalid cntlid range [65520-65519] 00:11:38.906 12:39:11 -- target/invalid.sh@75 -- # out='request: 00:11:38.906 { 00:11:38.907 "nqn": "nqn.2016-06.io.spdk:cnode23494", 00:11:38.907 "min_cntlid": 65520, 00:11:38.907 "method": "nvmf_create_subsystem", 00:11:38.907 "req_id": 1 00:11:38.907 } 00:11:38.907 Got JSON-RPC error response 00:11:38.907 response: 00:11:38.907 { 00:11:38.907 "code": -32602, 00:11:38.907 "message": "Invalid cntlid range [65520-65519]" 00:11:38.907 }' 00:11:38.907 12:39:11 -- target/invalid.sh@76 -- # [[ request: 00:11:38.907 { 00:11:38.907 "nqn": "nqn.2016-06.io.spdk:cnode23494", 00:11:38.907 "min_cntlid": 65520, 00:11:38.907 "method": "nvmf_create_subsystem", 00:11:38.907 "req_id": 1 00:11:38.907 } 00:11:38.907 Got JSON-RPC error response 00:11:38.907 response: 00:11:38.907 { 00:11:38.907 "code": -32602, 00:11:38.907 "message": "Invalid cntlid range [65520-65519]" 00:11:38.907 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:38.907 12:39:11 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10218 -I 0 00:11:39.164 [2024-11-20 12:39:12.155075] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10218: invalid cntlid range [1-0] 00:11:39.164 12:39:12 -- target/invalid.sh@77 -- # out='request: 00:11:39.164 { 00:11:39.164 "nqn": "nqn.2016-06.io.spdk:cnode10218", 00:11:39.164 "max_cntlid": 0, 00:11:39.164 "method": "nvmf_create_subsystem", 00:11:39.164 "req_id": 1 00:11:39.164 } 00:11:39.164 Got JSON-RPC error response 00:11:39.164 response: 00:11:39.164 { 00:11:39.164 "code": -32602, 00:11:39.164 "message": "Invalid cntlid range [1-0]" 00:11:39.164 }' 00:11:39.164 12:39:12 -- target/invalid.sh@78 -- # [[ request: 00:11:39.164 { 00:11:39.164 "nqn": "nqn.2016-06.io.spdk:cnode10218", 00:11:39.164 "max_cntlid": 0, 00:11:39.164 "method": "nvmf_create_subsystem", 00:11:39.164 "req_id": 1 00:11:39.164 } 00:11:39.164 Got JSON-RPC error response 00:11:39.164 response: 00:11:39.164 { 00:11:39.164 "code": -32602, 00:11:39.164 "message": "Invalid cntlid range [1-0]" 00:11:39.164 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:39.164 12:39:12 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1549 -I 65520 00:11:39.423 [2024-11-20 12:39:12.399904] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1549: invalid cntlid range [1-65520] 00:11:39.423 12:39:12 -- target/invalid.sh@79 -- # out='request: 00:11:39.423 { 00:11:39.423 "nqn": "nqn.2016-06.io.spdk:cnode1549", 00:11:39.423 "max_cntlid": 65520, 00:11:39.423 "method": "nvmf_create_subsystem", 00:11:39.423 "req_id": 1 00:11:39.423 } 00:11:39.423 Got JSON-RPC error response 00:11:39.423 response: 00:11:39.423 { 00:11:39.423 "code": -32602, 00:11:39.423 "message": "Invalid cntlid range [1-65520]" 00:11:39.423 }' 00:11:39.423 12:39:12 -- target/invalid.sh@80 -- # [[ request: 00:11:39.423 { 00:11:39.424 "nqn": "nqn.2016-06.io.spdk:cnode1549", 00:11:39.424 "max_cntlid": 65520, 00:11:39.424 "method": "nvmf_create_subsystem", 00:11:39.424 "req_id": 1 00:11:39.424 } 00:11:39.424 Got JSON-RPC error response 00:11:39.424 response: 00:11:39.424 { 00:11:39.424 "code": -32602, 00:11:39.424 "message": "Invalid cntlid range [1-65520]" 00:11:39.424 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:39.424 12:39:12 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4304 -i 6 -I 5 00:11:39.683 [2024-11-20 12:39:12.660779] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4304: invalid cntlid range [6-5] 00:11:39.683 12:39:12 -- target/invalid.sh@83 -- # out='request: 00:11:39.683 { 00:11:39.683 "nqn": "nqn.2016-06.io.spdk:cnode4304", 00:11:39.683 "min_cntlid": 6, 00:11:39.683 "max_cntlid": 5, 00:11:39.683 "method": "nvmf_create_subsystem", 00:11:39.683 "req_id": 1 00:11:39.683 } 00:11:39.683 Got JSON-RPC error response 00:11:39.683 response: 00:11:39.683 { 00:11:39.683 "code": -32602, 00:11:39.683 "message": "Invalid cntlid range [6-5]" 00:11:39.683 }' 00:11:39.683 12:39:12 -- target/invalid.sh@84 -- # [[ request: 00:11:39.683 { 00:11:39.683 "nqn": "nqn.2016-06.io.spdk:cnode4304", 00:11:39.683 "min_cntlid": 6, 00:11:39.683 "max_cntlid": 5, 00:11:39.683 "method": "nvmf_create_subsystem", 00:11:39.683 "req_id": 1 00:11:39.683 } 00:11:39.683 Got JSON-RPC error response 00:11:39.683 response: 00:11:39.683 { 00:11:39.683 "code": -32602, 00:11:39.683 "message": "Invalid cntlid range [6-5]" 00:11:39.683 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:39.683 12:39:12 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:11:39.942 12:39:12 -- target/invalid.sh@87 -- # out='request: 00:11:39.942 { 00:11:39.942 "name": "foobar", 00:11:39.942 "method": "nvmf_delete_target", 00:11:39.942 "req_id": 1 00:11:39.942 } 00:11:39.942 Got JSON-RPC error response 00:11:39.942 response: 00:11:39.942 { 00:11:39.942 "code": -32602, 00:11:39.942 "message": "The specified target doesn'\''t exist, cannot delete it." 00:11:39.942 }' 00:11:39.942 12:39:12 -- target/invalid.sh@88 -- # [[ request: 00:11:39.942 { 00:11:39.942 "name": "foobar", 00:11:39.942 "method": "nvmf_delete_target", 00:11:39.942 "req_id": 1 00:11:39.942 } 00:11:39.942 Got JSON-RPC error response 00:11:39.942 response: 00:11:39.942 { 00:11:39.942 "code": -32602, 00:11:39.942 "message": "The specified target doesn't exist, cannot delete it." 00:11:39.942 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:11:39.942 12:39:12 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:11:39.942 12:39:12 -- target/invalid.sh@91 -- # nvmftestfini 00:11:39.942 12:39:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:39.942 12:39:12 -- nvmf/common.sh@116 -- # sync 00:11:39.942 12:39:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:39.942 12:39:12 -- nvmf/common.sh@119 -- # set +e 00:11:39.942 12:39:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:39.942 12:39:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:39.942 rmmod nvme_tcp 00:11:39.942 rmmod nvme_fabrics 00:11:39.942 rmmod nvme_keyring 00:11:39.942 12:39:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:39.942 12:39:12 -- nvmf/common.sh@123 -- # set -e 00:11:39.942 12:39:12 -- nvmf/common.sh@124 -- # return 0 00:11:39.942 12:39:12 -- nvmf/common.sh@477 -- # '[' -n 3473467 ']' 00:11:39.942 12:39:12 -- nvmf/common.sh@478 -- # killprocess 3473467 00:11:39.942 12:39:12 -- common/autotest_common.sh@936 -- # '[' -z 3473467 ']' 00:11:39.942 12:39:12 -- common/autotest_common.sh@940 -- # kill -0 3473467 00:11:39.942 12:39:12 -- common/autotest_common.sh@941 -- # uname 00:11:39.942 12:39:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:39.942 12:39:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3473467 00:11:39.942 12:39:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:39.942 12:39:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:39.942 12:39:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3473467' 00:11:39.942 killing process with pid 3473467 00:11:39.942 12:39:12 -- common/autotest_common.sh@955 -- # kill 3473467 00:11:39.942 12:39:12 -- common/autotest_common.sh@960 -- # wait 3473467 00:11:40.202 12:39:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:40.202 12:39:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:40.202 12:39:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:40.202 12:39:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:40.202 12:39:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:40.202 12:39:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:40.202 12:39:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:40.202 12:39:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:42.110 12:39:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:42.110 00:11:42.110 real 0m9.507s 00:11:42.110 user 0m23.324s 00:11:42.110 sys 0m2.490s 00:11:42.110 12:39:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:42.110 12:39:15 -- common/autotest_common.sh@10 -- # set +x 00:11:42.110 ************************************ 00:11:42.110 END TEST nvmf_invalid 00:11:42.110 ************************************ 00:11:42.370 12:39:15 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:42.370 12:39:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:42.370 12:39:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:42.370 12:39:15 -- common/autotest_common.sh@10 -- # set +x 00:11:42.370 ************************************ 00:11:42.370 START TEST nvmf_abort 00:11:42.370 ************************************ 00:11:42.370 12:39:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:42.370 * Looking for test storage... 00:11:42.370 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:42.370 12:39:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:42.370 12:39:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:42.370 12:39:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:42.370 12:39:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:42.370 12:39:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:42.370 12:39:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:42.370 12:39:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:42.370 12:39:15 -- scripts/common.sh@335 -- # IFS=.-: 00:11:42.370 12:39:15 -- scripts/common.sh@335 -- # read -ra ver1 00:11:42.370 12:39:15 -- scripts/common.sh@336 -- # IFS=.-: 00:11:42.370 12:39:15 -- scripts/common.sh@336 -- # read -ra ver2 00:11:42.370 12:39:15 -- scripts/common.sh@337 -- # local 'op=<' 00:11:42.370 12:39:15 -- scripts/common.sh@339 -- # ver1_l=2 00:11:42.370 12:39:15 -- scripts/common.sh@340 -- # ver2_l=1 00:11:42.370 12:39:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:42.370 12:39:15 -- scripts/common.sh@343 -- # case "$op" in 00:11:42.370 12:39:15 -- scripts/common.sh@344 -- # : 1 00:11:42.370 12:39:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:42.370 12:39:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:42.370 12:39:15 -- scripts/common.sh@364 -- # decimal 1 00:11:42.370 12:39:15 -- scripts/common.sh@352 -- # local d=1 00:11:42.370 12:39:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:42.370 12:39:15 -- scripts/common.sh@354 -- # echo 1 00:11:42.370 12:39:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:42.370 12:39:15 -- scripts/common.sh@365 -- # decimal 2 00:11:42.370 12:39:15 -- scripts/common.sh@352 -- # local d=2 00:11:42.370 12:39:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:42.370 12:39:15 -- scripts/common.sh@354 -- # echo 2 00:11:42.370 12:39:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:42.370 12:39:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:42.370 12:39:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:42.370 12:39:15 -- scripts/common.sh@367 -- # return 0 00:11:42.370 12:39:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:42.370 12:39:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:42.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.370 --rc genhtml_branch_coverage=1 00:11:42.370 --rc genhtml_function_coverage=1 00:11:42.370 --rc genhtml_legend=1 00:11:42.370 --rc geninfo_all_blocks=1 00:11:42.370 --rc geninfo_unexecuted_blocks=1 00:11:42.370 00:11:42.370 ' 00:11:42.370 12:39:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:42.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.370 --rc genhtml_branch_coverage=1 00:11:42.370 --rc genhtml_function_coverage=1 00:11:42.370 --rc genhtml_legend=1 00:11:42.370 --rc geninfo_all_blocks=1 00:11:42.370 --rc geninfo_unexecuted_blocks=1 00:11:42.370 00:11:42.370 ' 00:11:42.370 12:39:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:42.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.370 --rc genhtml_branch_coverage=1 00:11:42.370 --rc genhtml_function_coverage=1 00:11:42.370 --rc genhtml_legend=1 00:11:42.370 --rc geninfo_all_blocks=1 00:11:42.370 --rc geninfo_unexecuted_blocks=1 00:11:42.370 00:11:42.370 ' 00:11:42.370 12:39:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:42.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.370 --rc genhtml_branch_coverage=1 00:11:42.370 --rc genhtml_function_coverage=1 00:11:42.370 --rc genhtml_legend=1 00:11:42.370 --rc geninfo_all_blocks=1 00:11:42.370 --rc geninfo_unexecuted_blocks=1 00:11:42.370 00:11:42.370 ' 00:11:42.370 12:39:15 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:42.370 12:39:15 -- nvmf/common.sh@7 -- # uname -s 00:11:42.370 12:39:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:42.370 12:39:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:42.370 12:39:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:42.370 12:39:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:42.370 12:39:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:42.370 12:39:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:42.370 12:39:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:42.370 12:39:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:42.370 12:39:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:42.370 12:39:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:42.370 12:39:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:42.370 12:39:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:42.370 12:39:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:42.370 12:39:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:42.370 12:39:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:42.370 12:39:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:42.370 12:39:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:42.370 12:39:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:42.370 12:39:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:42.371 12:39:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.371 12:39:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.371 12:39:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.371 12:39:15 -- paths/export.sh@5 -- # export PATH 00:11:42.371 12:39:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.371 12:39:15 -- nvmf/common.sh@46 -- # : 0 00:11:42.371 12:39:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:42.371 12:39:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:42.371 12:39:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:42.371 12:39:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:42.371 12:39:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:42.371 12:39:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:42.371 12:39:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:42.371 12:39:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:42.371 12:39:15 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:42.371 12:39:15 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:11:42.371 12:39:15 -- target/abort.sh@14 -- # nvmftestinit 00:11:42.371 12:39:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:42.371 12:39:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:42.371 12:39:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:42.371 12:39:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:42.371 12:39:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:42.371 12:39:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:42.371 12:39:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:42.371 12:39:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:42.371 12:39:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:42.371 12:39:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:42.371 12:39:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:42.371 12:39:15 -- common/autotest_common.sh@10 -- # set +x 00:11:44.908 12:39:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:44.908 12:39:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:44.908 12:39:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:44.908 12:39:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:44.908 12:39:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:44.908 12:39:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:44.908 12:39:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:44.908 12:39:17 -- nvmf/common.sh@294 -- # net_devs=() 00:11:44.908 12:39:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:44.908 12:39:17 -- nvmf/common.sh@295 -- # e810=() 00:11:44.908 12:39:17 -- nvmf/common.sh@295 -- # local -ga e810 00:11:44.908 12:39:17 -- nvmf/common.sh@296 -- # x722=() 00:11:44.908 12:39:17 -- nvmf/common.sh@296 -- # local -ga x722 00:11:44.908 12:39:17 -- nvmf/common.sh@297 -- # mlx=() 00:11:44.908 12:39:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:44.908 12:39:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:44.908 12:39:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:44.908 12:39:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:44.908 12:39:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:44.908 12:39:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:44.908 12:39:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:44.908 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:44.908 12:39:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:44.908 12:39:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:44.908 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:44.908 12:39:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:44.908 12:39:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:44.908 12:39:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:44.908 12:39:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:44.908 12:39:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:44.908 12:39:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:44.908 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:44.908 12:39:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:44.908 12:39:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:44.908 12:39:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:44.908 12:39:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:44.908 12:39:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:44.908 12:39:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:44.908 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:44.908 12:39:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:44.908 12:39:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:44.908 12:39:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:44.908 12:39:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:44.908 12:39:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:44.908 12:39:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:44.908 12:39:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:44.908 12:39:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:44.908 12:39:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:44.908 12:39:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:44.908 12:39:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:44.908 12:39:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:44.908 12:39:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:44.908 12:39:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:44.908 12:39:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:44.908 12:39:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:44.908 12:39:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:44.908 12:39:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:44.908 12:39:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:44.908 12:39:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:44.908 12:39:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:44.908 12:39:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:44.908 12:39:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:44.908 12:39:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:44.908 12:39:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:44.908 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:44.908 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:11:44.908 00:11:44.908 --- 10.0.0.2 ping statistics --- 00:11:44.908 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:44.908 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:11:44.908 12:39:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:44.909 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:44.909 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:11:44.909 00:11:44.909 --- 10.0.0.1 ping statistics --- 00:11:44.909 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:44.909 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:11:44.909 12:39:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:44.909 12:39:17 -- nvmf/common.sh@410 -- # return 0 00:11:44.909 12:39:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:44.909 12:39:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:44.909 12:39:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:44.909 12:39:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:44.909 12:39:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:44.909 12:39:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:44.909 12:39:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:44.909 12:39:17 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:11:44.909 12:39:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:44.909 12:39:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:44.909 12:39:17 -- common/autotest_common.sh@10 -- # set +x 00:11:44.909 12:39:17 -- nvmf/common.sh@469 -- # nvmfpid=3476355 00:11:44.909 12:39:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:44.909 12:39:17 -- nvmf/common.sh@470 -- # waitforlisten 3476355 00:11:44.909 12:39:17 -- common/autotest_common.sh@829 -- # '[' -z 3476355 ']' 00:11:44.909 12:39:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:44.909 12:39:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:44.909 12:39:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:44.909 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:44.909 12:39:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:44.909 12:39:17 -- common/autotest_common.sh@10 -- # set +x 00:11:44.909 [2024-11-20 12:39:17.649925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:44.909 [2024-11-20 12:39:17.650006] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:44.909 EAL: No free 2048 kB hugepages reported on node 1 00:11:44.909 [2024-11-20 12:39:17.723923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:44.909 [2024-11-20 12:39:17.842376] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:44.909 [2024-11-20 12:39:17.842543] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:44.909 [2024-11-20 12:39:17.842573] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:44.909 [2024-11-20 12:39:17.842589] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:44.909 [2024-11-20 12:39:17.842685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:44.909 [2024-11-20 12:39:17.842742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:44.909 [2024-11-20 12:39:17.842746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:45.848 12:39:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:45.848 12:39:18 -- common/autotest_common.sh@862 -- # return 0 00:11:45.848 12:39:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:45.848 12:39:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 12:39:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:45.848 12:39:18 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 [2024-11-20 12:39:18.684793] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 Malloc0 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 Delay0 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 [2024-11-20 12:39:18.748088] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:11:45.848 12:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.848 12:39:18 -- common/autotest_common.sh@10 -- # set +x 00:11:45.848 12:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.848 12:39:18 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:11:45.848 EAL: No free 2048 kB hugepages reported on node 1 00:11:45.848 [2024-11-20 12:39:18.803004] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:11:48.390 Initializing NVMe Controllers 00:11:48.390 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:11:48.390 controller IO queue size 128 less than required 00:11:48.390 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:11:48.390 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:11:48.390 Initialization complete. Launching workers. 00:11:48.390 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 30777 00:11:48.390 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 30838, failed to submit 62 00:11:48.390 success 30777, unsuccess 61, failed 0 00:11:48.390 12:39:20 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:48.390 12:39:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.390 12:39:20 -- common/autotest_common.sh@10 -- # set +x 00:11:48.390 12:39:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.390 12:39:20 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:11:48.390 12:39:20 -- target/abort.sh@38 -- # nvmftestfini 00:11:48.390 12:39:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:48.390 12:39:20 -- nvmf/common.sh@116 -- # sync 00:11:48.390 12:39:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:48.390 12:39:20 -- nvmf/common.sh@119 -- # set +e 00:11:48.390 12:39:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:48.390 12:39:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:48.390 rmmod nvme_tcp 00:11:48.390 rmmod nvme_fabrics 00:11:48.390 rmmod nvme_keyring 00:11:48.390 12:39:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:48.390 12:39:20 -- nvmf/common.sh@123 -- # set -e 00:11:48.390 12:39:20 -- nvmf/common.sh@124 -- # return 0 00:11:48.390 12:39:20 -- nvmf/common.sh@477 -- # '[' -n 3476355 ']' 00:11:48.390 12:39:20 -- nvmf/common.sh@478 -- # killprocess 3476355 00:11:48.390 12:39:20 -- common/autotest_common.sh@936 -- # '[' -z 3476355 ']' 00:11:48.390 12:39:20 -- common/autotest_common.sh@940 -- # kill -0 3476355 00:11:48.390 12:39:20 -- common/autotest_common.sh@941 -- # uname 00:11:48.390 12:39:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:48.390 12:39:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3476355 00:11:48.390 12:39:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:11:48.390 12:39:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:11:48.390 12:39:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3476355' 00:11:48.390 killing process with pid 3476355 00:11:48.390 12:39:20 -- common/autotest_common.sh@955 -- # kill 3476355 00:11:48.390 12:39:20 -- common/autotest_common.sh@960 -- # wait 3476355 00:11:48.390 12:39:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:48.390 12:39:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:48.390 12:39:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:48.390 12:39:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:48.390 12:39:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:48.390 12:39:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:48.390 12:39:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:48.390 12:39:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:50.297 12:39:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:50.297 00:11:50.297 real 0m8.082s 00:11:50.297 user 0m12.623s 00:11:50.297 sys 0m2.618s 00:11:50.297 12:39:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:50.297 12:39:23 -- common/autotest_common.sh@10 -- # set +x 00:11:50.297 ************************************ 00:11:50.297 END TEST nvmf_abort 00:11:50.297 ************************************ 00:11:50.297 12:39:23 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:11:50.297 12:39:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:50.297 12:39:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:50.297 12:39:23 -- common/autotest_common.sh@10 -- # set +x 00:11:50.297 ************************************ 00:11:50.297 START TEST nvmf_ns_hotplug_stress 00:11:50.297 ************************************ 00:11:50.297 12:39:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:11:50.297 * Looking for test storage... 00:11:50.297 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:50.297 12:39:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:50.297 12:39:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:50.297 12:39:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:50.558 12:39:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:50.558 12:39:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:50.558 12:39:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:50.558 12:39:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:50.558 12:39:23 -- scripts/common.sh@335 -- # IFS=.-: 00:11:50.558 12:39:23 -- scripts/common.sh@335 -- # read -ra ver1 00:11:50.558 12:39:23 -- scripts/common.sh@336 -- # IFS=.-: 00:11:50.558 12:39:23 -- scripts/common.sh@336 -- # read -ra ver2 00:11:50.558 12:39:23 -- scripts/common.sh@337 -- # local 'op=<' 00:11:50.558 12:39:23 -- scripts/common.sh@339 -- # ver1_l=2 00:11:50.558 12:39:23 -- scripts/common.sh@340 -- # ver2_l=1 00:11:50.558 12:39:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:50.558 12:39:23 -- scripts/common.sh@343 -- # case "$op" in 00:11:50.558 12:39:23 -- scripts/common.sh@344 -- # : 1 00:11:50.558 12:39:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:50.558 12:39:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:50.558 12:39:23 -- scripts/common.sh@364 -- # decimal 1 00:11:50.558 12:39:23 -- scripts/common.sh@352 -- # local d=1 00:11:50.558 12:39:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:50.558 12:39:23 -- scripts/common.sh@354 -- # echo 1 00:11:50.558 12:39:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:50.558 12:39:23 -- scripts/common.sh@365 -- # decimal 2 00:11:50.558 12:39:23 -- scripts/common.sh@352 -- # local d=2 00:11:50.558 12:39:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:50.558 12:39:23 -- scripts/common.sh@354 -- # echo 2 00:11:50.558 12:39:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:50.558 12:39:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:50.558 12:39:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:50.558 12:39:23 -- scripts/common.sh@367 -- # return 0 00:11:50.558 12:39:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:50.558 12:39:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:50.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:50.558 --rc genhtml_branch_coverage=1 00:11:50.558 --rc genhtml_function_coverage=1 00:11:50.558 --rc genhtml_legend=1 00:11:50.558 --rc geninfo_all_blocks=1 00:11:50.558 --rc geninfo_unexecuted_blocks=1 00:11:50.558 00:11:50.558 ' 00:11:50.558 12:39:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:50.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:50.558 --rc genhtml_branch_coverage=1 00:11:50.558 --rc genhtml_function_coverage=1 00:11:50.558 --rc genhtml_legend=1 00:11:50.558 --rc geninfo_all_blocks=1 00:11:50.558 --rc geninfo_unexecuted_blocks=1 00:11:50.558 00:11:50.558 ' 00:11:50.558 12:39:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:50.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:50.558 --rc genhtml_branch_coverage=1 00:11:50.558 --rc genhtml_function_coverage=1 00:11:50.558 --rc genhtml_legend=1 00:11:50.558 --rc geninfo_all_blocks=1 00:11:50.558 --rc geninfo_unexecuted_blocks=1 00:11:50.558 00:11:50.558 ' 00:11:50.558 12:39:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:50.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:50.558 --rc genhtml_branch_coverage=1 00:11:50.558 --rc genhtml_function_coverage=1 00:11:50.558 --rc genhtml_legend=1 00:11:50.558 --rc geninfo_all_blocks=1 00:11:50.558 --rc geninfo_unexecuted_blocks=1 00:11:50.558 00:11:50.558 ' 00:11:50.558 12:39:23 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:50.558 12:39:23 -- nvmf/common.sh@7 -- # uname -s 00:11:50.558 12:39:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:50.558 12:39:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:50.558 12:39:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:50.558 12:39:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:50.558 12:39:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:50.558 12:39:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:50.558 12:39:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:50.558 12:39:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:50.558 12:39:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:50.558 12:39:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:50.558 12:39:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.558 12:39:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.558 12:39:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:50.559 12:39:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:50.559 12:39:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:50.559 12:39:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:50.559 12:39:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:50.559 12:39:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:50.559 12:39:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:50.559 12:39:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.559 12:39:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.559 12:39:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.559 12:39:23 -- paths/export.sh@5 -- # export PATH 00:11:50.559 12:39:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.559 12:39:23 -- nvmf/common.sh@46 -- # : 0 00:11:50.559 12:39:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:50.559 12:39:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:50.559 12:39:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:50.559 12:39:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:50.559 12:39:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:50.559 12:39:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:50.559 12:39:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:50.559 12:39:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:50.559 12:39:23 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:50.559 12:39:23 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:11:50.559 12:39:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:50.559 12:39:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:50.559 12:39:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:50.559 12:39:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:50.559 12:39:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:50.559 12:39:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:50.559 12:39:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:50.559 12:39:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:50.559 12:39:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:50.559 12:39:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:50.559 12:39:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:50.559 12:39:23 -- common/autotest_common.sh@10 -- # set +x 00:11:52.465 12:39:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:52.465 12:39:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:52.465 12:39:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:52.465 12:39:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:52.465 12:39:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:52.465 12:39:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:52.465 12:39:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:52.465 12:39:25 -- nvmf/common.sh@294 -- # net_devs=() 00:11:52.465 12:39:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:52.465 12:39:25 -- nvmf/common.sh@295 -- # e810=() 00:11:52.465 12:39:25 -- nvmf/common.sh@295 -- # local -ga e810 00:11:52.465 12:39:25 -- nvmf/common.sh@296 -- # x722=() 00:11:52.465 12:39:25 -- nvmf/common.sh@296 -- # local -ga x722 00:11:52.465 12:39:25 -- nvmf/common.sh@297 -- # mlx=() 00:11:52.465 12:39:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:52.465 12:39:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:52.465 12:39:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:52.465 12:39:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:52.465 12:39:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:52.465 12:39:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:52.465 12:39:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:52.465 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:52.465 12:39:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:52.465 12:39:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:52.465 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:52.465 12:39:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:52.465 12:39:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:52.465 12:39:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:52.465 12:39:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:52.465 12:39:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:52.465 12:39:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:52.465 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:52.465 12:39:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:52.465 12:39:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:52.465 12:39:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:52.465 12:39:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:52.465 12:39:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:52.465 12:39:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:52.465 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:52.465 12:39:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:52.465 12:39:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:52.465 12:39:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:52.465 12:39:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:52.465 12:39:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:52.465 12:39:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:52.465 12:39:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:52.465 12:39:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:52.465 12:39:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:52.466 12:39:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:52.466 12:39:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:52.466 12:39:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:52.466 12:39:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:52.466 12:39:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:52.466 12:39:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:52.466 12:39:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:52.466 12:39:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:52.466 12:39:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:52.466 12:39:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:52.466 12:39:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:52.466 12:39:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:52.466 12:39:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:52.466 12:39:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:52.466 12:39:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:52.466 12:39:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:52.466 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:52.466 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:11:52.466 00:11:52.466 --- 10.0.0.2 ping statistics --- 00:11:52.466 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:52.466 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:11:52.466 12:39:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:52.724 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:52.724 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:11:52.724 00:11:52.724 --- 10.0.0.1 ping statistics --- 00:11:52.724 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:52.724 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:11:52.724 12:39:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:52.724 12:39:25 -- nvmf/common.sh@410 -- # return 0 00:11:52.724 12:39:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:52.724 12:39:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:52.724 12:39:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:52.724 12:39:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:52.724 12:39:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:52.724 12:39:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:52.724 12:39:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:52.724 12:39:25 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:11:52.724 12:39:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:52.724 12:39:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:52.724 12:39:25 -- common/autotest_common.sh@10 -- # set +x 00:11:52.724 12:39:25 -- nvmf/common.sh@469 -- # nvmfpid=3478733 00:11:52.724 12:39:25 -- nvmf/common.sh@470 -- # waitforlisten 3478733 00:11:52.724 12:39:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:52.724 12:39:25 -- common/autotest_common.sh@829 -- # '[' -z 3478733 ']' 00:11:52.724 12:39:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:52.724 12:39:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:52.724 12:39:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:52.724 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:52.724 12:39:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:52.724 12:39:25 -- common/autotest_common.sh@10 -- # set +x 00:11:52.724 [2024-11-20 12:39:25.638927] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:52.724 [2024-11-20 12:39:25.639007] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:52.724 EAL: No free 2048 kB hugepages reported on node 1 00:11:52.724 [2024-11-20 12:39:25.707993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:52.724 [2024-11-20 12:39:25.825997] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:52.724 [2024-11-20 12:39:25.826181] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:52.724 [2024-11-20 12:39:25.826202] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:52.724 [2024-11-20 12:39:25.826216] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:52.724 [2024-11-20 12:39:25.826301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:52.724 [2024-11-20 12:39:25.826357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:52.724 [2024-11-20 12:39:25.826361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:53.659 12:39:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:53.659 12:39:26 -- common/autotest_common.sh@862 -- # return 0 00:11:53.659 12:39:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:53.659 12:39:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:53.659 12:39:26 -- common/autotest_common.sh@10 -- # set +x 00:11:53.659 12:39:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:53.659 12:39:26 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:11:53.659 12:39:26 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:53.917 [2024-11-20 12:39:26.900988] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:53.917 12:39:26 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:54.175 12:39:27 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:54.433 [2024-11-20 12:39:27.411934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:54.433 12:39:27 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:11:54.691 12:39:27 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:11:54.949 Malloc0 00:11:54.949 12:39:27 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:55.207 Delay0 00:11:55.207 12:39:28 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:55.466 12:39:28 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:11:55.723 NULL1 00:11:55.723 12:39:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:11:55.982 12:39:28 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3479172 00:11:55.982 12:39:28 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:11:55.982 12:39:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:11:55.982 12:39:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:55.982 EAL: No free 2048 kB hugepages reported on node 1 00:11:57.360 Read completed with error (sct=0, sc=11) 00:11:57.360 12:39:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:57.360 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.360 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.360 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.360 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.360 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.360 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.360 12:39:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:11:57.360 12:39:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:11:57.619 true 00:11:57.619 12:39:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:11:57.619 12:39:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:58.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.556 12:39:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:58.817 12:39:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:11:58.817 12:39:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:11:58.817 true 00:11:59.076 12:39:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:11:59.076 12:39:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:59.076 12:39:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:59.335 12:39:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:11:59.335 12:39:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:11:59.593 true 00:11:59.593 12:39:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:11:59.593 12:39:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:00.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.532 12:39:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:00.790 12:39:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:00.790 12:39:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:01.048 true 00:12:01.048 12:39:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:01.048 12:39:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:01.306 12:39:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:01.564 12:39:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:01.564 12:39:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:01.822 true 00:12:01.822 12:39:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:01.822 12:39:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.755 12:39:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:03.014 12:39:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:03.014 12:39:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:03.323 true 00:12:03.323 12:39:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:03.323 12:39:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:03.601 12:39:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:03.861 12:39:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:03.861 12:39:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:03.861 true 00:12:04.119 12:39:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:04.119 12:39:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:05.055 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:05.055 12:39:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:05.055 12:39:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:05.055 12:39:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:05.314 true 00:12:05.314 12:39:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:05.314 12:39:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:05.572 12:39:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:05.830 12:39:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:05.830 12:39:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:06.088 true 00:12:06.088 12:39:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:06.088 12:39:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:07.026 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:07.026 12:39:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:07.285 12:39:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:07.285 12:39:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:07.544 true 00:12:07.544 12:39:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:07.544 12:39:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:07.801 12:39:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:08.061 12:39:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:08.061 12:39:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:08.061 true 00:12:08.321 12:39:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:08.321 12:39:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.321 12:39:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:08.579 12:39:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:08.579 12:39:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:08.839 true 00:12:09.099 12:39:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:09.099 12:39:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.038 12:39:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:10.295 12:39:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:10.295 12:39:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:10.553 true 00:12:10.553 12:39:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:10.553 12:39:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.811 12:39:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:11.069 12:39:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:11.069 12:39:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:11.327 true 00:12:11.327 12:39:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:11.327 12:39:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:11.585 12:39:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:11.843 12:39:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:11.843 12:39:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:12.101 true 00:12:12.101 12:39:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:12.101 12:39:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.039 12:39:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:13.039 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:13.297 12:39:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:13.297 12:39:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:13.562 true 00:12:13.562 12:39:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:13.562 12:39:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.823 12:39:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.081 12:39:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:14.081 12:39:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:14.338 true 00:12:14.338 12:39:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:14.338 12:39:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:14.596 12:39:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.854 12:39:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:14.854 12:39:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:15.113 true 00:12:15.113 12:39:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:15.113 12:39:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.046 12:39:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:16.308 12:39:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:16.308 12:39:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:16.566 true 00:12:16.566 12:39:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:16.566 12:39:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.824 12:39:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:17.083 12:39:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:17.083 12:39:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:17.341 true 00:12:17.341 12:39:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:17.341 12:39:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.277 12:39:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.277 12:39:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:18.277 12:39:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:18.536 true 00:12:18.536 12:39:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:18.536 12:39:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.794 12:39:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:19.052 12:39:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:19.052 12:39:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:19.309 true 00:12:19.309 12:39:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:19.309 12:39:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.567 12:39:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:19.825 12:39:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:19.825 12:39:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:20.083 true 00:12:20.083 12:39:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:20.083 12:39:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.022 12:39:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:21.280 12:39:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:21.280 12:39:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:21.537 true 00:12:21.537 12:39:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:21.537 12:39:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.794 12:39:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:22.052 12:39:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:22.052 12:39:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:22.310 true 00:12:22.310 12:39:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:22.310 12:39:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:23.246 12:39:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.246 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:23.504 12:39:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:23.504 12:39:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:23.762 true 00:12:23.762 12:39:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:23.762 12:39:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.020 12:39:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:24.278 12:39:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:24.278 12:39:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:24.536 true 00:12:24.536 12:39:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:24.536 12:39:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:25.471 12:39:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:25.729 12:39:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:25.729 12:39:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:25.986 true 00:12:25.986 12:39:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:25.986 12:39:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.245 12:39:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.245 Initializing NVMe Controllers 00:12:26.245 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:26.245 Controller IO queue size 128, less than required. 00:12:26.245 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:26.245 Controller IO queue size 128, less than required. 00:12:26.245 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:26.245 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:26.245 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:26.245 Initialization complete. Launching workers. 00:12:26.245 ======================================================== 00:12:26.245 Latency(us) 00:12:26.245 Device Information : IOPS MiB/s Average min max 00:12:26.245 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 536.48 0.26 114055.42 3113.43 1032345.07 00:12:26.245 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11031.14 5.39 11604.47 1639.84 456378.48 00:12:26.245 ======================================================== 00:12:26.245 Total : 11567.62 5.65 16355.93 1639.84 1032345.07 00:12:26.245 00:12:26.503 12:39:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:26.503 12:39:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:26.761 true 00:12:26.761 12:39:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3479172 00:12:26.761 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3479172) - No such process 00:12:26.761 12:39:59 -- target/ns_hotplug_stress.sh@53 -- # wait 3479172 00:12:26.761 12:39:59 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.019 12:39:59 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:27.277 12:40:00 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:27.277 12:40:00 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:27.277 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:27.277 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:27.277 12:40:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:27.575 null0 00:12:27.575 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:27.575 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:27.575 12:40:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:27.575 null1 00:12:27.575 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:27.575 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:27.575 12:40:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:27.848 null2 00:12:27.848 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:27.848 12:40:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:27.848 12:40:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:28.106 null3 00:12:28.106 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:28.106 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:28.106 12:40:01 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:28.364 null4 00:12:28.364 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:28.364 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:28.364 12:40:01 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:28.622 null5 00:12:28.622 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:28.622 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:28.622 12:40:01 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:28.880 null6 00:12:28.880 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:28.880 12:40:01 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:28.880 12:40:01 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:29.138 null7 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.138 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@66 -- # wait 3483335 3483336 3483338 3483340 3483342 3483344 3483346 3483348 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.139 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:29.397 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.656 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:29.916 12:40:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:30.174 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.432 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.690 12:40:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.948 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:30.949 12:40:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:31.207 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:31.465 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.465 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:31.466 12:40:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:31.724 12:40:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:31.983 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.242 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:32.501 12:40:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:32.760 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:32.760 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:32.760 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:32.760 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:33.018 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:33.018 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.018 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:33.019 12:40:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.277 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:33.535 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:33.793 12:40:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:34.051 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:34.051 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:34.051 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:34.051 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:34.051 12:40:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:34.051 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.051 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:34.051 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.308 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.309 12:40:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.566 12:40:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:34.823 12:40:07 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:12:34.823 12:40:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:34.823 12:40:07 -- nvmf/common.sh@116 -- # sync 00:12:34.823 12:40:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:34.823 12:40:07 -- nvmf/common.sh@119 -- # set +e 00:12:34.823 12:40:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:34.823 12:40:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:34.823 rmmod nvme_tcp 00:12:34.823 rmmod nvme_fabrics 00:12:34.823 rmmod nvme_keyring 00:12:34.823 12:40:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:34.823 12:40:07 -- nvmf/common.sh@123 -- # set -e 00:12:34.823 12:40:07 -- nvmf/common.sh@124 -- # return 0 00:12:34.823 12:40:07 -- nvmf/common.sh@477 -- # '[' -n 3478733 ']' 00:12:34.823 12:40:07 -- nvmf/common.sh@478 -- # killprocess 3478733 00:12:34.823 12:40:07 -- common/autotest_common.sh@936 -- # '[' -z 3478733 ']' 00:12:34.823 12:40:07 -- common/autotest_common.sh@940 -- # kill -0 3478733 00:12:34.823 12:40:07 -- common/autotest_common.sh@941 -- # uname 00:12:34.823 12:40:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:34.823 12:40:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3478733 00:12:35.081 12:40:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:35.081 12:40:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:35.081 12:40:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3478733' 00:12:35.081 killing process with pid 3478733 00:12:35.081 12:40:07 -- common/autotest_common.sh@955 -- # kill 3478733 00:12:35.081 12:40:07 -- common/autotest_common.sh@960 -- # wait 3478733 00:12:35.339 12:40:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:35.339 12:40:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:35.339 12:40:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:35.339 12:40:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:35.339 12:40:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:35.339 12:40:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.339 12:40:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:35.339 12:40:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.245 12:40:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:37.245 00:12:37.245 real 0m46.920s 00:12:37.245 user 3m34.622s 00:12:37.245 sys 0m15.286s 00:12:37.245 12:40:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:37.245 12:40:10 -- common/autotest_common.sh@10 -- # set +x 00:12:37.245 ************************************ 00:12:37.245 END TEST nvmf_ns_hotplug_stress 00:12:37.245 ************************************ 00:12:37.245 12:40:10 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:37.245 12:40:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:37.245 12:40:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:37.245 12:40:10 -- common/autotest_common.sh@10 -- # set +x 00:12:37.245 ************************************ 00:12:37.245 START TEST nvmf_connect_stress 00:12:37.245 ************************************ 00:12:37.245 12:40:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:37.245 * Looking for test storage... 00:12:37.245 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:37.245 12:40:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:37.245 12:40:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:37.245 12:40:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:37.504 12:40:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:37.504 12:40:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:37.504 12:40:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:37.504 12:40:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:37.504 12:40:10 -- scripts/common.sh@335 -- # IFS=.-: 00:12:37.504 12:40:10 -- scripts/common.sh@335 -- # read -ra ver1 00:12:37.504 12:40:10 -- scripts/common.sh@336 -- # IFS=.-: 00:12:37.504 12:40:10 -- scripts/common.sh@336 -- # read -ra ver2 00:12:37.504 12:40:10 -- scripts/common.sh@337 -- # local 'op=<' 00:12:37.504 12:40:10 -- scripts/common.sh@339 -- # ver1_l=2 00:12:37.504 12:40:10 -- scripts/common.sh@340 -- # ver2_l=1 00:12:37.504 12:40:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:37.504 12:40:10 -- scripts/common.sh@343 -- # case "$op" in 00:12:37.504 12:40:10 -- scripts/common.sh@344 -- # : 1 00:12:37.504 12:40:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:37.504 12:40:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:37.504 12:40:10 -- scripts/common.sh@364 -- # decimal 1 00:12:37.504 12:40:10 -- scripts/common.sh@352 -- # local d=1 00:12:37.504 12:40:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:37.504 12:40:10 -- scripts/common.sh@354 -- # echo 1 00:12:37.504 12:40:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:37.504 12:40:10 -- scripts/common.sh@365 -- # decimal 2 00:12:37.504 12:40:10 -- scripts/common.sh@352 -- # local d=2 00:12:37.504 12:40:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:37.504 12:40:10 -- scripts/common.sh@354 -- # echo 2 00:12:37.504 12:40:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:37.504 12:40:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:37.504 12:40:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:37.504 12:40:10 -- scripts/common.sh@367 -- # return 0 00:12:37.504 12:40:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:37.504 12:40:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:37.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.504 --rc genhtml_branch_coverage=1 00:12:37.504 --rc genhtml_function_coverage=1 00:12:37.504 --rc genhtml_legend=1 00:12:37.504 --rc geninfo_all_blocks=1 00:12:37.504 --rc geninfo_unexecuted_blocks=1 00:12:37.504 00:12:37.504 ' 00:12:37.504 12:40:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:37.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.504 --rc genhtml_branch_coverage=1 00:12:37.504 --rc genhtml_function_coverage=1 00:12:37.504 --rc genhtml_legend=1 00:12:37.504 --rc geninfo_all_blocks=1 00:12:37.504 --rc geninfo_unexecuted_blocks=1 00:12:37.504 00:12:37.504 ' 00:12:37.504 12:40:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:37.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.504 --rc genhtml_branch_coverage=1 00:12:37.504 --rc genhtml_function_coverage=1 00:12:37.504 --rc genhtml_legend=1 00:12:37.504 --rc geninfo_all_blocks=1 00:12:37.504 --rc geninfo_unexecuted_blocks=1 00:12:37.504 00:12:37.504 ' 00:12:37.504 12:40:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:37.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:37.504 --rc genhtml_branch_coverage=1 00:12:37.504 --rc genhtml_function_coverage=1 00:12:37.504 --rc genhtml_legend=1 00:12:37.504 --rc geninfo_all_blocks=1 00:12:37.505 --rc geninfo_unexecuted_blocks=1 00:12:37.505 00:12:37.505 ' 00:12:37.505 12:40:10 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:37.505 12:40:10 -- nvmf/common.sh@7 -- # uname -s 00:12:37.505 12:40:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:37.505 12:40:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:37.505 12:40:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:37.505 12:40:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:37.505 12:40:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:37.505 12:40:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:37.505 12:40:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:37.505 12:40:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:37.505 12:40:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:37.505 12:40:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:37.505 12:40:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.505 12:40:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.505 12:40:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:37.505 12:40:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:37.505 12:40:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:37.505 12:40:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:37.505 12:40:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:37.505 12:40:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:37.505 12:40:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:37.505 12:40:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.505 12:40:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.505 12:40:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.505 12:40:10 -- paths/export.sh@5 -- # export PATH 00:12:37.505 12:40:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.505 12:40:10 -- nvmf/common.sh@46 -- # : 0 00:12:37.505 12:40:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:37.505 12:40:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:37.505 12:40:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:37.505 12:40:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:37.505 12:40:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:37.505 12:40:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:37.505 12:40:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:37.505 12:40:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:37.505 12:40:10 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:37.505 12:40:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:37.505 12:40:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:37.505 12:40:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:37.505 12:40:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:37.505 12:40:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:37.505 12:40:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.505 12:40:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.505 12:40:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.505 12:40:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:37.505 12:40:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:37.505 12:40:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:37.505 12:40:10 -- common/autotest_common.sh@10 -- # set +x 00:12:39.411 12:40:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:39.411 12:40:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:39.411 12:40:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:39.411 12:40:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:39.411 12:40:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:39.411 12:40:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:39.411 12:40:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:39.411 12:40:12 -- nvmf/common.sh@294 -- # net_devs=() 00:12:39.411 12:40:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:39.411 12:40:12 -- nvmf/common.sh@295 -- # e810=() 00:12:39.411 12:40:12 -- nvmf/common.sh@295 -- # local -ga e810 00:12:39.411 12:40:12 -- nvmf/common.sh@296 -- # x722=() 00:12:39.411 12:40:12 -- nvmf/common.sh@296 -- # local -ga x722 00:12:39.411 12:40:12 -- nvmf/common.sh@297 -- # mlx=() 00:12:39.411 12:40:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:39.411 12:40:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:39.411 12:40:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:39.411 12:40:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:39.411 12:40:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:39.411 12:40:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:39.411 12:40:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:39.411 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:39.411 12:40:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:39.411 12:40:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:39.411 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:39.411 12:40:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:39.411 12:40:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:39.411 12:40:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:39.411 12:40:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:39.411 12:40:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:39.411 12:40:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:39.411 12:40:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:39.411 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:39.411 12:40:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:39.411 12:40:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:39.411 12:40:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:39.411 12:40:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:39.411 12:40:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:39.412 12:40:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:39.412 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:39.412 12:40:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:39.412 12:40:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:39.412 12:40:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:39.412 12:40:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:39.412 12:40:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:39.412 12:40:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:39.412 12:40:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:39.412 12:40:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:39.412 12:40:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:39.412 12:40:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:39.412 12:40:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:39.412 12:40:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:39.412 12:40:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:39.412 12:40:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:39.412 12:40:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:39.412 12:40:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:39.412 12:40:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:39.412 12:40:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:39.412 12:40:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:39.412 12:40:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:39.412 12:40:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:39.412 12:40:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:39.412 12:40:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:39.412 12:40:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:39.412 12:40:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:39.412 12:40:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:39.412 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:39.412 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:12:39.412 00:12:39.412 --- 10.0.0.2 ping statistics --- 00:12:39.412 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:39.412 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:12:39.412 12:40:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:39.412 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:39.412 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:12:39.412 00:12:39.412 --- 10.0.0.1 ping statistics --- 00:12:39.412 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:39.412 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:12:39.412 12:40:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:39.412 12:40:12 -- nvmf/common.sh@410 -- # return 0 00:12:39.412 12:40:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:39.412 12:40:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:39.412 12:40:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:39.412 12:40:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:39.412 12:40:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:39.412 12:40:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:39.412 12:40:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:39.412 12:40:12 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:39.412 12:40:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:39.412 12:40:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:39.412 12:40:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.412 12:40:12 -- nvmf/common.sh@469 -- # nvmfpid=3486133 00:12:39.412 12:40:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:39.412 12:40:12 -- nvmf/common.sh@470 -- # waitforlisten 3486133 00:12:39.412 12:40:12 -- common/autotest_common.sh@829 -- # '[' -z 3486133 ']' 00:12:39.412 12:40:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:39.412 12:40:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:39.412 12:40:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:39.412 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:39.412 12:40:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:39.412 12:40:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.412 [2024-11-20 12:40:12.514758] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:39.412 [2024-11-20 12:40:12.514821] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:39.670 EAL: No free 2048 kB hugepages reported on node 1 00:12:39.670 [2024-11-20 12:40:12.581265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:39.670 [2024-11-20 12:40:12.690385] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:39.670 [2024-11-20 12:40:12.690587] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:39.670 [2024-11-20 12:40:12.690607] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:39.670 [2024-11-20 12:40:12.690620] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:39.670 [2024-11-20 12:40:12.690701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:39.670 [2024-11-20 12:40:12.690757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:39.670 [2024-11-20 12:40:12.690759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:40.604 12:40:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:40.604 12:40:13 -- common/autotest_common.sh@862 -- # return 0 00:12:40.604 12:40:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:40.604 12:40:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:40.604 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:40.604 12:40:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:40.604 12:40:13 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:40.604 12:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.604 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:40.604 [2024-11-20 12:40:13.522458] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:40.604 12:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.604 12:40:13 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:40.604 12:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.604 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:40.604 12:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.604 12:40:13 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:40.604 12:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.604 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:40.604 [2024-11-20 12:40:13.560219] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:40.604 12:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.604 12:40:13 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:40.604 12:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.604 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:40.604 NULL1 00:12:40.604 12:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.604 12:40:13 -- target/connect_stress.sh@21 -- # PERF_PID=3486291 00:12:40.604 12:40:13 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:40.604 12:40:13 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:40.604 12:40:13 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.604 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.604 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 EAL: No free 2048 kB hugepages reported on node 1 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:40.605 12:40:13 -- target/connect_stress.sh@28 -- # cat 00:12:40.605 12:40:13 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:40.605 12:40:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:40.605 12:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.605 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:40.862 12:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.862 12:40:13 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:40.862 12:40:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:40.862 12:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.862 12:40:13 -- common/autotest_common.sh@10 -- # set +x 00:12:41.428 12:40:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:41.428 12:40:14 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:41.428 12:40:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:41.428 12:40:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:41.428 12:40:14 -- common/autotest_common.sh@10 -- # set +x 00:12:41.685 12:40:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:41.685 12:40:14 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:41.685 12:40:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:41.685 12:40:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:41.685 12:40:14 -- common/autotest_common.sh@10 -- # set +x 00:12:41.942 12:40:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:41.943 12:40:14 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:41.943 12:40:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:41.943 12:40:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:41.943 12:40:14 -- common/autotest_common.sh@10 -- # set +x 00:12:42.200 12:40:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.200 12:40:15 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:42.200 12:40:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:42.200 12:40:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.200 12:40:15 -- common/autotest_common.sh@10 -- # set +x 00:12:42.458 12:40:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.458 12:40:15 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:42.458 12:40:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:42.458 12:40:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.458 12:40:15 -- common/autotest_common.sh@10 -- # set +x 00:12:43.025 12:40:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.025 12:40:15 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:43.025 12:40:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:43.025 12:40:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.025 12:40:15 -- common/autotest_common.sh@10 -- # set +x 00:12:43.282 12:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.282 12:40:16 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:43.282 12:40:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:43.282 12:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.282 12:40:16 -- common/autotest_common.sh@10 -- # set +x 00:12:43.540 12:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.540 12:40:16 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:43.540 12:40:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:43.540 12:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.540 12:40:16 -- common/autotest_common.sh@10 -- # set +x 00:12:43.797 12:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.797 12:40:16 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:43.797 12:40:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:43.797 12:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.797 12:40:16 -- common/autotest_common.sh@10 -- # set +x 00:12:44.055 12:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:44.055 12:40:17 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:44.055 12:40:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:44.055 12:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:44.055 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:12:44.620 12:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:44.620 12:40:17 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:44.620 12:40:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:44.620 12:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:44.620 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:12:44.879 12:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:44.879 12:40:17 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:44.879 12:40:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:44.879 12:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:44.879 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:12:45.137 12:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.137 12:40:18 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:45.137 12:40:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:45.137 12:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.137 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:12:45.394 12:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.394 12:40:18 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:45.394 12:40:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:45.394 12:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.394 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:12:45.652 12:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.652 12:40:18 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:45.652 12:40:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:45.652 12:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.652 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:12:46.217 12:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.217 12:40:19 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:46.217 12:40:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:46.217 12:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.217 12:40:19 -- common/autotest_common.sh@10 -- # set +x 00:12:46.474 12:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.474 12:40:19 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:46.474 12:40:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:46.474 12:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.474 12:40:19 -- common/autotest_common.sh@10 -- # set +x 00:12:46.732 12:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.732 12:40:19 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:46.732 12:40:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:46.732 12:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.732 12:40:19 -- common/autotest_common.sh@10 -- # set +x 00:12:46.990 12:40:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.990 12:40:20 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:46.990 12:40:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:46.990 12:40:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.990 12:40:20 -- common/autotest_common.sh@10 -- # set +x 00:12:47.554 12:40:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.554 12:40:20 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:47.554 12:40:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:47.554 12:40:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.554 12:40:20 -- common/autotest_common.sh@10 -- # set +x 00:12:47.812 12:40:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.812 12:40:20 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:47.812 12:40:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:47.812 12:40:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.812 12:40:20 -- common/autotest_common.sh@10 -- # set +x 00:12:48.069 12:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.069 12:40:21 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:48.069 12:40:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:48.069 12:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.069 12:40:21 -- common/autotest_common.sh@10 -- # set +x 00:12:48.327 12:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.327 12:40:21 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:48.327 12:40:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:48.327 12:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.327 12:40:21 -- common/autotest_common.sh@10 -- # set +x 00:12:48.584 12:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.584 12:40:21 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:48.584 12:40:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:48.584 12:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.584 12:40:21 -- common/autotest_common.sh@10 -- # set +x 00:12:49.149 12:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:49.149 12:40:21 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:49.149 12:40:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:49.149 12:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:49.149 12:40:21 -- common/autotest_common.sh@10 -- # set +x 00:12:49.406 12:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:49.406 12:40:22 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:49.406 12:40:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:49.406 12:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:49.406 12:40:22 -- common/autotest_common.sh@10 -- # set +x 00:12:49.664 12:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:49.664 12:40:22 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:49.664 12:40:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:49.664 12:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:49.664 12:40:22 -- common/autotest_common.sh@10 -- # set +x 00:12:49.922 12:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:49.922 12:40:22 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:49.922 12:40:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:49.922 12:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:49.922 12:40:22 -- common/autotest_common.sh@10 -- # set +x 00:12:50.180 12:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:50.180 12:40:23 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:50.180 12:40:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:50.180 12:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.180 12:40:23 -- common/autotest_common.sh@10 -- # set +x 00:12:50.745 12:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:50.745 12:40:23 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:50.745 12:40:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:50.745 12:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.745 12:40:23 -- common/autotest_common.sh@10 -- # set +x 00:12:50.745 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:51.003 12:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.003 12:40:23 -- target/connect_stress.sh@34 -- # kill -0 3486291 00:12:51.003 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3486291) - No such process 00:12:51.003 12:40:23 -- target/connect_stress.sh@38 -- # wait 3486291 00:12:51.003 12:40:23 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:51.003 12:40:23 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:12:51.003 12:40:23 -- target/connect_stress.sh@43 -- # nvmftestfini 00:12:51.003 12:40:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:51.003 12:40:23 -- nvmf/common.sh@116 -- # sync 00:12:51.003 12:40:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:51.003 12:40:23 -- nvmf/common.sh@119 -- # set +e 00:12:51.003 12:40:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:51.003 12:40:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:51.003 rmmod nvme_tcp 00:12:51.003 rmmod nvme_fabrics 00:12:51.003 rmmod nvme_keyring 00:12:51.003 12:40:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:51.003 12:40:23 -- nvmf/common.sh@123 -- # set -e 00:12:51.003 12:40:23 -- nvmf/common.sh@124 -- # return 0 00:12:51.003 12:40:23 -- nvmf/common.sh@477 -- # '[' -n 3486133 ']' 00:12:51.003 12:40:23 -- nvmf/common.sh@478 -- # killprocess 3486133 00:12:51.003 12:40:23 -- common/autotest_common.sh@936 -- # '[' -z 3486133 ']' 00:12:51.003 12:40:23 -- common/autotest_common.sh@940 -- # kill -0 3486133 00:12:51.003 12:40:23 -- common/autotest_common.sh@941 -- # uname 00:12:51.003 12:40:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:51.003 12:40:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3486133 00:12:51.003 12:40:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:51.003 12:40:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:51.003 12:40:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3486133' 00:12:51.003 killing process with pid 3486133 00:12:51.003 12:40:24 -- common/autotest_common.sh@955 -- # kill 3486133 00:12:51.003 12:40:24 -- common/autotest_common.sh@960 -- # wait 3486133 00:12:51.262 12:40:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:51.262 12:40:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:51.262 12:40:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:51.262 12:40:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:51.262 12:40:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:51.262 12:40:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:51.262 12:40:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:51.262 12:40:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.229 12:40:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:53.229 00:12:53.229 real 0m16.053s 00:12:53.229 user 0m40.806s 00:12:53.229 sys 0m5.804s 00:12:53.229 12:40:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:53.229 12:40:26 -- common/autotest_common.sh@10 -- # set +x 00:12:53.229 ************************************ 00:12:53.229 END TEST nvmf_connect_stress 00:12:53.229 ************************************ 00:12:53.488 12:40:26 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:12:53.488 12:40:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:53.488 12:40:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:53.488 12:40:26 -- common/autotest_common.sh@10 -- # set +x 00:12:53.488 ************************************ 00:12:53.488 START TEST nvmf_fused_ordering 00:12:53.488 ************************************ 00:12:53.488 12:40:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:12:53.488 * Looking for test storage... 00:12:53.488 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:53.488 12:40:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:53.488 12:40:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:53.488 12:40:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:53.488 12:40:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:53.488 12:40:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:53.488 12:40:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:53.488 12:40:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:53.488 12:40:26 -- scripts/common.sh@335 -- # IFS=.-: 00:12:53.488 12:40:26 -- scripts/common.sh@335 -- # read -ra ver1 00:12:53.488 12:40:26 -- scripts/common.sh@336 -- # IFS=.-: 00:12:53.488 12:40:26 -- scripts/common.sh@336 -- # read -ra ver2 00:12:53.488 12:40:26 -- scripts/common.sh@337 -- # local 'op=<' 00:12:53.488 12:40:26 -- scripts/common.sh@339 -- # ver1_l=2 00:12:53.488 12:40:26 -- scripts/common.sh@340 -- # ver2_l=1 00:12:53.488 12:40:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:53.488 12:40:26 -- scripts/common.sh@343 -- # case "$op" in 00:12:53.488 12:40:26 -- scripts/common.sh@344 -- # : 1 00:12:53.488 12:40:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:53.488 12:40:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:53.488 12:40:26 -- scripts/common.sh@364 -- # decimal 1 00:12:53.488 12:40:26 -- scripts/common.sh@352 -- # local d=1 00:12:53.488 12:40:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:53.488 12:40:26 -- scripts/common.sh@354 -- # echo 1 00:12:53.488 12:40:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:53.488 12:40:26 -- scripts/common.sh@365 -- # decimal 2 00:12:53.488 12:40:26 -- scripts/common.sh@352 -- # local d=2 00:12:53.488 12:40:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:53.488 12:40:26 -- scripts/common.sh@354 -- # echo 2 00:12:53.488 12:40:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:53.488 12:40:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:53.488 12:40:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:53.488 12:40:26 -- scripts/common.sh@367 -- # return 0 00:12:53.488 12:40:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:53.488 12:40:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:53.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.488 --rc genhtml_branch_coverage=1 00:12:53.488 --rc genhtml_function_coverage=1 00:12:53.488 --rc genhtml_legend=1 00:12:53.488 --rc geninfo_all_blocks=1 00:12:53.488 --rc geninfo_unexecuted_blocks=1 00:12:53.488 00:12:53.488 ' 00:12:53.488 12:40:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:53.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.488 --rc genhtml_branch_coverage=1 00:12:53.488 --rc genhtml_function_coverage=1 00:12:53.488 --rc genhtml_legend=1 00:12:53.488 --rc geninfo_all_blocks=1 00:12:53.488 --rc geninfo_unexecuted_blocks=1 00:12:53.488 00:12:53.488 ' 00:12:53.488 12:40:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:53.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.488 --rc genhtml_branch_coverage=1 00:12:53.488 --rc genhtml_function_coverage=1 00:12:53.488 --rc genhtml_legend=1 00:12:53.488 --rc geninfo_all_blocks=1 00:12:53.488 --rc geninfo_unexecuted_blocks=1 00:12:53.488 00:12:53.488 ' 00:12:53.488 12:40:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:53.488 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.488 --rc genhtml_branch_coverage=1 00:12:53.488 --rc genhtml_function_coverage=1 00:12:53.488 --rc genhtml_legend=1 00:12:53.488 --rc geninfo_all_blocks=1 00:12:53.488 --rc geninfo_unexecuted_blocks=1 00:12:53.488 00:12:53.488 ' 00:12:53.488 12:40:26 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:53.488 12:40:26 -- nvmf/common.sh@7 -- # uname -s 00:12:53.488 12:40:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:53.488 12:40:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:53.488 12:40:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:53.488 12:40:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:53.488 12:40:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:53.488 12:40:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:53.488 12:40:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:53.488 12:40:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:53.488 12:40:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:53.488 12:40:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:53.488 12:40:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.488 12:40:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.488 12:40:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:53.488 12:40:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:53.488 12:40:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:53.488 12:40:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:53.488 12:40:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:53.488 12:40:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:53.488 12:40:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:53.488 12:40:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.488 12:40:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.488 12:40:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.488 12:40:26 -- paths/export.sh@5 -- # export PATH 00:12:53.488 12:40:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.488 12:40:26 -- nvmf/common.sh@46 -- # : 0 00:12:53.488 12:40:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:53.488 12:40:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:53.488 12:40:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:53.488 12:40:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:53.488 12:40:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:53.488 12:40:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:53.488 12:40:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:53.488 12:40:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:53.488 12:40:26 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:12:53.488 12:40:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:53.488 12:40:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:53.488 12:40:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:53.488 12:40:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:53.488 12:40:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:53.488 12:40:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.488 12:40:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.488 12:40:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.488 12:40:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:53.488 12:40:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:53.488 12:40:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:53.488 12:40:26 -- common/autotest_common.sh@10 -- # set +x 00:12:56.022 12:40:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:56.022 12:40:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:56.022 12:40:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:56.022 12:40:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:56.022 12:40:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:56.022 12:40:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:56.022 12:40:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:56.022 12:40:28 -- nvmf/common.sh@294 -- # net_devs=() 00:12:56.022 12:40:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:56.022 12:40:28 -- nvmf/common.sh@295 -- # e810=() 00:12:56.022 12:40:28 -- nvmf/common.sh@295 -- # local -ga e810 00:12:56.022 12:40:28 -- nvmf/common.sh@296 -- # x722=() 00:12:56.022 12:40:28 -- nvmf/common.sh@296 -- # local -ga x722 00:12:56.022 12:40:28 -- nvmf/common.sh@297 -- # mlx=() 00:12:56.022 12:40:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:56.022 12:40:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:56.022 12:40:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:56.022 12:40:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:56.022 12:40:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:56.022 12:40:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:56.022 12:40:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:56.022 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:56.022 12:40:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:56.022 12:40:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:56.022 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:56.022 12:40:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:56.022 12:40:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:56.022 12:40:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:56.022 12:40:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:56.022 12:40:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:56.022 12:40:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:56.022 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:56.022 12:40:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:56.022 12:40:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:56.022 12:40:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:56.022 12:40:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:56.022 12:40:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:56.022 12:40:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:56.022 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:56.022 12:40:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:56.022 12:40:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:56.022 12:40:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:56.022 12:40:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:56.022 12:40:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:56.022 12:40:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:56.022 12:40:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:56.022 12:40:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:56.022 12:40:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:56.022 12:40:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:56.022 12:40:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:56.022 12:40:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:56.022 12:40:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:56.022 12:40:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:56.022 12:40:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:56.022 12:40:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:56.022 12:40:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:56.022 12:40:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:56.022 12:40:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:56.022 12:40:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:56.022 12:40:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:56.022 12:40:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:56.022 12:40:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:56.022 12:40:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:56.022 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:56.022 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.157 ms 00:12:56.022 00:12:56.022 --- 10.0.0.2 ping statistics --- 00:12:56.022 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:56.022 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:12:56.022 12:40:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:56.022 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:56.022 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:12:56.022 00:12:56.022 --- 10.0.0.1 ping statistics --- 00:12:56.022 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:56.022 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:12:56.022 12:40:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:56.022 12:40:28 -- nvmf/common.sh@410 -- # return 0 00:12:56.022 12:40:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:56.022 12:40:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:56.022 12:40:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:56.022 12:40:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:56.022 12:40:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:56.022 12:40:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:56.022 12:40:28 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:12:56.022 12:40:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:56.022 12:40:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:56.022 12:40:28 -- common/autotest_common.sh@10 -- # set +x 00:12:56.022 12:40:28 -- nvmf/common.sh@469 -- # nvmfpid=3489496 00:12:56.022 12:40:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:56.022 12:40:28 -- nvmf/common.sh@470 -- # waitforlisten 3489496 00:12:56.022 12:40:28 -- common/autotest_common.sh@829 -- # '[' -z 3489496 ']' 00:12:56.022 12:40:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:56.022 12:40:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:56.022 12:40:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:56.022 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:56.022 12:40:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:56.022 12:40:28 -- common/autotest_common.sh@10 -- # set +x 00:12:56.022 [2024-11-20 12:40:28.700852] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:56.022 [2024-11-20 12:40:28.700920] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:56.022 EAL: No free 2048 kB hugepages reported on node 1 00:12:56.022 [2024-11-20 12:40:28.766415] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:56.022 [2024-11-20 12:40:28.887192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:56.022 [2024-11-20 12:40:28.887389] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:56.022 [2024-11-20 12:40:28.887407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:56.022 [2024-11-20 12:40:28.887430] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:56.022 [2024-11-20 12:40:28.887473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:56.954 12:40:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:56.954 12:40:29 -- common/autotest_common.sh@862 -- # return 0 00:12:56.954 12:40:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:56.954 12:40:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 12:40:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:56.954 12:40:29 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:56.954 12:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 [2024-11-20 12:40:29.739314] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:56.954 12:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.954 12:40:29 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:56.954 12:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 12:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.954 12:40:29 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:56.954 12:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 [2024-11-20 12:40:29.755512] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:56.954 12:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.954 12:40:29 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:56.954 12:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 NULL1 00:12:56.954 12:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.954 12:40:29 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:12:56.954 12:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 12:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.954 12:40:29 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:56.954 12:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.954 12:40:29 -- common/autotest_common.sh@10 -- # set +x 00:12:56.954 12:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.954 12:40:29 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:12:56.954 [2024-11-20 12:40:29.800882] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:56.955 [2024-11-20 12:40:29.800922] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3489651 ] 00:12:56.955 EAL: No free 2048 kB hugepages reported on node 1 00:12:57.213 Attached to nqn.2016-06.io.spdk:cnode1 00:12:57.213 Namespace ID: 1 size: 1GB 00:12:57.213 fused_ordering(0) 00:12:57.213 fused_ordering(1) 00:12:57.213 fused_ordering(2) 00:12:57.213 fused_ordering(3) 00:12:57.213 fused_ordering(4) 00:12:57.213 fused_ordering(5) 00:12:57.213 fused_ordering(6) 00:12:57.213 fused_ordering(7) 00:12:57.213 fused_ordering(8) 00:12:57.213 fused_ordering(9) 00:12:57.213 fused_ordering(10) 00:12:57.213 fused_ordering(11) 00:12:57.213 fused_ordering(12) 00:12:57.213 fused_ordering(13) 00:12:57.213 fused_ordering(14) 00:12:57.213 fused_ordering(15) 00:12:57.213 fused_ordering(16) 00:12:57.213 fused_ordering(17) 00:12:57.213 fused_ordering(18) 00:12:57.213 fused_ordering(19) 00:12:57.213 fused_ordering(20) 00:12:57.213 fused_ordering(21) 00:12:57.213 fused_ordering(22) 00:12:57.213 fused_ordering(23) 00:12:57.213 fused_ordering(24) 00:12:57.213 fused_ordering(25) 00:12:57.213 fused_ordering(26) 00:12:57.213 fused_ordering(27) 00:12:57.213 fused_ordering(28) 00:12:57.213 fused_ordering(29) 00:12:57.213 fused_ordering(30) 00:12:57.213 fused_ordering(31) 00:12:57.213 fused_ordering(32) 00:12:57.213 fused_ordering(33) 00:12:57.213 fused_ordering(34) 00:12:57.213 fused_ordering(35) 00:12:57.213 fused_ordering(36) 00:12:57.213 fused_ordering(37) 00:12:57.213 fused_ordering(38) 00:12:57.213 fused_ordering(39) 00:12:57.213 fused_ordering(40) 00:12:57.213 fused_ordering(41) 00:12:57.213 fused_ordering(42) 00:12:57.213 fused_ordering(43) 00:12:57.213 fused_ordering(44) 00:12:57.213 fused_ordering(45) 00:12:57.213 fused_ordering(46) 00:12:57.213 fused_ordering(47) 00:12:57.213 fused_ordering(48) 00:12:57.213 fused_ordering(49) 00:12:57.213 fused_ordering(50) 00:12:57.213 fused_ordering(51) 00:12:57.213 fused_ordering(52) 00:12:57.213 fused_ordering(53) 00:12:57.213 fused_ordering(54) 00:12:57.213 fused_ordering(55) 00:12:57.213 fused_ordering(56) 00:12:57.213 fused_ordering(57) 00:12:57.213 fused_ordering(58) 00:12:57.213 fused_ordering(59) 00:12:57.213 fused_ordering(60) 00:12:57.213 fused_ordering(61) 00:12:57.213 fused_ordering(62) 00:12:57.213 fused_ordering(63) 00:12:57.213 fused_ordering(64) 00:12:57.213 fused_ordering(65) 00:12:57.213 fused_ordering(66) 00:12:57.213 fused_ordering(67) 00:12:57.213 fused_ordering(68) 00:12:57.213 fused_ordering(69) 00:12:57.213 fused_ordering(70) 00:12:57.213 fused_ordering(71) 00:12:57.213 fused_ordering(72) 00:12:57.213 fused_ordering(73) 00:12:57.213 fused_ordering(74) 00:12:57.213 fused_ordering(75) 00:12:57.213 fused_ordering(76) 00:12:57.213 fused_ordering(77) 00:12:57.213 fused_ordering(78) 00:12:57.213 fused_ordering(79) 00:12:57.213 fused_ordering(80) 00:12:57.213 fused_ordering(81) 00:12:57.213 fused_ordering(82) 00:12:57.213 fused_ordering(83) 00:12:57.213 fused_ordering(84) 00:12:57.213 fused_ordering(85) 00:12:57.213 fused_ordering(86) 00:12:57.213 fused_ordering(87) 00:12:57.213 fused_ordering(88) 00:12:57.213 fused_ordering(89) 00:12:57.213 fused_ordering(90) 00:12:57.213 fused_ordering(91) 00:12:57.213 fused_ordering(92) 00:12:57.213 fused_ordering(93) 00:12:57.213 fused_ordering(94) 00:12:57.213 fused_ordering(95) 00:12:57.213 fused_ordering(96) 00:12:57.213 fused_ordering(97) 00:12:57.213 fused_ordering(98) 00:12:57.213 fused_ordering(99) 00:12:57.213 fused_ordering(100) 00:12:57.213 fused_ordering(101) 00:12:57.213 fused_ordering(102) 00:12:57.213 fused_ordering(103) 00:12:57.213 fused_ordering(104) 00:12:57.213 fused_ordering(105) 00:12:57.213 fused_ordering(106) 00:12:57.213 fused_ordering(107) 00:12:57.213 fused_ordering(108) 00:12:57.213 fused_ordering(109) 00:12:57.213 fused_ordering(110) 00:12:57.213 fused_ordering(111) 00:12:57.213 fused_ordering(112) 00:12:57.213 fused_ordering(113) 00:12:57.213 fused_ordering(114) 00:12:57.213 fused_ordering(115) 00:12:57.213 fused_ordering(116) 00:12:57.213 fused_ordering(117) 00:12:57.213 fused_ordering(118) 00:12:57.213 fused_ordering(119) 00:12:57.213 fused_ordering(120) 00:12:57.213 fused_ordering(121) 00:12:57.213 fused_ordering(122) 00:12:57.213 fused_ordering(123) 00:12:57.213 fused_ordering(124) 00:12:57.213 fused_ordering(125) 00:12:57.213 fused_ordering(126) 00:12:57.213 fused_ordering(127) 00:12:57.213 fused_ordering(128) 00:12:57.213 fused_ordering(129) 00:12:57.213 fused_ordering(130) 00:12:57.213 fused_ordering(131) 00:12:57.213 fused_ordering(132) 00:12:57.213 fused_ordering(133) 00:12:57.213 fused_ordering(134) 00:12:57.213 fused_ordering(135) 00:12:57.213 fused_ordering(136) 00:12:57.213 fused_ordering(137) 00:12:57.213 fused_ordering(138) 00:12:57.213 fused_ordering(139) 00:12:57.213 fused_ordering(140) 00:12:57.213 fused_ordering(141) 00:12:57.213 fused_ordering(142) 00:12:57.213 fused_ordering(143) 00:12:57.213 fused_ordering(144) 00:12:57.213 fused_ordering(145) 00:12:57.213 fused_ordering(146) 00:12:57.213 fused_ordering(147) 00:12:57.213 fused_ordering(148) 00:12:57.213 fused_ordering(149) 00:12:57.213 fused_ordering(150) 00:12:57.213 fused_ordering(151) 00:12:57.213 fused_ordering(152) 00:12:57.213 fused_ordering(153) 00:12:57.213 fused_ordering(154) 00:12:57.213 fused_ordering(155) 00:12:57.214 fused_ordering(156) 00:12:57.214 fused_ordering(157) 00:12:57.214 fused_ordering(158) 00:12:57.214 fused_ordering(159) 00:12:57.214 fused_ordering(160) 00:12:57.214 fused_ordering(161) 00:12:57.214 fused_ordering(162) 00:12:57.214 fused_ordering(163) 00:12:57.214 fused_ordering(164) 00:12:57.214 fused_ordering(165) 00:12:57.214 fused_ordering(166) 00:12:57.214 fused_ordering(167) 00:12:57.214 fused_ordering(168) 00:12:57.214 fused_ordering(169) 00:12:57.214 fused_ordering(170) 00:12:57.214 fused_ordering(171) 00:12:57.214 fused_ordering(172) 00:12:57.214 fused_ordering(173) 00:12:57.214 fused_ordering(174) 00:12:57.214 fused_ordering(175) 00:12:57.214 fused_ordering(176) 00:12:57.214 fused_ordering(177) 00:12:57.214 fused_ordering(178) 00:12:57.214 fused_ordering(179) 00:12:57.214 fused_ordering(180) 00:12:57.214 fused_ordering(181) 00:12:57.214 fused_ordering(182) 00:12:57.214 fused_ordering(183) 00:12:57.214 fused_ordering(184) 00:12:57.214 fused_ordering(185) 00:12:57.214 fused_ordering(186) 00:12:57.214 fused_ordering(187) 00:12:57.214 fused_ordering(188) 00:12:57.214 fused_ordering(189) 00:12:57.214 fused_ordering(190) 00:12:57.214 fused_ordering(191) 00:12:57.214 fused_ordering(192) 00:12:57.214 fused_ordering(193) 00:12:57.214 fused_ordering(194) 00:12:57.214 fused_ordering(195) 00:12:57.214 fused_ordering(196) 00:12:57.214 fused_ordering(197) 00:12:57.214 fused_ordering(198) 00:12:57.214 fused_ordering(199) 00:12:57.214 fused_ordering(200) 00:12:57.214 fused_ordering(201) 00:12:57.214 fused_ordering(202) 00:12:57.214 fused_ordering(203) 00:12:57.214 fused_ordering(204) 00:12:57.214 fused_ordering(205) 00:12:57.780 fused_ordering(206) 00:12:57.780 fused_ordering(207) 00:12:57.780 fused_ordering(208) 00:12:57.780 fused_ordering(209) 00:12:57.780 fused_ordering(210) 00:12:57.780 fused_ordering(211) 00:12:57.780 fused_ordering(212) 00:12:57.780 fused_ordering(213) 00:12:57.780 fused_ordering(214) 00:12:57.780 fused_ordering(215) 00:12:57.780 fused_ordering(216) 00:12:57.780 fused_ordering(217) 00:12:57.780 fused_ordering(218) 00:12:57.780 fused_ordering(219) 00:12:57.780 fused_ordering(220) 00:12:57.780 fused_ordering(221) 00:12:57.780 fused_ordering(222) 00:12:57.780 fused_ordering(223) 00:12:57.780 fused_ordering(224) 00:12:57.780 fused_ordering(225) 00:12:57.780 fused_ordering(226) 00:12:57.780 fused_ordering(227) 00:12:57.780 fused_ordering(228) 00:12:57.780 fused_ordering(229) 00:12:57.780 fused_ordering(230) 00:12:57.780 fused_ordering(231) 00:12:57.780 fused_ordering(232) 00:12:57.780 fused_ordering(233) 00:12:57.780 fused_ordering(234) 00:12:57.780 fused_ordering(235) 00:12:57.780 fused_ordering(236) 00:12:57.780 fused_ordering(237) 00:12:57.780 fused_ordering(238) 00:12:57.780 fused_ordering(239) 00:12:57.780 fused_ordering(240) 00:12:57.780 fused_ordering(241) 00:12:57.780 fused_ordering(242) 00:12:57.780 fused_ordering(243) 00:12:57.780 fused_ordering(244) 00:12:57.780 fused_ordering(245) 00:12:57.780 fused_ordering(246) 00:12:57.780 fused_ordering(247) 00:12:57.780 fused_ordering(248) 00:12:57.780 fused_ordering(249) 00:12:57.780 fused_ordering(250) 00:12:57.780 fused_ordering(251) 00:12:57.780 fused_ordering(252) 00:12:57.780 fused_ordering(253) 00:12:57.780 fused_ordering(254) 00:12:57.780 fused_ordering(255) 00:12:57.780 fused_ordering(256) 00:12:57.780 fused_ordering(257) 00:12:57.780 fused_ordering(258) 00:12:57.780 fused_ordering(259) 00:12:57.780 fused_ordering(260) 00:12:57.780 fused_ordering(261) 00:12:57.780 fused_ordering(262) 00:12:57.780 fused_ordering(263) 00:12:57.780 fused_ordering(264) 00:12:57.780 fused_ordering(265) 00:12:57.780 fused_ordering(266) 00:12:57.780 fused_ordering(267) 00:12:57.780 fused_ordering(268) 00:12:57.780 fused_ordering(269) 00:12:57.780 fused_ordering(270) 00:12:57.780 fused_ordering(271) 00:12:57.780 fused_ordering(272) 00:12:57.780 fused_ordering(273) 00:12:57.780 fused_ordering(274) 00:12:57.780 fused_ordering(275) 00:12:57.780 fused_ordering(276) 00:12:57.780 fused_ordering(277) 00:12:57.780 fused_ordering(278) 00:12:57.780 fused_ordering(279) 00:12:57.780 fused_ordering(280) 00:12:57.780 fused_ordering(281) 00:12:57.780 fused_ordering(282) 00:12:57.780 fused_ordering(283) 00:12:57.780 fused_ordering(284) 00:12:57.780 fused_ordering(285) 00:12:57.780 fused_ordering(286) 00:12:57.780 fused_ordering(287) 00:12:57.780 fused_ordering(288) 00:12:57.780 fused_ordering(289) 00:12:57.780 fused_ordering(290) 00:12:57.780 fused_ordering(291) 00:12:57.780 fused_ordering(292) 00:12:57.780 fused_ordering(293) 00:12:57.780 fused_ordering(294) 00:12:57.780 fused_ordering(295) 00:12:57.780 fused_ordering(296) 00:12:57.780 fused_ordering(297) 00:12:57.780 fused_ordering(298) 00:12:57.780 fused_ordering(299) 00:12:57.780 fused_ordering(300) 00:12:57.780 fused_ordering(301) 00:12:57.780 fused_ordering(302) 00:12:57.780 fused_ordering(303) 00:12:57.780 fused_ordering(304) 00:12:57.780 fused_ordering(305) 00:12:57.780 fused_ordering(306) 00:12:57.780 fused_ordering(307) 00:12:57.780 fused_ordering(308) 00:12:57.780 fused_ordering(309) 00:12:57.780 fused_ordering(310) 00:12:57.780 fused_ordering(311) 00:12:57.780 fused_ordering(312) 00:12:57.780 fused_ordering(313) 00:12:57.780 fused_ordering(314) 00:12:57.780 fused_ordering(315) 00:12:57.780 fused_ordering(316) 00:12:57.780 fused_ordering(317) 00:12:57.780 fused_ordering(318) 00:12:57.780 fused_ordering(319) 00:12:57.780 fused_ordering(320) 00:12:57.781 fused_ordering(321) 00:12:57.781 fused_ordering(322) 00:12:57.781 fused_ordering(323) 00:12:57.781 fused_ordering(324) 00:12:57.781 fused_ordering(325) 00:12:57.781 fused_ordering(326) 00:12:57.781 fused_ordering(327) 00:12:57.781 fused_ordering(328) 00:12:57.781 fused_ordering(329) 00:12:57.781 fused_ordering(330) 00:12:57.781 fused_ordering(331) 00:12:57.781 fused_ordering(332) 00:12:57.781 fused_ordering(333) 00:12:57.781 fused_ordering(334) 00:12:57.781 fused_ordering(335) 00:12:57.781 fused_ordering(336) 00:12:57.781 fused_ordering(337) 00:12:57.781 fused_ordering(338) 00:12:57.781 fused_ordering(339) 00:12:57.781 fused_ordering(340) 00:12:57.781 fused_ordering(341) 00:12:57.781 fused_ordering(342) 00:12:57.781 fused_ordering(343) 00:12:57.781 fused_ordering(344) 00:12:57.781 fused_ordering(345) 00:12:57.781 fused_ordering(346) 00:12:57.781 fused_ordering(347) 00:12:57.781 fused_ordering(348) 00:12:57.781 fused_ordering(349) 00:12:57.781 fused_ordering(350) 00:12:57.781 fused_ordering(351) 00:12:57.781 fused_ordering(352) 00:12:57.781 fused_ordering(353) 00:12:57.781 fused_ordering(354) 00:12:57.781 fused_ordering(355) 00:12:57.781 fused_ordering(356) 00:12:57.781 fused_ordering(357) 00:12:57.781 fused_ordering(358) 00:12:57.781 fused_ordering(359) 00:12:57.781 fused_ordering(360) 00:12:57.781 fused_ordering(361) 00:12:57.781 fused_ordering(362) 00:12:57.781 fused_ordering(363) 00:12:57.781 fused_ordering(364) 00:12:57.781 fused_ordering(365) 00:12:57.781 fused_ordering(366) 00:12:57.781 fused_ordering(367) 00:12:57.781 fused_ordering(368) 00:12:57.781 fused_ordering(369) 00:12:57.781 fused_ordering(370) 00:12:57.781 fused_ordering(371) 00:12:57.781 fused_ordering(372) 00:12:57.781 fused_ordering(373) 00:12:57.781 fused_ordering(374) 00:12:57.781 fused_ordering(375) 00:12:57.781 fused_ordering(376) 00:12:57.781 fused_ordering(377) 00:12:57.781 fused_ordering(378) 00:12:57.781 fused_ordering(379) 00:12:57.781 fused_ordering(380) 00:12:57.781 fused_ordering(381) 00:12:57.781 fused_ordering(382) 00:12:57.781 fused_ordering(383) 00:12:57.781 fused_ordering(384) 00:12:57.781 fused_ordering(385) 00:12:57.781 fused_ordering(386) 00:12:57.781 fused_ordering(387) 00:12:57.781 fused_ordering(388) 00:12:57.781 fused_ordering(389) 00:12:57.781 fused_ordering(390) 00:12:57.781 fused_ordering(391) 00:12:57.781 fused_ordering(392) 00:12:57.781 fused_ordering(393) 00:12:57.781 fused_ordering(394) 00:12:57.781 fused_ordering(395) 00:12:57.781 fused_ordering(396) 00:12:57.781 fused_ordering(397) 00:12:57.781 fused_ordering(398) 00:12:57.781 fused_ordering(399) 00:12:57.781 fused_ordering(400) 00:12:57.781 fused_ordering(401) 00:12:57.781 fused_ordering(402) 00:12:57.781 fused_ordering(403) 00:12:57.781 fused_ordering(404) 00:12:57.781 fused_ordering(405) 00:12:57.781 fused_ordering(406) 00:12:57.781 fused_ordering(407) 00:12:57.781 fused_ordering(408) 00:12:57.781 fused_ordering(409) 00:12:57.781 fused_ordering(410) 00:12:58.039 fused_ordering(411) 00:12:58.039 fused_ordering(412) 00:12:58.039 fused_ordering(413) 00:12:58.039 fused_ordering(414) 00:12:58.039 fused_ordering(415) 00:12:58.039 fused_ordering(416) 00:12:58.039 fused_ordering(417) 00:12:58.039 fused_ordering(418) 00:12:58.039 fused_ordering(419) 00:12:58.039 fused_ordering(420) 00:12:58.039 fused_ordering(421) 00:12:58.039 fused_ordering(422) 00:12:58.039 fused_ordering(423) 00:12:58.039 fused_ordering(424) 00:12:58.039 fused_ordering(425) 00:12:58.039 fused_ordering(426) 00:12:58.039 fused_ordering(427) 00:12:58.039 fused_ordering(428) 00:12:58.039 fused_ordering(429) 00:12:58.039 fused_ordering(430) 00:12:58.039 fused_ordering(431) 00:12:58.039 fused_ordering(432) 00:12:58.039 fused_ordering(433) 00:12:58.039 fused_ordering(434) 00:12:58.039 fused_ordering(435) 00:12:58.039 fused_ordering(436) 00:12:58.039 fused_ordering(437) 00:12:58.039 fused_ordering(438) 00:12:58.039 fused_ordering(439) 00:12:58.039 fused_ordering(440) 00:12:58.039 fused_ordering(441) 00:12:58.039 fused_ordering(442) 00:12:58.039 fused_ordering(443) 00:12:58.039 fused_ordering(444) 00:12:58.039 fused_ordering(445) 00:12:58.039 fused_ordering(446) 00:12:58.039 fused_ordering(447) 00:12:58.039 fused_ordering(448) 00:12:58.039 fused_ordering(449) 00:12:58.039 fused_ordering(450) 00:12:58.039 fused_ordering(451) 00:12:58.039 fused_ordering(452) 00:12:58.039 fused_ordering(453) 00:12:58.039 fused_ordering(454) 00:12:58.039 fused_ordering(455) 00:12:58.039 fused_ordering(456) 00:12:58.039 fused_ordering(457) 00:12:58.039 fused_ordering(458) 00:12:58.039 fused_ordering(459) 00:12:58.039 fused_ordering(460) 00:12:58.039 fused_ordering(461) 00:12:58.039 fused_ordering(462) 00:12:58.039 fused_ordering(463) 00:12:58.039 fused_ordering(464) 00:12:58.039 fused_ordering(465) 00:12:58.039 fused_ordering(466) 00:12:58.039 fused_ordering(467) 00:12:58.039 fused_ordering(468) 00:12:58.039 fused_ordering(469) 00:12:58.039 fused_ordering(470) 00:12:58.039 fused_ordering(471) 00:12:58.039 fused_ordering(472) 00:12:58.039 fused_ordering(473) 00:12:58.039 fused_ordering(474) 00:12:58.039 fused_ordering(475) 00:12:58.039 fused_ordering(476) 00:12:58.039 fused_ordering(477) 00:12:58.039 fused_ordering(478) 00:12:58.039 fused_ordering(479) 00:12:58.039 fused_ordering(480) 00:12:58.039 fused_ordering(481) 00:12:58.039 fused_ordering(482) 00:12:58.039 fused_ordering(483) 00:12:58.039 fused_ordering(484) 00:12:58.039 fused_ordering(485) 00:12:58.039 fused_ordering(486) 00:12:58.039 fused_ordering(487) 00:12:58.039 fused_ordering(488) 00:12:58.039 fused_ordering(489) 00:12:58.039 fused_ordering(490) 00:12:58.039 fused_ordering(491) 00:12:58.039 fused_ordering(492) 00:12:58.039 fused_ordering(493) 00:12:58.039 fused_ordering(494) 00:12:58.039 fused_ordering(495) 00:12:58.039 fused_ordering(496) 00:12:58.039 fused_ordering(497) 00:12:58.039 fused_ordering(498) 00:12:58.039 fused_ordering(499) 00:12:58.039 fused_ordering(500) 00:12:58.039 fused_ordering(501) 00:12:58.039 fused_ordering(502) 00:12:58.039 fused_ordering(503) 00:12:58.039 fused_ordering(504) 00:12:58.039 fused_ordering(505) 00:12:58.039 fused_ordering(506) 00:12:58.039 fused_ordering(507) 00:12:58.039 fused_ordering(508) 00:12:58.039 fused_ordering(509) 00:12:58.039 fused_ordering(510) 00:12:58.039 fused_ordering(511) 00:12:58.039 fused_ordering(512) 00:12:58.039 fused_ordering(513) 00:12:58.039 fused_ordering(514) 00:12:58.039 fused_ordering(515) 00:12:58.039 fused_ordering(516) 00:12:58.039 fused_ordering(517) 00:12:58.039 fused_ordering(518) 00:12:58.039 fused_ordering(519) 00:12:58.039 fused_ordering(520) 00:12:58.039 fused_ordering(521) 00:12:58.039 fused_ordering(522) 00:12:58.039 fused_ordering(523) 00:12:58.039 fused_ordering(524) 00:12:58.039 fused_ordering(525) 00:12:58.039 fused_ordering(526) 00:12:58.039 fused_ordering(527) 00:12:58.039 fused_ordering(528) 00:12:58.039 fused_ordering(529) 00:12:58.039 fused_ordering(530) 00:12:58.039 fused_ordering(531) 00:12:58.039 fused_ordering(532) 00:12:58.039 fused_ordering(533) 00:12:58.039 fused_ordering(534) 00:12:58.039 fused_ordering(535) 00:12:58.039 fused_ordering(536) 00:12:58.039 fused_ordering(537) 00:12:58.039 fused_ordering(538) 00:12:58.039 fused_ordering(539) 00:12:58.039 fused_ordering(540) 00:12:58.039 fused_ordering(541) 00:12:58.039 fused_ordering(542) 00:12:58.039 fused_ordering(543) 00:12:58.039 fused_ordering(544) 00:12:58.039 fused_ordering(545) 00:12:58.039 fused_ordering(546) 00:12:58.039 fused_ordering(547) 00:12:58.039 fused_ordering(548) 00:12:58.039 fused_ordering(549) 00:12:58.039 fused_ordering(550) 00:12:58.039 fused_ordering(551) 00:12:58.039 fused_ordering(552) 00:12:58.039 fused_ordering(553) 00:12:58.039 fused_ordering(554) 00:12:58.040 fused_ordering(555) 00:12:58.040 fused_ordering(556) 00:12:58.040 fused_ordering(557) 00:12:58.040 fused_ordering(558) 00:12:58.040 fused_ordering(559) 00:12:58.040 fused_ordering(560) 00:12:58.040 fused_ordering(561) 00:12:58.040 fused_ordering(562) 00:12:58.040 fused_ordering(563) 00:12:58.040 fused_ordering(564) 00:12:58.040 fused_ordering(565) 00:12:58.040 fused_ordering(566) 00:12:58.040 fused_ordering(567) 00:12:58.040 fused_ordering(568) 00:12:58.040 fused_ordering(569) 00:12:58.040 fused_ordering(570) 00:12:58.040 fused_ordering(571) 00:12:58.040 fused_ordering(572) 00:12:58.040 fused_ordering(573) 00:12:58.040 fused_ordering(574) 00:12:58.040 fused_ordering(575) 00:12:58.040 fused_ordering(576) 00:12:58.040 fused_ordering(577) 00:12:58.040 fused_ordering(578) 00:12:58.040 fused_ordering(579) 00:12:58.040 fused_ordering(580) 00:12:58.040 fused_ordering(581) 00:12:58.040 fused_ordering(582) 00:12:58.040 fused_ordering(583) 00:12:58.040 fused_ordering(584) 00:12:58.040 fused_ordering(585) 00:12:58.040 fused_ordering(586) 00:12:58.040 fused_ordering(587) 00:12:58.040 fused_ordering(588) 00:12:58.040 fused_ordering(589) 00:12:58.040 fused_ordering(590) 00:12:58.040 fused_ordering(591) 00:12:58.040 fused_ordering(592) 00:12:58.040 fused_ordering(593) 00:12:58.040 fused_ordering(594) 00:12:58.040 fused_ordering(595) 00:12:58.040 fused_ordering(596) 00:12:58.040 fused_ordering(597) 00:12:58.040 fused_ordering(598) 00:12:58.040 fused_ordering(599) 00:12:58.040 fused_ordering(600) 00:12:58.040 fused_ordering(601) 00:12:58.040 fused_ordering(602) 00:12:58.040 fused_ordering(603) 00:12:58.040 fused_ordering(604) 00:12:58.040 fused_ordering(605) 00:12:58.040 fused_ordering(606) 00:12:58.040 fused_ordering(607) 00:12:58.040 fused_ordering(608) 00:12:58.040 fused_ordering(609) 00:12:58.040 fused_ordering(610) 00:12:58.040 fused_ordering(611) 00:12:58.040 fused_ordering(612) 00:12:58.040 fused_ordering(613) 00:12:58.040 fused_ordering(614) 00:12:58.040 fused_ordering(615) 00:12:58.606 fused_ordering(616) 00:12:58.606 fused_ordering(617) 00:12:58.606 fused_ordering(618) 00:12:58.606 fused_ordering(619) 00:12:58.606 fused_ordering(620) 00:12:58.606 fused_ordering(621) 00:12:58.606 fused_ordering(622) 00:12:58.606 fused_ordering(623) 00:12:58.606 fused_ordering(624) 00:12:58.606 fused_ordering(625) 00:12:58.606 fused_ordering(626) 00:12:58.606 fused_ordering(627) 00:12:58.606 fused_ordering(628) 00:12:58.606 fused_ordering(629) 00:12:58.606 fused_ordering(630) 00:12:58.606 fused_ordering(631) 00:12:58.606 fused_ordering(632) 00:12:58.606 fused_ordering(633) 00:12:58.606 fused_ordering(634) 00:12:58.606 fused_ordering(635) 00:12:58.606 fused_ordering(636) 00:12:58.606 fused_ordering(637) 00:12:58.606 fused_ordering(638) 00:12:58.606 fused_ordering(639) 00:12:58.606 fused_ordering(640) 00:12:58.606 fused_ordering(641) 00:12:58.606 fused_ordering(642) 00:12:58.606 fused_ordering(643) 00:12:58.606 fused_ordering(644) 00:12:58.606 fused_ordering(645) 00:12:58.606 fused_ordering(646) 00:12:58.606 fused_ordering(647) 00:12:58.606 fused_ordering(648) 00:12:58.606 fused_ordering(649) 00:12:58.606 fused_ordering(650) 00:12:58.606 fused_ordering(651) 00:12:58.606 fused_ordering(652) 00:12:58.606 fused_ordering(653) 00:12:58.606 fused_ordering(654) 00:12:58.606 fused_ordering(655) 00:12:58.606 fused_ordering(656) 00:12:58.606 fused_ordering(657) 00:12:58.606 fused_ordering(658) 00:12:58.606 fused_ordering(659) 00:12:58.606 fused_ordering(660) 00:12:58.606 fused_ordering(661) 00:12:58.606 fused_ordering(662) 00:12:58.606 fused_ordering(663) 00:12:58.607 fused_ordering(664) 00:12:58.607 fused_ordering(665) 00:12:58.607 fused_ordering(666) 00:12:58.607 fused_ordering(667) 00:12:58.607 fused_ordering(668) 00:12:58.607 fused_ordering(669) 00:12:58.607 fused_ordering(670) 00:12:58.607 fused_ordering(671) 00:12:58.607 fused_ordering(672) 00:12:58.607 fused_ordering(673) 00:12:58.607 fused_ordering(674) 00:12:58.607 fused_ordering(675) 00:12:58.607 fused_ordering(676) 00:12:58.607 fused_ordering(677) 00:12:58.607 fused_ordering(678) 00:12:58.607 fused_ordering(679) 00:12:58.607 fused_ordering(680) 00:12:58.607 fused_ordering(681) 00:12:58.607 fused_ordering(682) 00:12:58.607 fused_ordering(683) 00:12:58.607 fused_ordering(684) 00:12:58.607 fused_ordering(685) 00:12:58.607 fused_ordering(686) 00:12:58.607 fused_ordering(687) 00:12:58.607 fused_ordering(688) 00:12:58.607 fused_ordering(689) 00:12:58.607 fused_ordering(690) 00:12:58.607 fused_ordering(691) 00:12:58.607 fused_ordering(692) 00:12:58.607 fused_ordering(693) 00:12:58.607 fused_ordering(694) 00:12:58.607 fused_ordering(695) 00:12:58.607 fused_ordering(696) 00:12:58.607 fused_ordering(697) 00:12:58.607 fused_ordering(698) 00:12:58.607 fused_ordering(699) 00:12:58.607 fused_ordering(700) 00:12:58.607 fused_ordering(701) 00:12:58.607 fused_ordering(702) 00:12:58.607 fused_ordering(703) 00:12:58.607 fused_ordering(704) 00:12:58.607 fused_ordering(705) 00:12:58.607 fused_ordering(706) 00:12:58.607 fused_ordering(707) 00:12:58.607 fused_ordering(708) 00:12:58.607 fused_ordering(709) 00:12:58.607 fused_ordering(710) 00:12:58.607 fused_ordering(711) 00:12:58.607 fused_ordering(712) 00:12:58.607 fused_ordering(713) 00:12:58.607 fused_ordering(714) 00:12:58.607 fused_ordering(715) 00:12:58.607 fused_ordering(716) 00:12:58.607 fused_ordering(717) 00:12:58.607 fused_ordering(718) 00:12:58.607 fused_ordering(719) 00:12:58.607 fused_ordering(720) 00:12:58.607 fused_ordering(721) 00:12:58.607 fused_ordering(722) 00:12:58.607 fused_ordering(723) 00:12:58.607 fused_ordering(724) 00:12:58.607 fused_ordering(725) 00:12:58.607 fused_ordering(726) 00:12:58.607 fused_ordering(727) 00:12:58.607 fused_ordering(728) 00:12:58.607 fused_ordering(729) 00:12:58.607 fused_ordering(730) 00:12:58.607 fused_ordering(731) 00:12:58.607 fused_ordering(732) 00:12:58.607 fused_ordering(733) 00:12:58.607 fused_ordering(734) 00:12:58.607 fused_ordering(735) 00:12:58.607 fused_ordering(736) 00:12:58.607 fused_ordering(737) 00:12:58.607 fused_ordering(738) 00:12:58.607 fused_ordering(739) 00:12:58.607 fused_ordering(740) 00:12:58.607 fused_ordering(741) 00:12:58.607 fused_ordering(742) 00:12:58.607 fused_ordering(743) 00:12:58.607 fused_ordering(744) 00:12:58.607 fused_ordering(745) 00:12:58.607 fused_ordering(746) 00:12:58.607 fused_ordering(747) 00:12:58.607 fused_ordering(748) 00:12:58.607 fused_ordering(749) 00:12:58.607 fused_ordering(750) 00:12:58.607 fused_ordering(751) 00:12:58.607 fused_ordering(752) 00:12:58.607 fused_ordering(753) 00:12:58.607 fused_ordering(754) 00:12:58.607 fused_ordering(755) 00:12:58.607 fused_ordering(756) 00:12:58.607 fused_ordering(757) 00:12:58.607 fused_ordering(758) 00:12:58.607 fused_ordering(759) 00:12:58.607 fused_ordering(760) 00:12:58.607 fused_ordering(761) 00:12:58.607 fused_ordering(762) 00:12:58.607 fused_ordering(763) 00:12:58.607 fused_ordering(764) 00:12:58.607 fused_ordering(765) 00:12:58.607 fused_ordering(766) 00:12:58.607 fused_ordering(767) 00:12:58.607 fused_ordering(768) 00:12:58.607 fused_ordering(769) 00:12:58.607 fused_ordering(770) 00:12:58.607 fused_ordering(771) 00:12:58.607 fused_ordering(772) 00:12:58.607 fused_ordering(773) 00:12:58.607 fused_ordering(774) 00:12:58.607 fused_ordering(775) 00:12:58.607 fused_ordering(776) 00:12:58.607 fused_ordering(777) 00:12:58.607 fused_ordering(778) 00:12:58.607 fused_ordering(779) 00:12:58.607 fused_ordering(780) 00:12:58.607 fused_ordering(781) 00:12:58.607 fused_ordering(782) 00:12:58.607 fused_ordering(783) 00:12:58.607 fused_ordering(784) 00:12:58.607 fused_ordering(785) 00:12:58.607 fused_ordering(786) 00:12:58.607 fused_ordering(787) 00:12:58.607 fused_ordering(788) 00:12:58.607 fused_ordering(789) 00:12:58.607 fused_ordering(790) 00:12:58.607 fused_ordering(791) 00:12:58.607 fused_ordering(792) 00:12:58.607 fused_ordering(793) 00:12:58.607 fused_ordering(794) 00:12:58.607 fused_ordering(795) 00:12:58.607 fused_ordering(796) 00:12:58.607 fused_ordering(797) 00:12:58.607 fused_ordering(798) 00:12:58.607 fused_ordering(799) 00:12:58.607 fused_ordering(800) 00:12:58.607 fused_ordering(801) 00:12:58.607 fused_ordering(802) 00:12:58.607 fused_ordering(803) 00:12:58.607 fused_ordering(804) 00:12:58.607 fused_ordering(805) 00:12:58.607 fused_ordering(806) 00:12:58.607 fused_ordering(807) 00:12:58.607 fused_ordering(808) 00:12:58.607 fused_ordering(809) 00:12:58.607 fused_ordering(810) 00:12:58.607 fused_ordering(811) 00:12:58.607 fused_ordering(812) 00:12:58.607 fused_ordering(813) 00:12:58.607 fused_ordering(814) 00:12:58.607 fused_ordering(815) 00:12:58.607 fused_ordering(816) 00:12:58.607 fused_ordering(817) 00:12:58.607 fused_ordering(818) 00:12:58.607 fused_ordering(819) 00:12:58.607 fused_ordering(820) 00:12:59.540 fused_ordering(821) 00:12:59.540 fused_ordering(822) 00:12:59.540 fused_ordering(823) 00:12:59.540 fused_ordering(824) 00:12:59.540 fused_ordering(825) 00:12:59.540 fused_ordering(826) 00:12:59.540 fused_ordering(827) 00:12:59.540 fused_ordering(828) 00:12:59.540 fused_ordering(829) 00:12:59.540 fused_ordering(830) 00:12:59.540 fused_ordering(831) 00:12:59.540 fused_ordering(832) 00:12:59.540 fused_ordering(833) 00:12:59.540 fused_ordering(834) 00:12:59.540 fused_ordering(835) 00:12:59.540 fused_ordering(836) 00:12:59.540 fused_ordering(837) 00:12:59.540 fused_ordering(838) 00:12:59.540 fused_ordering(839) 00:12:59.540 fused_ordering(840) 00:12:59.540 fused_ordering(841) 00:12:59.540 fused_ordering(842) 00:12:59.540 fused_ordering(843) 00:12:59.540 fused_ordering(844) 00:12:59.540 fused_ordering(845) 00:12:59.540 fused_ordering(846) 00:12:59.540 fused_ordering(847) 00:12:59.540 fused_ordering(848) 00:12:59.540 fused_ordering(849) 00:12:59.540 fused_ordering(850) 00:12:59.540 fused_ordering(851) 00:12:59.540 fused_ordering(852) 00:12:59.540 fused_ordering(853) 00:12:59.540 fused_ordering(854) 00:12:59.540 fused_ordering(855) 00:12:59.540 fused_ordering(856) 00:12:59.540 fused_ordering(857) 00:12:59.540 fused_ordering(858) 00:12:59.540 fused_ordering(859) 00:12:59.540 fused_ordering(860) 00:12:59.540 fused_ordering(861) 00:12:59.540 fused_ordering(862) 00:12:59.540 fused_ordering(863) 00:12:59.540 fused_ordering(864) 00:12:59.540 fused_ordering(865) 00:12:59.540 fused_ordering(866) 00:12:59.540 fused_ordering(867) 00:12:59.540 fused_ordering(868) 00:12:59.540 fused_ordering(869) 00:12:59.540 fused_ordering(870) 00:12:59.540 fused_ordering(871) 00:12:59.540 fused_ordering(872) 00:12:59.540 fused_ordering(873) 00:12:59.540 fused_ordering(874) 00:12:59.540 fused_ordering(875) 00:12:59.540 fused_ordering(876) 00:12:59.540 fused_ordering(877) 00:12:59.540 fused_ordering(878) 00:12:59.540 fused_ordering(879) 00:12:59.540 fused_ordering(880) 00:12:59.540 fused_ordering(881) 00:12:59.540 fused_ordering(882) 00:12:59.540 fused_ordering(883) 00:12:59.540 fused_ordering(884) 00:12:59.540 fused_ordering(885) 00:12:59.540 fused_ordering(886) 00:12:59.540 fused_ordering(887) 00:12:59.540 fused_ordering(888) 00:12:59.540 fused_ordering(889) 00:12:59.540 fused_ordering(890) 00:12:59.540 fused_ordering(891) 00:12:59.540 fused_ordering(892) 00:12:59.540 fused_ordering(893) 00:12:59.540 fused_ordering(894) 00:12:59.540 fused_ordering(895) 00:12:59.540 fused_ordering(896) 00:12:59.540 fused_ordering(897) 00:12:59.540 fused_ordering(898) 00:12:59.540 fused_ordering(899) 00:12:59.540 fused_ordering(900) 00:12:59.540 fused_ordering(901) 00:12:59.540 fused_ordering(902) 00:12:59.540 fused_ordering(903) 00:12:59.540 fused_ordering(904) 00:12:59.540 fused_ordering(905) 00:12:59.540 fused_ordering(906) 00:12:59.540 fused_ordering(907) 00:12:59.540 fused_ordering(908) 00:12:59.540 fused_ordering(909) 00:12:59.540 fused_ordering(910) 00:12:59.540 fused_ordering(911) 00:12:59.540 fused_ordering(912) 00:12:59.540 fused_ordering(913) 00:12:59.540 fused_ordering(914) 00:12:59.540 fused_ordering(915) 00:12:59.540 fused_ordering(916) 00:12:59.540 fused_ordering(917) 00:12:59.540 fused_ordering(918) 00:12:59.540 fused_ordering(919) 00:12:59.540 fused_ordering(920) 00:12:59.540 fused_ordering(921) 00:12:59.540 fused_ordering(922) 00:12:59.540 fused_ordering(923) 00:12:59.540 fused_ordering(924) 00:12:59.540 fused_ordering(925) 00:12:59.540 fused_ordering(926) 00:12:59.540 fused_ordering(927) 00:12:59.540 fused_ordering(928) 00:12:59.540 fused_ordering(929) 00:12:59.540 fused_ordering(930) 00:12:59.540 fused_ordering(931) 00:12:59.540 fused_ordering(932) 00:12:59.540 fused_ordering(933) 00:12:59.540 fused_ordering(934) 00:12:59.540 fused_ordering(935) 00:12:59.540 fused_ordering(936) 00:12:59.540 fused_ordering(937) 00:12:59.540 fused_ordering(938) 00:12:59.540 fused_ordering(939) 00:12:59.540 fused_ordering(940) 00:12:59.540 fused_ordering(941) 00:12:59.540 fused_ordering(942) 00:12:59.540 fused_ordering(943) 00:12:59.540 fused_ordering(944) 00:12:59.540 fused_ordering(945) 00:12:59.540 fused_ordering(946) 00:12:59.540 fused_ordering(947) 00:12:59.540 fused_ordering(948) 00:12:59.540 fused_ordering(949) 00:12:59.540 fused_ordering(950) 00:12:59.540 fused_ordering(951) 00:12:59.540 fused_ordering(952) 00:12:59.540 fused_ordering(953) 00:12:59.540 fused_ordering(954) 00:12:59.540 fused_ordering(955) 00:12:59.540 fused_ordering(956) 00:12:59.540 fused_ordering(957) 00:12:59.540 fused_ordering(958) 00:12:59.540 fused_ordering(959) 00:12:59.540 fused_ordering(960) 00:12:59.540 fused_ordering(961) 00:12:59.540 fused_ordering(962) 00:12:59.540 fused_ordering(963) 00:12:59.540 fused_ordering(964) 00:12:59.540 fused_ordering(965) 00:12:59.540 fused_ordering(966) 00:12:59.540 fused_ordering(967) 00:12:59.540 fused_ordering(968) 00:12:59.540 fused_ordering(969) 00:12:59.540 fused_ordering(970) 00:12:59.540 fused_ordering(971) 00:12:59.540 fused_ordering(972) 00:12:59.540 fused_ordering(973) 00:12:59.540 fused_ordering(974) 00:12:59.540 fused_ordering(975) 00:12:59.540 fused_ordering(976) 00:12:59.540 fused_ordering(977) 00:12:59.540 fused_ordering(978) 00:12:59.540 fused_ordering(979) 00:12:59.540 fused_ordering(980) 00:12:59.540 fused_ordering(981) 00:12:59.540 fused_ordering(982) 00:12:59.540 fused_ordering(983) 00:12:59.540 fused_ordering(984) 00:12:59.540 fused_ordering(985) 00:12:59.540 fused_ordering(986) 00:12:59.540 fused_ordering(987) 00:12:59.540 fused_ordering(988) 00:12:59.540 fused_ordering(989) 00:12:59.540 fused_ordering(990) 00:12:59.540 fused_ordering(991) 00:12:59.540 fused_ordering(992) 00:12:59.540 fused_ordering(993) 00:12:59.540 fused_ordering(994) 00:12:59.540 fused_ordering(995) 00:12:59.540 fused_ordering(996) 00:12:59.540 fused_ordering(997) 00:12:59.540 fused_ordering(998) 00:12:59.540 fused_ordering(999) 00:12:59.540 fused_ordering(1000) 00:12:59.540 fused_ordering(1001) 00:12:59.540 fused_ordering(1002) 00:12:59.540 fused_ordering(1003) 00:12:59.540 fused_ordering(1004) 00:12:59.540 fused_ordering(1005) 00:12:59.540 fused_ordering(1006) 00:12:59.540 fused_ordering(1007) 00:12:59.540 fused_ordering(1008) 00:12:59.540 fused_ordering(1009) 00:12:59.540 fused_ordering(1010) 00:12:59.540 fused_ordering(1011) 00:12:59.540 fused_ordering(1012) 00:12:59.540 fused_ordering(1013) 00:12:59.540 fused_ordering(1014) 00:12:59.540 fused_ordering(1015) 00:12:59.540 fused_ordering(1016) 00:12:59.540 fused_ordering(1017) 00:12:59.540 fused_ordering(1018) 00:12:59.540 fused_ordering(1019) 00:12:59.540 fused_ordering(1020) 00:12:59.540 fused_ordering(1021) 00:12:59.540 fused_ordering(1022) 00:12:59.540 fused_ordering(1023) 00:12:59.540 12:40:32 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:12:59.540 12:40:32 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:12:59.540 12:40:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:59.540 12:40:32 -- nvmf/common.sh@116 -- # sync 00:12:59.540 12:40:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:59.540 12:40:32 -- nvmf/common.sh@119 -- # set +e 00:12:59.540 12:40:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:59.540 12:40:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:59.540 rmmod nvme_tcp 00:12:59.540 rmmod nvme_fabrics 00:12:59.540 rmmod nvme_keyring 00:12:59.540 12:40:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:59.540 12:40:32 -- nvmf/common.sh@123 -- # set -e 00:12:59.540 12:40:32 -- nvmf/common.sh@124 -- # return 0 00:12:59.540 12:40:32 -- nvmf/common.sh@477 -- # '[' -n 3489496 ']' 00:12:59.540 12:40:32 -- nvmf/common.sh@478 -- # killprocess 3489496 00:12:59.540 12:40:32 -- common/autotest_common.sh@936 -- # '[' -z 3489496 ']' 00:12:59.540 12:40:32 -- common/autotest_common.sh@940 -- # kill -0 3489496 00:12:59.540 12:40:32 -- common/autotest_common.sh@941 -- # uname 00:12:59.540 12:40:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:59.540 12:40:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3489496 00:12:59.540 12:40:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:59.540 12:40:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:59.540 12:40:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3489496' 00:12:59.540 killing process with pid 3489496 00:12:59.540 12:40:32 -- common/autotest_common.sh@955 -- # kill 3489496 00:12:59.540 12:40:32 -- common/autotest_common.sh@960 -- # wait 3489496 00:12:59.797 12:40:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:59.797 12:40:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:59.797 12:40:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:59.797 12:40:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:59.797 12:40:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:59.797 12:40:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:59.797 12:40:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:59.797 12:40:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:01.700 12:40:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:01.700 00:13:01.700 real 0m8.420s 00:13:01.700 user 0m6.405s 00:13:01.700 sys 0m3.191s 00:13:01.700 12:40:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:01.700 12:40:34 -- common/autotest_common.sh@10 -- # set +x 00:13:01.700 ************************************ 00:13:01.700 END TEST nvmf_fused_ordering 00:13:01.700 ************************************ 00:13:01.700 12:40:34 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:01.700 12:40:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:01.700 12:40:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:01.700 12:40:34 -- common/autotest_common.sh@10 -- # set +x 00:13:01.959 ************************************ 00:13:01.959 START TEST nvmf_delete_subsystem 00:13:01.959 ************************************ 00:13:01.959 12:40:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:01.959 * Looking for test storage... 00:13:01.959 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:01.959 12:40:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:01.959 12:40:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:01.959 12:40:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:01.959 12:40:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:01.959 12:40:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:01.959 12:40:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:01.959 12:40:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:01.959 12:40:34 -- scripts/common.sh@335 -- # IFS=.-: 00:13:01.959 12:40:34 -- scripts/common.sh@335 -- # read -ra ver1 00:13:01.959 12:40:34 -- scripts/common.sh@336 -- # IFS=.-: 00:13:01.959 12:40:34 -- scripts/common.sh@336 -- # read -ra ver2 00:13:01.959 12:40:34 -- scripts/common.sh@337 -- # local 'op=<' 00:13:01.959 12:40:34 -- scripts/common.sh@339 -- # ver1_l=2 00:13:01.959 12:40:34 -- scripts/common.sh@340 -- # ver2_l=1 00:13:01.959 12:40:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:01.959 12:40:34 -- scripts/common.sh@343 -- # case "$op" in 00:13:01.959 12:40:34 -- scripts/common.sh@344 -- # : 1 00:13:01.959 12:40:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:01.959 12:40:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:01.959 12:40:34 -- scripts/common.sh@364 -- # decimal 1 00:13:01.959 12:40:34 -- scripts/common.sh@352 -- # local d=1 00:13:01.959 12:40:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:01.959 12:40:34 -- scripts/common.sh@354 -- # echo 1 00:13:01.959 12:40:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:01.959 12:40:34 -- scripts/common.sh@365 -- # decimal 2 00:13:01.959 12:40:34 -- scripts/common.sh@352 -- # local d=2 00:13:01.959 12:40:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:01.959 12:40:34 -- scripts/common.sh@354 -- # echo 2 00:13:01.959 12:40:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:01.959 12:40:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:01.959 12:40:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:01.959 12:40:34 -- scripts/common.sh@367 -- # return 0 00:13:01.959 12:40:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:01.959 12:40:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:01.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.959 --rc genhtml_branch_coverage=1 00:13:01.959 --rc genhtml_function_coverage=1 00:13:01.959 --rc genhtml_legend=1 00:13:01.959 --rc geninfo_all_blocks=1 00:13:01.959 --rc geninfo_unexecuted_blocks=1 00:13:01.959 00:13:01.959 ' 00:13:01.959 12:40:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:01.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.959 --rc genhtml_branch_coverage=1 00:13:01.959 --rc genhtml_function_coverage=1 00:13:01.959 --rc genhtml_legend=1 00:13:01.959 --rc geninfo_all_blocks=1 00:13:01.959 --rc geninfo_unexecuted_blocks=1 00:13:01.959 00:13:01.959 ' 00:13:01.959 12:40:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:01.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.959 --rc genhtml_branch_coverage=1 00:13:01.959 --rc genhtml_function_coverage=1 00:13:01.959 --rc genhtml_legend=1 00:13:01.959 --rc geninfo_all_blocks=1 00:13:01.959 --rc geninfo_unexecuted_blocks=1 00:13:01.959 00:13:01.959 ' 00:13:01.959 12:40:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:01.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.959 --rc genhtml_branch_coverage=1 00:13:01.959 --rc genhtml_function_coverage=1 00:13:01.959 --rc genhtml_legend=1 00:13:01.959 --rc geninfo_all_blocks=1 00:13:01.959 --rc geninfo_unexecuted_blocks=1 00:13:01.959 00:13:01.959 ' 00:13:01.959 12:40:34 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:01.959 12:40:34 -- nvmf/common.sh@7 -- # uname -s 00:13:01.959 12:40:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:01.959 12:40:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:01.959 12:40:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:01.959 12:40:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:01.959 12:40:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:01.959 12:40:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:01.960 12:40:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:01.960 12:40:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:01.960 12:40:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:01.960 12:40:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:01.960 12:40:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:01.960 12:40:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:01.960 12:40:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:01.960 12:40:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:01.960 12:40:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:01.960 12:40:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:01.960 12:40:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:01.960 12:40:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:01.960 12:40:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:01.960 12:40:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.960 12:40:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.960 12:40:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.960 12:40:34 -- paths/export.sh@5 -- # export PATH 00:13:01.960 12:40:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.960 12:40:34 -- nvmf/common.sh@46 -- # : 0 00:13:01.960 12:40:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:01.960 12:40:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:01.960 12:40:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:01.960 12:40:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:01.960 12:40:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:01.960 12:40:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:01.960 12:40:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:01.960 12:40:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:01.960 12:40:34 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:01.960 12:40:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:01.960 12:40:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:01.960 12:40:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:01.960 12:40:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:01.960 12:40:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:01.960 12:40:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:01.960 12:40:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:01.960 12:40:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:01.960 12:40:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:01.960 12:40:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:01.960 12:40:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:01.960 12:40:34 -- common/autotest_common.sh@10 -- # set +x 00:13:03.861 12:40:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:03.861 12:40:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:03.861 12:40:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:03.861 12:40:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:03.861 12:40:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:03.861 12:40:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:03.861 12:40:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:03.861 12:40:36 -- nvmf/common.sh@294 -- # net_devs=() 00:13:03.861 12:40:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:03.861 12:40:36 -- nvmf/common.sh@295 -- # e810=() 00:13:03.861 12:40:36 -- nvmf/common.sh@295 -- # local -ga e810 00:13:03.861 12:40:36 -- nvmf/common.sh@296 -- # x722=() 00:13:03.861 12:40:36 -- nvmf/common.sh@296 -- # local -ga x722 00:13:03.861 12:40:36 -- nvmf/common.sh@297 -- # mlx=() 00:13:03.861 12:40:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:03.861 12:40:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:03.861 12:40:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:03.861 12:40:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:03.861 12:40:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:03.861 12:40:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.861 12:40:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:03.861 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:03.861 12:40:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.861 12:40:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:03.861 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:03.861 12:40:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:03.861 12:40:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:03.861 12:40:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.861 12:40:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.861 12:40:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.862 12:40:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.862 12:40:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:03.862 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:03.862 12:40:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.862 12:40:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.862 12:40:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.862 12:40:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.862 12:40:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.862 12:40:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:03.862 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:03.862 12:40:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.862 12:40:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:03.862 12:40:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:03.862 12:40:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:03.862 12:40:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:03.862 12:40:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:03.862 12:40:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:03.862 12:40:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:03.862 12:40:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:03.862 12:40:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:03.862 12:40:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:03.862 12:40:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:03.862 12:40:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:03.862 12:40:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:03.862 12:40:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:03.862 12:40:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:03.862 12:40:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:03.862 12:40:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:03.862 12:40:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:03.862 12:40:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:03.862 12:40:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:03.862 12:40:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:03.862 12:40:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:03.862 12:40:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:04.120 12:40:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:04.120 12:40:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:04.120 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:04.120 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:13:04.120 00:13:04.120 --- 10.0.0.2 ping statistics --- 00:13:04.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:04.120 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:13:04.120 12:40:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:04.120 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:04.120 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:13:04.120 00:13:04.120 --- 10.0.0.1 ping statistics --- 00:13:04.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:04.120 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:13:04.120 12:40:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:04.120 12:40:36 -- nvmf/common.sh@410 -- # return 0 00:13:04.120 12:40:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:04.120 12:40:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:04.120 12:40:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:04.120 12:40:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:04.120 12:40:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:04.120 12:40:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:04.120 12:40:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:04.120 12:40:37 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:04.120 12:40:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:04.120 12:40:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:04.120 12:40:37 -- common/autotest_common.sh@10 -- # set +x 00:13:04.120 12:40:37 -- nvmf/common.sh@469 -- # nvmfpid=3492001 00:13:04.120 12:40:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:04.120 12:40:37 -- nvmf/common.sh@470 -- # waitforlisten 3492001 00:13:04.120 12:40:37 -- common/autotest_common.sh@829 -- # '[' -z 3492001 ']' 00:13:04.120 12:40:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:04.120 12:40:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:04.120 12:40:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:04.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:04.120 12:40:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:04.120 12:40:37 -- common/autotest_common.sh@10 -- # set +x 00:13:04.120 [2024-11-20 12:40:37.044336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:04.120 [2024-11-20 12:40:37.044402] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:04.120 EAL: No free 2048 kB hugepages reported on node 1 00:13:04.120 [2024-11-20 12:40:37.109774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:04.120 [2024-11-20 12:40:37.227127] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:04.120 [2024-11-20 12:40:37.227286] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:04.120 [2024-11-20 12:40:37.227303] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:04.379 [2024-11-20 12:40:37.227316] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:04.379 [2024-11-20 12:40:37.231096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:04.379 [2024-11-20 12:40:37.231109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:05.056 12:40:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:05.056 12:40:38 -- common/autotest_common.sh@862 -- # return 0 00:13:05.056 12:40:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:05.056 12:40:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 12:40:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:05.056 12:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 [2024-11-20 12:40:38.095793] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:05.056 12:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:05.056 12:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 12:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:05.056 12:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 [2024-11-20 12:40:38.112015] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:05.056 12:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:05.056 12:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 NULL1 00:13:05.056 12:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:05.056 12:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 Delay0 00:13:05.056 12:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.056 12:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.056 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:13:05.056 12:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@28 -- # perf_pid=3492156 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:05.056 12:40:38 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:05.314 EAL: No free 2048 kB hugepages reported on node 1 00:13:05.314 [2024-11-20 12:40:38.186769] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:07.213 12:40:40 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:07.213 12:40:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.213 12:40:40 -- common/autotest_common.sh@10 -- # set +x 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 [2024-11-20 12:40:40.318060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7c4400c350 is same with the state(5) to be set 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Write completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.213 starting I/O failed: -6 00:13:07.213 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 starting I/O failed: -6 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 starting I/O failed: -6 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 starting I/O failed: -6 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 [2024-11-20 12:40:40.318691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a74a20 is same with the state(5) to be set 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 [2024-11-20 12:40:40.319203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7c44000c00 is same with the state(5) to be set 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:07.214 Read completed with error (sct=0, sc=8) 00:13:07.214 Write completed with error (sct=0, sc=8) 00:13:08.589 [2024-11-20 12:40:41.283727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8d960 is same with the state(5) to be set 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 [2024-11-20 12:40:41.320131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7c4400bf20 is same with the state(5) to be set 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 [2024-11-20 12:40:41.320304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7c4400c600 is same with the state(5) to be set 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 [2024-11-20 12:40:41.320539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a74770 is same with the state(5) to be set 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Write completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 Read completed with error (sct=0, sc=8) 00:13:08.589 [2024-11-20 12:40:41.321275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a943d0 is same with the state(5) to be set 00:13:08.590 [2024-11-20 12:40:41.321745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a8d960 (9): Bad file descriptor 00:13:08.590 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:08.590 12:40:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.590 12:40:41 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:08.590 12:40:41 -- target/delete_subsystem.sh@35 -- # kill -0 3492156 00:13:08.590 12:40:41 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:08.590 Initializing NVMe Controllers 00:13:08.590 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:08.590 Controller IO queue size 128, less than required. 00:13:08.590 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:08.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:08.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:08.590 Initialization complete. Launching workers. 00:13:08.590 ======================================================== 00:13:08.590 Latency(us) 00:13:08.590 Device Information : IOPS MiB/s Average min max 00:13:08.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 167.70 0.08 902470.52 588.37 1013387.07 00:13:08.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 164.72 0.08 906592.68 1155.39 1013414.71 00:13:08.590 ======================================================== 00:13:08.590 Total : 332.42 0.16 904513.15 588.37 1013414.71 00:13:08.590 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@35 -- # kill -0 3492156 00:13:08.848 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3492156) - No such process 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@45 -- # NOT wait 3492156 00:13:08.848 12:40:41 -- common/autotest_common.sh@650 -- # local es=0 00:13:08.848 12:40:41 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3492156 00:13:08.848 12:40:41 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:08.848 12:40:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:08.848 12:40:41 -- common/autotest_common.sh@642 -- # type -t wait 00:13:08.848 12:40:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:08.848 12:40:41 -- common/autotest_common.sh@653 -- # wait 3492156 00:13:08.848 12:40:41 -- common/autotest_common.sh@653 -- # es=1 00:13:08.848 12:40:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:08.848 12:40:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:08.848 12:40:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:08.848 12:40:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.848 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:13:08.848 12:40:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:08.848 12:40:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.848 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:13:08.848 [2024-11-20 12:40:41.846798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:08.848 12:40:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.848 12:40:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.848 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:13:08.848 12:40:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@54 -- # perf_pid=3492570 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:08.848 12:40:41 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:08.848 EAL: No free 2048 kB hugepages reported on node 1 00:13:08.848 [2024-11-20 12:40:41.908424] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:09.413 12:40:42 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:09.413 12:40:42 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:09.413 12:40:42 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:09.978 12:40:42 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:09.978 12:40:42 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:09.978 12:40:42 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:10.543 12:40:43 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:10.543 12:40:43 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:10.543 12:40:43 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:10.801 12:40:43 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:10.801 12:40:43 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:10.801 12:40:43 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:11.366 12:40:44 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:11.366 12:40:44 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:11.366 12:40:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:11.932 12:40:44 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:11.932 12:40:44 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:11.932 12:40:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:11.932 Initializing NVMe Controllers 00:13:11.932 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:11.932 Controller IO queue size 128, less than required. 00:13:11.932 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:11.932 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:11.932 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:11.932 Initialization complete. Launching workers. 00:13:11.932 ======================================================== 00:13:11.932 Latency(us) 00:13:11.932 Device Information : IOPS MiB/s Average min max 00:13:11.932 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004052.70 1000170.14 1012605.95 00:13:11.932 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005207.80 1000262.89 1042930.03 00:13:11.932 ======================================================== 00:13:11.932 Total : 256.00 0.12 1004630.25 1000170.14 1042930.03 00:13:11.932 00:13:12.498 12:40:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:12.498 12:40:45 -- target/delete_subsystem.sh@57 -- # kill -0 3492570 00:13:12.498 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3492570) - No such process 00:13:12.498 12:40:45 -- target/delete_subsystem.sh@67 -- # wait 3492570 00:13:12.498 12:40:45 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:12.498 12:40:45 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:12.498 12:40:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:12.498 12:40:45 -- nvmf/common.sh@116 -- # sync 00:13:12.498 12:40:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:12.498 12:40:45 -- nvmf/common.sh@119 -- # set +e 00:13:12.498 12:40:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:12.498 12:40:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:12.498 rmmod nvme_tcp 00:13:12.498 rmmod nvme_fabrics 00:13:12.498 rmmod nvme_keyring 00:13:12.498 12:40:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:12.498 12:40:45 -- nvmf/common.sh@123 -- # set -e 00:13:12.498 12:40:45 -- nvmf/common.sh@124 -- # return 0 00:13:12.498 12:40:45 -- nvmf/common.sh@477 -- # '[' -n 3492001 ']' 00:13:12.498 12:40:45 -- nvmf/common.sh@478 -- # killprocess 3492001 00:13:12.498 12:40:45 -- common/autotest_common.sh@936 -- # '[' -z 3492001 ']' 00:13:12.498 12:40:45 -- common/autotest_common.sh@940 -- # kill -0 3492001 00:13:12.498 12:40:45 -- common/autotest_common.sh@941 -- # uname 00:13:12.498 12:40:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:12.498 12:40:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3492001 00:13:12.498 12:40:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:12.498 12:40:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:12.498 12:40:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3492001' 00:13:12.498 killing process with pid 3492001 00:13:12.498 12:40:45 -- common/autotest_common.sh@955 -- # kill 3492001 00:13:12.498 12:40:45 -- common/autotest_common.sh@960 -- # wait 3492001 00:13:12.756 12:40:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:12.756 12:40:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:12.756 12:40:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:12.756 12:40:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:12.756 12:40:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:12.756 12:40:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:12.756 12:40:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:12.756 12:40:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.293 12:40:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:15.293 00:13:15.293 real 0m12.978s 00:13:15.293 user 0m29.591s 00:13:15.293 sys 0m2.760s 00:13:15.293 12:40:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:15.293 12:40:47 -- common/autotest_common.sh@10 -- # set +x 00:13:15.293 ************************************ 00:13:15.293 END TEST nvmf_delete_subsystem 00:13:15.293 ************************************ 00:13:15.293 12:40:47 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:15.293 12:40:47 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:15.293 12:40:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:15.293 12:40:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:15.293 12:40:47 -- common/autotest_common.sh@10 -- # set +x 00:13:15.293 ************************************ 00:13:15.293 START TEST nvmf_nvme_cli 00:13:15.293 ************************************ 00:13:15.293 12:40:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:15.293 * Looking for test storage... 00:13:15.293 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:15.293 12:40:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:15.293 12:40:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:15.293 12:40:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:15.293 12:40:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:15.293 12:40:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:15.293 12:40:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:15.293 12:40:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:15.293 12:40:47 -- scripts/common.sh@335 -- # IFS=.-: 00:13:15.293 12:40:47 -- scripts/common.sh@335 -- # read -ra ver1 00:13:15.293 12:40:47 -- scripts/common.sh@336 -- # IFS=.-: 00:13:15.293 12:40:47 -- scripts/common.sh@336 -- # read -ra ver2 00:13:15.293 12:40:47 -- scripts/common.sh@337 -- # local 'op=<' 00:13:15.293 12:40:47 -- scripts/common.sh@339 -- # ver1_l=2 00:13:15.293 12:40:47 -- scripts/common.sh@340 -- # ver2_l=1 00:13:15.293 12:40:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:15.293 12:40:47 -- scripts/common.sh@343 -- # case "$op" in 00:13:15.293 12:40:47 -- scripts/common.sh@344 -- # : 1 00:13:15.293 12:40:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:15.293 12:40:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:15.293 12:40:47 -- scripts/common.sh@364 -- # decimal 1 00:13:15.293 12:40:47 -- scripts/common.sh@352 -- # local d=1 00:13:15.293 12:40:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:15.293 12:40:47 -- scripts/common.sh@354 -- # echo 1 00:13:15.293 12:40:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:15.293 12:40:47 -- scripts/common.sh@365 -- # decimal 2 00:13:15.293 12:40:47 -- scripts/common.sh@352 -- # local d=2 00:13:15.293 12:40:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:15.293 12:40:47 -- scripts/common.sh@354 -- # echo 2 00:13:15.293 12:40:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:15.293 12:40:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:15.293 12:40:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:15.293 12:40:47 -- scripts/common.sh@367 -- # return 0 00:13:15.293 12:40:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:15.293 12:40:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.293 --rc genhtml_branch_coverage=1 00:13:15.293 --rc genhtml_function_coverage=1 00:13:15.293 --rc genhtml_legend=1 00:13:15.293 --rc geninfo_all_blocks=1 00:13:15.293 --rc geninfo_unexecuted_blocks=1 00:13:15.293 00:13:15.293 ' 00:13:15.293 12:40:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.293 --rc genhtml_branch_coverage=1 00:13:15.293 --rc genhtml_function_coverage=1 00:13:15.293 --rc genhtml_legend=1 00:13:15.293 --rc geninfo_all_blocks=1 00:13:15.293 --rc geninfo_unexecuted_blocks=1 00:13:15.293 00:13:15.293 ' 00:13:15.293 12:40:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.293 --rc genhtml_branch_coverage=1 00:13:15.293 --rc genhtml_function_coverage=1 00:13:15.293 --rc genhtml_legend=1 00:13:15.293 --rc geninfo_all_blocks=1 00:13:15.293 --rc geninfo_unexecuted_blocks=1 00:13:15.293 00:13:15.293 ' 00:13:15.293 12:40:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.293 --rc genhtml_branch_coverage=1 00:13:15.293 --rc genhtml_function_coverage=1 00:13:15.293 --rc genhtml_legend=1 00:13:15.293 --rc geninfo_all_blocks=1 00:13:15.293 --rc geninfo_unexecuted_blocks=1 00:13:15.293 00:13:15.293 ' 00:13:15.293 12:40:47 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:15.293 12:40:47 -- nvmf/common.sh@7 -- # uname -s 00:13:15.293 12:40:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:15.293 12:40:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:15.293 12:40:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:15.293 12:40:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:15.293 12:40:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:15.293 12:40:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:15.293 12:40:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:15.293 12:40:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:15.293 12:40:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:15.293 12:40:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:15.293 12:40:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.293 12:40:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.293 12:40:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:15.293 12:40:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:15.293 12:40:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:15.293 12:40:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:15.293 12:40:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:15.293 12:40:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:15.293 12:40:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:15.293 12:40:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.293 12:40:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.293 12:40:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.293 12:40:47 -- paths/export.sh@5 -- # export PATH 00:13:15.293 12:40:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.293 12:40:47 -- nvmf/common.sh@46 -- # : 0 00:13:15.293 12:40:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:15.293 12:40:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:15.293 12:40:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:15.293 12:40:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:15.293 12:40:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:15.293 12:40:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:15.293 12:40:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:15.293 12:40:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:15.293 12:40:47 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:15.293 12:40:47 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:15.293 12:40:47 -- target/nvme_cli.sh@14 -- # devs=() 00:13:15.293 12:40:47 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:15.293 12:40:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:15.293 12:40:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:15.293 12:40:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:15.293 12:40:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:15.293 12:40:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:15.293 12:40:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.293 12:40:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.293 12:40:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.293 12:40:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:15.293 12:40:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:15.293 12:40:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:15.293 12:40:47 -- common/autotest_common.sh@10 -- # set +x 00:13:17.194 12:40:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:17.194 12:40:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:17.194 12:40:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:17.194 12:40:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:17.194 12:40:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:17.194 12:40:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:17.194 12:40:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:17.194 12:40:49 -- nvmf/common.sh@294 -- # net_devs=() 00:13:17.194 12:40:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:17.194 12:40:49 -- nvmf/common.sh@295 -- # e810=() 00:13:17.194 12:40:49 -- nvmf/common.sh@295 -- # local -ga e810 00:13:17.194 12:40:49 -- nvmf/common.sh@296 -- # x722=() 00:13:17.194 12:40:49 -- nvmf/common.sh@296 -- # local -ga x722 00:13:17.194 12:40:49 -- nvmf/common.sh@297 -- # mlx=() 00:13:17.194 12:40:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:17.194 12:40:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:17.194 12:40:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:17.194 12:40:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:17.194 12:40:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:17.194 12:40:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.194 12:40:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:17.194 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:17.194 12:40:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.194 12:40:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:17.194 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:17.194 12:40:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:17.194 12:40:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.194 12:40:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.194 12:40:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.194 12:40:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.194 12:40:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:17.194 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:17.194 12:40:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.194 12:40:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.194 12:40:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.194 12:40:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.194 12:40:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.194 12:40:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:17.194 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:17.194 12:40:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.194 12:40:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:17.194 12:40:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:17.194 12:40:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:17.194 12:40:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:17.194 12:40:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:17.194 12:40:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:17.194 12:40:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:17.194 12:40:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:17.194 12:40:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:17.194 12:40:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:17.194 12:40:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:17.194 12:40:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:17.194 12:40:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:17.194 12:40:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:17.194 12:40:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:17.194 12:40:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:17.194 12:40:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:17.194 12:40:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:17.194 12:40:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:17.194 12:40:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:17.194 12:40:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:17.194 12:40:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:17.194 12:40:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:17.194 12:40:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:17.194 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:17.194 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:13:17.194 00:13:17.195 --- 10.0.0.2 ping statistics --- 00:13:17.195 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.195 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:13:17.195 12:40:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:17.195 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:17.195 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:13:17.195 00:13:17.195 --- 10.0.0.1 ping statistics --- 00:13:17.195 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.195 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:13:17.195 12:40:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:17.195 12:40:50 -- nvmf/common.sh@410 -- # return 0 00:13:17.195 12:40:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:17.195 12:40:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:17.195 12:40:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:17.195 12:40:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:17.195 12:40:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:17.195 12:40:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:17.195 12:40:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:17.195 12:40:50 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:17.195 12:40:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:17.195 12:40:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:17.195 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:13:17.195 12:40:50 -- nvmf/common.sh@469 -- # nvmfpid=3494946 00:13:17.195 12:40:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:17.195 12:40:50 -- nvmf/common.sh@470 -- # waitforlisten 3494946 00:13:17.195 12:40:50 -- common/autotest_common.sh@829 -- # '[' -z 3494946 ']' 00:13:17.195 12:40:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:17.195 12:40:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:17.195 12:40:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:17.195 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:17.195 12:40:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:17.195 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:13:17.195 [2024-11-20 12:40:50.187781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:17.195 [2024-11-20 12:40:50.187879] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:17.195 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.195 [2024-11-20 12:40:50.258133] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:17.454 [2024-11-20 12:40:50.378786] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:17.454 [2024-11-20 12:40:50.378947] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:17.454 [2024-11-20 12:40:50.378967] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:17.454 [2024-11-20 12:40:50.378982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:17.454 [2024-11-20 12:40:50.379046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:17.454 [2024-11-20 12:40:50.379099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:17.454 [2024-11-20 12:40:50.379149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:17.454 [2024-11-20 12:40:50.379152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:18.388 12:40:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:18.388 12:40:51 -- common/autotest_common.sh@862 -- # return 0 00:13:18.388 12:40:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:18.388 12:40:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 12:40:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.388 12:40:51 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 [2024-11-20 12:40:51.246895] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 Malloc0 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 Malloc1 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 [2024-11-20 12:40:51.328749] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:18.388 12:40:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.388 12:40:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.388 12:40:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.388 12:40:51 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:18.646 00:13:18.646 Discovery Log Number of Records 2, Generation counter 2 00:13:18.646 =====Discovery Log Entry 0====== 00:13:18.646 trtype: tcp 00:13:18.646 adrfam: ipv4 00:13:18.646 subtype: current discovery subsystem 00:13:18.646 treq: not required 00:13:18.646 portid: 0 00:13:18.646 trsvcid: 4420 00:13:18.646 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:18.646 traddr: 10.0.0.2 00:13:18.646 eflags: explicit discovery connections, duplicate discovery information 00:13:18.646 sectype: none 00:13:18.646 =====Discovery Log Entry 1====== 00:13:18.646 trtype: tcp 00:13:18.646 adrfam: ipv4 00:13:18.646 subtype: nvme subsystem 00:13:18.646 treq: not required 00:13:18.646 portid: 0 00:13:18.646 trsvcid: 4420 00:13:18.646 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:18.646 traddr: 10.0.0.2 00:13:18.646 eflags: none 00:13:18.646 sectype: none 00:13:18.646 12:40:51 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:18.646 12:40:51 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:18.646 12:40:51 -- nvmf/common.sh@510 -- # local dev _ 00:13:18.646 12:40:51 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:18.646 12:40:51 -- nvmf/common.sh@509 -- # nvme list 00:13:18.646 12:40:51 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:18.646 12:40:51 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:18.646 12:40:51 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:18.646 12:40:51 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:18.646 12:40:51 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:18.646 12:40:51 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:19.213 12:40:52 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:19.213 12:40:52 -- common/autotest_common.sh@1187 -- # local i=0 00:13:19.213 12:40:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:19.213 12:40:52 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:19.213 12:40:52 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:19.213 12:40:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:21.111 12:40:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:21.111 12:40:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:21.111 12:40:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:21.111 12:40:54 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:21.111 12:40:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:21.111 12:40:54 -- common/autotest_common.sh@1197 -- # return 0 00:13:21.111 12:40:54 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:21.111 12:40:54 -- nvmf/common.sh@510 -- # local dev _ 00:13:21.111 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.111 12:40:54 -- nvmf/common.sh@509 -- # nvme list 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:21.369 /dev/nvme0n2 ]] 00:13:21.369 12:40:54 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:21.369 12:40:54 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:21.369 12:40:54 -- nvmf/common.sh@510 -- # local dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@509 -- # nvme list 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:21.369 12:40:54 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:21.369 12:40:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:21.369 12:40:54 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:21.369 12:40:54 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:21.369 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.369 12:40:54 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:21.369 12:40:54 -- common/autotest_common.sh@1208 -- # local i=0 00:13:21.369 12:40:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:21.369 12:40:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.369 12:40:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:21.369 12:40:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.369 12:40:54 -- common/autotest_common.sh@1220 -- # return 0 00:13:21.369 12:40:54 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:21.369 12:40:54 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:21.369 12:40:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.369 12:40:54 -- common/autotest_common.sh@10 -- # set +x 00:13:21.369 12:40:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.369 12:40:54 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:21.369 12:40:54 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:21.369 12:40:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:21.369 12:40:54 -- nvmf/common.sh@116 -- # sync 00:13:21.369 12:40:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:21.369 12:40:54 -- nvmf/common.sh@119 -- # set +e 00:13:21.369 12:40:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:21.369 12:40:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:21.369 rmmod nvme_tcp 00:13:21.369 rmmod nvme_fabrics 00:13:21.369 rmmod nvme_keyring 00:13:21.369 12:40:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:21.369 12:40:54 -- nvmf/common.sh@123 -- # set -e 00:13:21.369 12:40:54 -- nvmf/common.sh@124 -- # return 0 00:13:21.369 12:40:54 -- nvmf/common.sh@477 -- # '[' -n 3494946 ']' 00:13:21.369 12:40:54 -- nvmf/common.sh@478 -- # killprocess 3494946 00:13:21.369 12:40:54 -- common/autotest_common.sh@936 -- # '[' -z 3494946 ']' 00:13:21.369 12:40:54 -- common/autotest_common.sh@940 -- # kill -0 3494946 00:13:21.369 12:40:54 -- common/autotest_common.sh@941 -- # uname 00:13:21.369 12:40:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:21.369 12:40:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3494946 00:13:21.369 12:40:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:21.369 12:40:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:21.369 12:40:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3494946' 00:13:21.369 killing process with pid 3494946 00:13:21.369 12:40:54 -- common/autotest_common.sh@955 -- # kill 3494946 00:13:21.369 12:40:54 -- common/autotest_common.sh@960 -- # wait 3494946 00:13:21.936 12:40:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:21.936 12:40:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:21.936 12:40:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:21.936 12:40:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:21.936 12:40:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:21.936 12:40:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:21.936 12:40:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:21.936 12:40:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:23.841 12:40:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:23.841 00:13:23.841 real 0m8.977s 00:13:23.841 user 0m18.056s 00:13:23.841 sys 0m2.301s 00:13:23.841 12:40:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:23.841 12:40:56 -- common/autotest_common.sh@10 -- # set +x 00:13:23.841 ************************************ 00:13:23.841 END TEST nvmf_nvme_cli 00:13:23.841 ************************************ 00:13:23.841 12:40:56 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:23.841 12:40:56 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:23.841 12:40:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:23.841 12:40:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:23.841 12:40:56 -- common/autotest_common.sh@10 -- # set +x 00:13:23.841 ************************************ 00:13:23.841 START TEST nvmf_host_management 00:13:23.841 ************************************ 00:13:23.841 12:40:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:23.841 * Looking for test storage... 00:13:23.841 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:23.841 12:40:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:23.841 12:40:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:23.841 12:40:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:24.099 12:40:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:24.099 12:40:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:24.099 12:40:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:24.099 12:40:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:24.099 12:40:56 -- scripts/common.sh@335 -- # IFS=.-: 00:13:24.100 12:40:56 -- scripts/common.sh@335 -- # read -ra ver1 00:13:24.100 12:40:56 -- scripts/common.sh@336 -- # IFS=.-: 00:13:24.100 12:40:56 -- scripts/common.sh@336 -- # read -ra ver2 00:13:24.100 12:40:56 -- scripts/common.sh@337 -- # local 'op=<' 00:13:24.100 12:40:56 -- scripts/common.sh@339 -- # ver1_l=2 00:13:24.100 12:40:56 -- scripts/common.sh@340 -- # ver2_l=1 00:13:24.100 12:40:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:24.100 12:40:56 -- scripts/common.sh@343 -- # case "$op" in 00:13:24.100 12:40:56 -- scripts/common.sh@344 -- # : 1 00:13:24.100 12:40:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:24.100 12:40:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:24.100 12:40:56 -- scripts/common.sh@364 -- # decimal 1 00:13:24.100 12:40:56 -- scripts/common.sh@352 -- # local d=1 00:13:24.100 12:40:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:24.100 12:40:56 -- scripts/common.sh@354 -- # echo 1 00:13:24.100 12:40:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:24.100 12:40:56 -- scripts/common.sh@365 -- # decimal 2 00:13:24.100 12:40:56 -- scripts/common.sh@352 -- # local d=2 00:13:24.100 12:40:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:24.100 12:40:56 -- scripts/common.sh@354 -- # echo 2 00:13:24.100 12:40:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:24.100 12:40:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:24.100 12:40:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:24.100 12:40:56 -- scripts/common.sh@367 -- # return 0 00:13:24.100 12:40:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:24.100 12:40:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:24.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.100 --rc genhtml_branch_coverage=1 00:13:24.100 --rc genhtml_function_coverage=1 00:13:24.100 --rc genhtml_legend=1 00:13:24.100 --rc geninfo_all_blocks=1 00:13:24.100 --rc geninfo_unexecuted_blocks=1 00:13:24.100 00:13:24.100 ' 00:13:24.100 12:40:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:24.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.100 --rc genhtml_branch_coverage=1 00:13:24.100 --rc genhtml_function_coverage=1 00:13:24.100 --rc genhtml_legend=1 00:13:24.100 --rc geninfo_all_blocks=1 00:13:24.100 --rc geninfo_unexecuted_blocks=1 00:13:24.100 00:13:24.100 ' 00:13:24.100 12:40:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:24.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.100 --rc genhtml_branch_coverage=1 00:13:24.100 --rc genhtml_function_coverage=1 00:13:24.100 --rc genhtml_legend=1 00:13:24.100 --rc geninfo_all_blocks=1 00:13:24.100 --rc geninfo_unexecuted_blocks=1 00:13:24.100 00:13:24.100 ' 00:13:24.100 12:40:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:24.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.100 --rc genhtml_branch_coverage=1 00:13:24.100 --rc genhtml_function_coverage=1 00:13:24.100 --rc genhtml_legend=1 00:13:24.100 --rc geninfo_all_blocks=1 00:13:24.100 --rc geninfo_unexecuted_blocks=1 00:13:24.100 00:13:24.100 ' 00:13:24.100 12:40:56 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:24.100 12:40:56 -- nvmf/common.sh@7 -- # uname -s 00:13:24.100 12:40:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:24.100 12:40:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:24.100 12:40:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:24.100 12:40:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:24.100 12:40:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:24.100 12:40:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:24.100 12:40:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:24.100 12:40:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:24.100 12:40:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:24.100 12:40:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:24.100 12:40:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:24.100 12:40:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:24.100 12:40:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:24.100 12:40:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:24.100 12:40:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:24.100 12:40:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:24.100 12:40:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:24.100 12:40:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:24.100 12:40:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:24.100 12:40:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.100 12:40:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.100 12:40:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.100 12:40:56 -- paths/export.sh@5 -- # export PATH 00:13:24.100 12:40:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.100 12:40:56 -- nvmf/common.sh@46 -- # : 0 00:13:24.100 12:40:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:24.100 12:40:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:24.100 12:40:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:24.100 12:40:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:24.100 12:40:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:24.100 12:40:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:24.100 12:40:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:24.100 12:40:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:24.100 12:40:56 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:24.100 12:40:56 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:24.100 12:40:56 -- target/host_management.sh@104 -- # nvmftestinit 00:13:24.100 12:40:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:24.100 12:40:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:24.100 12:40:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:24.100 12:40:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:24.100 12:40:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:24.100 12:40:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:24.100 12:40:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:24.100 12:40:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:24.100 12:40:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:24.100 12:40:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:24.100 12:40:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:24.100 12:40:56 -- common/autotest_common.sh@10 -- # set +x 00:13:26.003 12:40:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:26.003 12:40:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:26.003 12:40:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:26.003 12:40:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:26.003 12:40:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:26.003 12:40:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:26.003 12:40:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:26.003 12:40:59 -- nvmf/common.sh@294 -- # net_devs=() 00:13:26.003 12:40:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:26.003 12:40:59 -- nvmf/common.sh@295 -- # e810=() 00:13:26.003 12:40:59 -- nvmf/common.sh@295 -- # local -ga e810 00:13:26.003 12:40:59 -- nvmf/common.sh@296 -- # x722=() 00:13:26.003 12:40:59 -- nvmf/common.sh@296 -- # local -ga x722 00:13:26.003 12:40:59 -- nvmf/common.sh@297 -- # mlx=() 00:13:26.003 12:40:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:26.003 12:40:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:26.003 12:40:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:26.003 12:40:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:26.003 12:40:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:26.003 12:40:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:26.003 12:40:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:26.003 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:26.003 12:40:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:26.003 12:40:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:26.003 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:26.003 12:40:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:26.003 12:40:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:26.003 12:40:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:26.003 12:40:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:26.003 12:40:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:26.003 12:40:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:26.003 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:26.003 12:40:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:26.003 12:40:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:26.003 12:40:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:26.003 12:40:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:26.003 12:40:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:26.003 12:40:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:26.003 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:26.003 12:40:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:26.003 12:40:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:26.003 12:40:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:26.003 12:40:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:26.003 12:40:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:26.003 12:40:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:26.003 12:40:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:26.003 12:40:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:26.003 12:40:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:26.003 12:40:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:26.003 12:40:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:26.003 12:40:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:26.003 12:40:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:26.003 12:40:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:26.003 12:40:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:26.003 12:40:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:26.003 12:40:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:26.003 12:40:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:26.260 12:40:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:26.260 12:40:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:26.260 12:40:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:26.260 12:40:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:26.260 12:40:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:26.260 12:40:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:26.260 12:40:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:26.260 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:26.260 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.345 ms 00:13:26.260 00:13:26.260 --- 10.0.0.2 ping statistics --- 00:13:26.260 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:26.260 rtt min/avg/max/mdev = 0.345/0.345/0.345/0.000 ms 00:13:26.260 12:40:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:26.260 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:26.260 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.202 ms 00:13:26.260 00:13:26.260 --- 10.0.0.1 ping statistics --- 00:13:26.260 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:26.260 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:13:26.260 12:40:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:26.260 12:40:59 -- nvmf/common.sh@410 -- # return 0 00:13:26.260 12:40:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:26.260 12:40:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:26.260 12:40:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:26.260 12:40:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:26.260 12:40:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:26.260 12:40:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:26.260 12:40:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:26.260 12:40:59 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:26.260 12:40:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:26.260 12:40:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:26.260 12:40:59 -- common/autotest_common.sh@10 -- # set +x 00:13:26.260 ************************************ 00:13:26.260 START TEST nvmf_host_management 00:13:26.260 ************************************ 00:13:26.260 12:40:59 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:13:26.260 12:40:59 -- target/host_management.sh@69 -- # starttarget 00:13:26.261 12:40:59 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:26.261 12:40:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:26.261 12:40:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:26.261 12:40:59 -- common/autotest_common.sh@10 -- # set +x 00:13:26.261 12:40:59 -- nvmf/common.sh@469 -- # nvmfpid=3497482 00:13:26.261 12:40:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:26.261 12:40:59 -- nvmf/common.sh@470 -- # waitforlisten 3497482 00:13:26.261 12:40:59 -- common/autotest_common.sh@829 -- # '[' -z 3497482 ']' 00:13:26.261 12:40:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:26.261 12:40:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:26.261 12:40:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:26.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:26.261 12:40:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:26.261 12:40:59 -- common/autotest_common.sh@10 -- # set +x 00:13:26.261 [2024-11-20 12:40:59.280226] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:26.261 [2024-11-20 12:40:59.280298] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:26.261 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.261 [2024-11-20 12:40:59.346899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:26.518 [2024-11-20 12:40:59.465858] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:26.518 [2024-11-20 12:40:59.465991] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:26.518 [2024-11-20 12:40:59.466019] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:26.518 [2024-11-20 12:40:59.466033] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:26.518 [2024-11-20 12:40:59.466104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:26.518 [2024-11-20 12:40:59.466137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:26.518 [2024-11-20 12:40:59.466164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:26.518 [2024-11-20 12:40:59.466168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:27.451 12:41:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:27.451 12:41:00 -- common/autotest_common.sh@862 -- # return 0 00:13:27.451 12:41:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:27.451 12:41:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:27.451 12:41:00 -- common/autotest_common.sh@10 -- # set +x 00:13:27.451 12:41:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:27.451 12:41:00 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:27.452 12:41:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.452 12:41:00 -- common/autotest_common.sh@10 -- # set +x 00:13:27.452 [2024-11-20 12:41:00.287650] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:27.452 12:41:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.452 12:41:00 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:27.452 12:41:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:27.452 12:41:00 -- common/autotest_common.sh@10 -- # set +x 00:13:27.452 12:41:00 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:27.452 12:41:00 -- target/host_management.sh@23 -- # cat 00:13:27.452 12:41:00 -- target/host_management.sh@30 -- # rpc_cmd 00:13:27.452 12:41:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.452 12:41:00 -- common/autotest_common.sh@10 -- # set +x 00:13:27.452 Malloc0 00:13:27.452 [2024-11-20 12:41:00.349432] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:27.452 12:41:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.452 12:41:00 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:27.452 12:41:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:27.452 12:41:00 -- common/autotest_common.sh@10 -- # set +x 00:13:27.452 12:41:00 -- target/host_management.sh@73 -- # perfpid=3497666 00:13:27.452 12:41:00 -- target/host_management.sh@74 -- # waitforlisten 3497666 /var/tmp/bdevperf.sock 00:13:27.452 12:41:00 -- common/autotest_common.sh@829 -- # '[' -z 3497666 ']' 00:13:27.452 12:41:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:27.452 12:41:00 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:27.452 12:41:00 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:27.452 12:41:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:27.452 12:41:00 -- nvmf/common.sh@520 -- # config=() 00:13:27.452 12:41:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:27.452 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:27.452 12:41:00 -- nvmf/common.sh@520 -- # local subsystem config 00:13:27.452 12:41:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:27.452 12:41:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:27.452 12:41:00 -- common/autotest_common.sh@10 -- # set +x 00:13:27.452 12:41:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:27.452 { 00:13:27.452 "params": { 00:13:27.452 "name": "Nvme$subsystem", 00:13:27.452 "trtype": "$TEST_TRANSPORT", 00:13:27.452 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:27.452 "adrfam": "ipv4", 00:13:27.452 "trsvcid": "$NVMF_PORT", 00:13:27.452 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:27.452 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:27.452 "hdgst": ${hdgst:-false}, 00:13:27.452 "ddgst": ${ddgst:-false} 00:13:27.452 }, 00:13:27.452 "method": "bdev_nvme_attach_controller" 00:13:27.452 } 00:13:27.452 EOF 00:13:27.452 )") 00:13:27.452 12:41:00 -- nvmf/common.sh@542 -- # cat 00:13:27.452 12:41:00 -- nvmf/common.sh@544 -- # jq . 00:13:27.452 12:41:00 -- nvmf/common.sh@545 -- # IFS=, 00:13:27.452 12:41:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:27.452 "params": { 00:13:27.452 "name": "Nvme0", 00:13:27.452 "trtype": "tcp", 00:13:27.452 "traddr": "10.0.0.2", 00:13:27.452 "adrfam": "ipv4", 00:13:27.452 "trsvcid": "4420", 00:13:27.452 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:27.452 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:27.452 "hdgst": false, 00:13:27.452 "ddgst": false 00:13:27.452 }, 00:13:27.452 "method": "bdev_nvme_attach_controller" 00:13:27.452 }' 00:13:27.452 [2024-11-20 12:41:00.426612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:27.452 [2024-11-20 12:41:00.426710] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3497666 ] 00:13:27.452 EAL: No free 2048 kB hugepages reported on node 1 00:13:27.452 [2024-11-20 12:41:00.491162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:27.709 [2024-11-20 12:41:00.601968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:27.967 Running I/O for 10 seconds... 00:13:28.535 12:41:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:28.535 12:41:01 -- common/autotest_common.sh@862 -- # return 0 00:13:28.535 12:41:01 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:28.535 12:41:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.535 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:13:28.535 12:41:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.535 12:41:01 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:28.535 12:41:01 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:28.535 12:41:01 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:28.535 12:41:01 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:28.535 12:41:01 -- target/host_management.sh@52 -- # local ret=1 00:13:28.535 12:41:01 -- target/host_management.sh@53 -- # local i 00:13:28.535 12:41:01 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:28.535 12:41:01 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:28.535 12:41:01 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:28.535 12:41:01 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:28.535 12:41:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.535 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:13:28.535 12:41:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.535 12:41:01 -- target/host_management.sh@55 -- # read_io_count=2477 00:13:28.535 12:41:01 -- target/host_management.sh@58 -- # '[' 2477 -ge 100 ']' 00:13:28.535 12:41:01 -- target/host_management.sh@59 -- # ret=0 00:13:28.535 12:41:01 -- target/host_management.sh@60 -- # break 00:13:28.535 12:41:01 -- target/host_management.sh@64 -- # return 0 00:13:28.535 12:41:01 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:28.535 12:41:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.535 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:13:28.535 [2024-11-20 12:41:01.481617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2303e60 is same with the state(5) to be set 00:13:28.535 [2024-11-20 12:41:01.481677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2303e60 is same with the state(5) to be set 00:13:28.535 [2024-11-20 12:41:01.481693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2303e60 is same with the state(5) to be set 00:13:28.535 [2024-11-20 12:41:01.481707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2303e60 is same with the state(5) to be set 00:13:28.535 12:41:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.535 12:41:01 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:28.535 [2024-11-20 12:41:01.485765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.485807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 12:41:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.535 [2024-11-20 12:41:01.485837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.485857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.485875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.485898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.485914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.485929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:13:28.535 [2024-11-20 12:41:01.485944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.485960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.485975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.485989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.535 [2024-11-20 12:41:01.486328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.535 [2024-11-20 12:41:01.486343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.486973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.486988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:77952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:78208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:78592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:79488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:79872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:80128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:28.536 [2024-11-20 12:41:01.487732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487820] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x23d9030 was disconnected and freed. reset controller. 00:13:28.536 [2024-11-20 12:41:01.487892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:13:28.536 [2024-11-20 12:41:01.487914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:13:28.536 [2024-11-20 12:41:01.487942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:13:28.536 [2024-11-20 12:41:01.487969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.487983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:13:28.536 [2024-11-20 12:41:01.487995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:28.536 [2024-11-20 12:41:01.488013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23db160 is same with the state(5) to be set 00:13:28.536 [2024-11-20 12:41:01.489131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:28.536 task offset: 73088 on job bdev=Nvme0n1 fails 00:13:28.536 00:13:28.536 Latency(us) 00:13:28.536 [2024-11-20T11:41:01.644Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:28.536 [2024-11-20T11:41:01.644Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:28.536 [2024-11-20T11:41:01.644Z] Job: Nvme0n1 ended in about 0.66 seconds with error 00:13:28.536 Verification LBA range: start 0x0 length 0x400 00:13:28.536 Nvme0n1 : 0.66 3934.52 245.91 96.40 0.00 15640.99 2633.58 23787.14 00:13:28.536 [2024-11-20T11:41:01.645Z] =================================================================================================================== 00:13:28.537 [2024-11-20T11:41:01.645Z] Total : 3934.52 245.91 96.40 0.00 15640.99 2633.58 23787.14 00:13:28.537 [2024-11-20 12:41:01.490984] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:28.537 [2024-11-20 12:41:01.491026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23db160 (9): Bad file descriptor 00:13:28.537 12:41:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.537 12:41:01 -- target/host_management.sh@87 -- # sleep 1 00:13:28.537 [2024-11-20 12:41:01.535504] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:29.470 12:41:02 -- target/host_management.sh@91 -- # kill -9 3497666 00:13:29.470 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3497666) - No such process 00:13:29.470 12:41:02 -- target/host_management.sh@91 -- # true 00:13:29.470 12:41:02 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:29.470 12:41:02 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:29.470 12:41:02 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:29.470 12:41:02 -- nvmf/common.sh@520 -- # config=() 00:13:29.470 12:41:02 -- nvmf/common.sh@520 -- # local subsystem config 00:13:29.470 12:41:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:29.470 12:41:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:29.470 { 00:13:29.470 "params": { 00:13:29.470 "name": "Nvme$subsystem", 00:13:29.470 "trtype": "$TEST_TRANSPORT", 00:13:29.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:29.470 "adrfam": "ipv4", 00:13:29.470 "trsvcid": "$NVMF_PORT", 00:13:29.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:29.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:29.470 "hdgst": ${hdgst:-false}, 00:13:29.470 "ddgst": ${ddgst:-false} 00:13:29.470 }, 00:13:29.470 "method": "bdev_nvme_attach_controller" 00:13:29.470 } 00:13:29.470 EOF 00:13:29.470 )") 00:13:29.470 12:41:02 -- nvmf/common.sh@542 -- # cat 00:13:29.470 12:41:02 -- nvmf/common.sh@544 -- # jq . 00:13:29.470 12:41:02 -- nvmf/common.sh@545 -- # IFS=, 00:13:29.470 12:41:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:29.470 "params": { 00:13:29.470 "name": "Nvme0", 00:13:29.470 "trtype": "tcp", 00:13:29.470 "traddr": "10.0.0.2", 00:13:29.470 "adrfam": "ipv4", 00:13:29.470 "trsvcid": "4420", 00:13:29.470 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:29.470 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:29.470 "hdgst": false, 00:13:29.470 "ddgst": false 00:13:29.470 }, 00:13:29.470 "method": "bdev_nvme_attach_controller" 00:13:29.470 }' 00:13:29.470 [2024-11-20 12:41:02.539127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:29.470 [2024-11-20 12:41:02.539201] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3497949 ] 00:13:29.470 EAL: No free 2048 kB hugepages reported on node 1 00:13:29.728 [2024-11-20 12:41:02.598983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:29.728 [2024-11-20 12:41:02.707157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:29.985 Running I/O for 1 seconds... 00:13:31.361 00:13:31.361 Latency(us) 00:13:31.361 [2024-11-20T11:41:04.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:31.361 [2024-11-20T11:41:04.469Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:31.361 Verification LBA range: start 0x0 length 0x400 00:13:31.361 Nvme0n1 : 1.01 4019.43 251.21 0.00 0.00 15656.92 2148.12 23010.42 00:13:31.361 [2024-11-20T11:41:04.469Z] =================================================================================================================== 00:13:31.361 [2024-11-20T11:41:04.469Z] Total : 4019.43 251.21 0.00 0.00 15656.92 2148.12 23010.42 00:13:31.361 12:41:04 -- target/host_management.sh@101 -- # stoptarget 00:13:31.361 12:41:04 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:31.361 12:41:04 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:31.361 12:41:04 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:31.361 12:41:04 -- target/host_management.sh@40 -- # nvmftestfini 00:13:31.361 12:41:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:31.361 12:41:04 -- nvmf/common.sh@116 -- # sync 00:13:31.361 12:41:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:31.361 12:41:04 -- nvmf/common.sh@119 -- # set +e 00:13:31.361 12:41:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:31.361 12:41:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:31.361 rmmod nvme_tcp 00:13:31.361 rmmod nvme_fabrics 00:13:31.361 rmmod nvme_keyring 00:13:31.361 12:41:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:31.361 12:41:04 -- nvmf/common.sh@123 -- # set -e 00:13:31.361 12:41:04 -- nvmf/common.sh@124 -- # return 0 00:13:31.361 12:41:04 -- nvmf/common.sh@477 -- # '[' -n 3497482 ']' 00:13:31.361 12:41:04 -- nvmf/common.sh@478 -- # killprocess 3497482 00:13:31.361 12:41:04 -- common/autotest_common.sh@936 -- # '[' -z 3497482 ']' 00:13:31.361 12:41:04 -- common/autotest_common.sh@940 -- # kill -0 3497482 00:13:31.361 12:41:04 -- common/autotest_common.sh@941 -- # uname 00:13:31.361 12:41:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:31.361 12:41:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3497482 00:13:31.361 12:41:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:31.361 12:41:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:31.361 12:41:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3497482' 00:13:31.361 killing process with pid 3497482 00:13:31.361 12:41:04 -- common/autotest_common.sh@955 -- # kill 3497482 00:13:31.361 12:41:04 -- common/autotest_common.sh@960 -- # wait 3497482 00:13:31.620 [2024-11-20 12:41:04.717052] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:31.879 12:41:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:31.879 12:41:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:31.879 12:41:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:31.879 12:41:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:31.879 12:41:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:31.879 12:41:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:31.879 12:41:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:31.879 12:41:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:33.793 12:41:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:33.793 00:13:33.793 real 0m7.557s 00:13:33.793 user 0m23.596s 00:13:33.793 sys 0m1.516s 00:13:33.793 12:41:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:33.793 12:41:06 -- common/autotest_common.sh@10 -- # set +x 00:13:33.793 ************************************ 00:13:33.793 END TEST nvmf_host_management 00:13:33.793 ************************************ 00:13:33.793 12:41:06 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:33.793 00:13:33.793 real 0m9.997s 00:13:33.793 user 0m24.518s 00:13:33.793 sys 0m3.071s 00:13:33.793 12:41:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:33.793 12:41:06 -- common/autotest_common.sh@10 -- # set +x 00:13:33.793 ************************************ 00:13:33.793 END TEST nvmf_host_management 00:13:33.793 ************************************ 00:13:33.793 12:41:06 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:33.793 12:41:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:33.793 12:41:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:33.793 12:41:06 -- common/autotest_common.sh@10 -- # set +x 00:13:33.793 ************************************ 00:13:33.793 START TEST nvmf_lvol 00:13:33.793 ************************************ 00:13:33.793 12:41:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:33.793 * Looking for test storage... 00:13:33.793 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:33.793 12:41:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:34.052 12:41:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:34.052 12:41:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:34.052 12:41:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:34.052 12:41:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:34.052 12:41:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:34.052 12:41:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:34.052 12:41:06 -- scripts/common.sh@335 -- # IFS=.-: 00:13:34.052 12:41:06 -- scripts/common.sh@335 -- # read -ra ver1 00:13:34.052 12:41:06 -- scripts/common.sh@336 -- # IFS=.-: 00:13:34.052 12:41:06 -- scripts/common.sh@336 -- # read -ra ver2 00:13:34.052 12:41:06 -- scripts/common.sh@337 -- # local 'op=<' 00:13:34.052 12:41:06 -- scripts/common.sh@339 -- # ver1_l=2 00:13:34.052 12:41:06 -- scripts/common.sh@340 -- # ver2_l=1 00:13:34.052 12:41:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:34.052 12:41:06 -- scripts/common.sh@343 -- # case "$op" in 00:13:34.052 12:41:06 -- scripts/common.sh@344 -- # : 1 00:13:34.052 12:41:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:34.052 12:41:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:34.052 12:41:06 -- scripts/common.sh@364 -- # decimal 1 00:13:34.052 12:41:06 -- scripts/common.sh@352 -- # local d=1 00:13:34.052 12:41:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:34.052 12:41:06 -- scripts/common.sh@354 -- # echo 1 00:13:34.052 12:41:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:34.052 12:41:06 -- scripts/common.sh@365 -- # decimal 2 00:13:34.052 12:41:06 -- scripts/common.sh@352 -- # local d=2 00:13:34.052 12:41:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:34.052 12:41:06 -- scripts/common.sh@354 -- # echo 2 00:13:34.052 12:41:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:34.052 12:41:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:34.052 12:41:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:34.052 12:41:06 -- scripts/common.sh@367 -- # return 0 00:13:34.052 12:41:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:34.052 12:41:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:34.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.052 --rc genhtml_branch_coverage=1 00:13:34.052 --rc genhtml_function_coverage=1 00:13:34.052 --rc genhtml_legend=1 00:13:34.052 --rc geninfo_all_blocks=1 00:13:34.052 --rc geninfo_unexecuted_blocks=1 00:13:34.052 00:13:34.052 ' 00:13:34.052 12:41:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:34.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.052 --rc genhtml_branch_coverage=1 00:13:34.052 --rc genhtml_function_coverage=1 00:13:34.052 --rc genhtml_legend=1 00:13:34.052 --rc geninfo_all_blocks=1 00:13:34.052 --rc geninfo_unexecuted_blocks=1 00:13:34.052 00:13:34.052 ' 00:13:34.052 12:41:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:34.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.052 --rc genhtml_branch_coverage=1 00:13:34.052 --rc genhtml_function_coverage=1 00:13:34.052 --rc genhtml_legend=1 00:13:34.052 --rc geninfo_all_blocks=1 00:13:34.052 --rc geninfo_unexecuted_blocks=1 00:13:34.052 00:13:34.052 ' 00:13:34.052 12:41:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:34.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.052 --rc genhtml_branch_coverage=1 00:13:34.052 --rc genhtml_function_coverage=1 00:13:34.052 --rc genhtml_legend=1 00:13:34.052 --rc geninfo_all_blocks=1 00:13:34.052 --rc geninfo_unexecuted_blocks=1 00:13:34.052 00:13:34.052 ' 00:13:34.053 12:41:06 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:34.053 12:41:06 -- nvmf/common.sh@7 -- # uname -s 00:13:34.053 12:41:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:34.053 12:41:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:34.053 12:41:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:34.053 12:41:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:34.053 12:41:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:34.053 12:41:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:34.053 12:41:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:34.053 12:41:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:34.053 12:41:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:34.053 12:41:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:34.053 12:41:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:34.053 12:41:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:34.053 12:41:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:34.053 12:41:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:34.053 12:41:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:34.053 12:41:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:34.053 12:41:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:34.053 12:41:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:34.053 12:41:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:34.053 12:41:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.053 12:41:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.053 12:41:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.053 12:41:07 -- paths/export.sh@5 -- # export PATH 00:13:34.053 12:41:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.053 12:41:07 -- nvmf/common.sh@46 -- # : 0 00:13:34.053 12:41:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:34.053 12:41:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:34.053 12:41:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:34.053 12:41:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:34.053 12:41:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:34.053 12:41:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:34.053 12:41:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:34.053 12:41:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:34.053 12:41:07 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:34.053 12:41:07 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:34.053 12:41:07 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:34.053 12:41:07 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:34.053 12:41:07 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:34.053 12:41:07 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:34.053 12:41:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:34.053 12:41:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:34.053 12:41:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:34.053 12:41:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:34.053 12:41:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:34.053 12:41:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.053 12:41:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.053 12:41:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:34.053 12:41:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:34.053 12:41:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:34.053 12:41:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:34.053 12:41:07 -- common/autotest_common.sh@10 -- # set +x 00:13:35.953 12:41:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:35.953 12:41:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:35.953 12:41:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:35.953 12:41:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:35.953 12:41:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:35.953 12:41:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:35.953 12:41:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:35.953 12:41:09 -- nvmf/common.sh@294 -- # net_devs=() 00:13:35.953 12:41:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:35.953 12:41:09 -- nvmf/common.sh@295 -- # e810=() 00:13:35.953 12:41:09 -- nvmf/common.sh@295 -- # local -ga e810 00:13:35.953 12:41:09 -- nvmf/common.sh@296 -- # x722=() 00:13:35.953 12:41:09 -- nvmf/common.sh@296 -- # local -ga x722 00:13:35.953 12:41:09 -- nvmf/common.sh@297 -- # mlx=() 00:13:35.953 12:41:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:35.953 12:41:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:35.953 12:41:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:35.953 12:41:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:35.953 12:41:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:35.953 12:41:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:35.953 12:41:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:35.953 12:41:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:35.953 12:41:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.953 12:41:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:35.954 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:35.954 12:41:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.954 12:41:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:35.954 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:35.954 12:41:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:35.954 12:41:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.954 12:41:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.954 12:41:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.954 12:41:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.954 12:41:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:35.954 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:35.954 12:41:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.954 12:41:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.954 12:41:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.954 12:41:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.954 12:41:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.954 12:41:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:35.954 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:35.954 12:41:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.954 12:41:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:35.954 12:41:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:35.954 12:41:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:35.954 12:41:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:35.954 12:41:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:35.954 12:41:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:35.954 12:41:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:35.954 12:41:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:35.954 12:41:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:35.954 12:41:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:35.954 12:41:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:35.954 12:41:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:35.954 12:41:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:35.954 12:41:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:35.954 12:41:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:35.954 12:41:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:35.954 12:41:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:36.212 12:41:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:36.212 12:41:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:36.212 12:41:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:36.212 12:41:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:36.212 12:41:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:36.212 12:41:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:36.212 12:41:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:36.212 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:36.212 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:13:36.212 00:13:36.212 --- 10.0.0.2 ping statistics --- 00:13:36.212 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:36.212 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:13:36.213 12:41:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:36.213 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:36.213 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:13:36.213 00:13:36.213 --- 10.0.0.1 ping statistics --- 00:13:36.213 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:36.213 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:13:36.213 12:41:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:36.213 12:41:09 -- nvmf/common.sh@410 -- # return 0 00:13:36.213 12:41:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:36.213 12:41:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:36.213 12:41:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:36.213 12:41:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:36.213 12:41:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:36.213 12:41:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:36.213 12:41:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:36.213 12:41:09 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:36.213 12:41:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:36.213 12:41:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:36.213 12:41:09 -- common/autotest_common.sh@10 -- # set +x 00:13:36.213 12:41:09 -- nvmf/common.sh@469 -- # nvmfpid=3500187 00:13:36.213 12:41:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:36.213 12:41:09 -- nvmf/common.sh@470 -- # waitforlisten 3500187 00:13:36.213 12:41:09 -- common/autotest_common.sh@829 -- # '[' -z 3500187 ']' 00:13:36.213 12:41:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:36.213 12:41:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:36.213 12:41:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:36.213 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:36.213 12:41:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:36.213 12:41:09 -- common/autotest_common.sh@10 -- # set +x 00:13:36.213 [2024-11-20 12:41:09.238443] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:36.213 [2024-11-20 12:41:09.238537] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:36.213 EAL: No free 2048 kB hugepages reported on node 1 00:13:36.213 [2024-11-20 12:41:09.303280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:36.470 [2024-11-20 12:41:09.414324] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:36.470 [2024-11-20 12:41:09.414491] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:36.470 [2024-11-20 12:41:09.414509] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:36.470 [2024-11-20 12:41:09.414521] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:36.470 [2024-11-20 12:41:09.414578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:36.470 [2024-11-20 12:41:09.414640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:36.470 [2024-11-20 12:41:09.414643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:37.402 12:41:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:37.402 12:41:10 -- common/autotest_common.sh@862 -- # return 0 00:13:37.402 12:41:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:37.402 12:41:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:37.402 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:13:37.402 12:41:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:37.402 12:41:10 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:37.660 [2024-11-20 12:41:10.510892] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:37.660 12:41:10 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:37.918 12:41:10 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:37.918 12:41:10 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:38.177 12:41:11 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:38.177 12:41:11 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:38.435 12:41:11 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:38.694 12:41:11 -- target/nvmf_lvol.sh@29 -- # lvs=5fa7d435-6254-4ac6-baaa-234d652f0203 00:13:38.694 12:41:11 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 5fa7d435-6254-4ac6-baaa-234d652f0203 lvol 20 00:13:38.953 12:41:11 -- target/nvmf_lvol.sh@32 -- # lvol=ba4505a1-73e4-4426-8ed3-cb04ebb571a4 00:13:38.953 12:41:11 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:39.211 12:41:12 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ba4505a1-73e4-4426-8ed3-cb04ebb571a4 00:13:39.468 12:41:12 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:39.727 [2024-11-20 12:41:12.586592] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:39.727 12:41:12 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:39.985 12:41:12 -- target/nvmf_lvol.sh@42 -- # perf_pid=3500637 00:13:39.985 12:41:12 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:39.985 12:41:12 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:39.985 EAL: No free 2048 kB hugepages reported on node 1 00:13:40.924 12:41:13 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot ba4505a1-73e4-4426-8ed3-cb04ebb571a4 MY_SNAPSHOT 00:13:41.183 12:41:14 -- target/nvmf_lvol.sh@47 -- # snapshot=79c8af1a-7b44-49b3-bbf3-54f10126f885 00:13:41.183 12:41:14 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize ba4505a1-73e4-4426-8ed3-cb04ebb571a4 30 00:13:41.442 12:41:14 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 79c8af1a-7b44-49b3-bbf3-54f10126f885 MY_CLONE 00:13:41.701 12:41:14 -- target/nvmf_lvol.sh@49 -- # clone=ec0d7f66-2824-4911-aae2-ea81651fe43e 00:13:41.701 12:41:14 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate ec0d7f66-2824-4911-aae2-ea81651fe43e 00:13:42.270 12:41:15 -- target/nvmf_lvol.sh@53 -- # wait 3500637 00:13:50.393 Initializing NVMe Controllers 00:13:50.393 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:50.393 Controller IO queue size 128, less than required. 00:13:50.393 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:50.393 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:13:50.393 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:13:50.393 Initialization complete. Launching workers. 00:13:50.393 ======================================================== 00:13:50.393 Latency(us) 00:13:50.393 Device Information : IOPS MiB/s Average min max 00:13:50.393 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10755.10 42.01 11903.43 2087.66 93320.71 00:13:50.393 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10777.90 42.10 11884.13 2124.19 67064.28 00:13:50.393 ======================================================== 00:13:50.393 Total : 21533.00 84.11 11893.77 2087.66 93320.71 00:13:50.393 00:13:50.393 12:41:23 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:50.393 12:41:23 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ba4505a1-73e4-4426-8ed3-cb04ebb571a4 00:13:50.652 12:41:23 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 5fa7d435-6254-4ac6-baaa-234d652f0203 00:13:50.910 12:41:23 -- target/nvmf_lvol.sh@60 -- # rm -f 00:13:50.910 12:41:23 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:13:50.910 12:41:23 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:13:50.910 12:41:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.910 12:41:23 -- nvmf/common.sh@116 -- # sync 00:13:50.910 12:41:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.910 12:41:23 -- nvmf/common.sh@119 -- # set +e 00:13:50.910 12:41:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.910 12:41:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.910 rmmod nvme_tcp 00:13:50.910 rmmod nvme_fabrics 00:13:50.910 rmmod nvme_keyring 00:13:51.168 12:41:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:51.168 12:41:24 -- nvmf/common.sh@123 -- # set -e 00:13:51.168 12:41:24 -- nvmf/common.sh@124 -- # return 0 00:13:51.168 12:41:24 -- nvmf/common.sh@477 -- # '[' -n 3500187 ']' 00:13:51.168 12:41:24 -- nvmf/common.sh@478 -- # killprocess 3500187 00:13:51.168 12:41:24 -- common/autotest_common.sh@936 -- # '[' -z 3500187 ']' 00:13:51.168 12:41:24 -- common/autotest_common.sh@940 -- # kill -0 3500187 00:13:51.168 12:41:24 -- common/autotest_common.sh@941 -- # uname 00:13:51.168 12:41:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:51.168 12:41:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3500187 00:13:51.168 12:41:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:51.168 12:41:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:51.168 12:41:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3500187' 00:13:51.168 killing process with pid 3500187 00:13:51.168 12:41:24 -- common/autotest_common.sh@955 -- # kill 3500187 00:13:51.168 12:41:24 -- common/autotest_common.sh@960 -- # wait 3500187 00:13:51.426 12:41:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.426 12:41:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.426 12:41:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.426 12:41:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.426 12:41:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.426 12:41:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.426 12:41:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.426 12:41:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.333 12:41:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.333 00:13:53.333 real 0m19.584s 00:13:53.333 user 1m6.240s 00:13:53.333 sys 0m5.604s 00:13:53.333 12:41:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:53.333 12:41:26 -- common/autotest_common.sh@10 -- # set +x 00:13:53.333 ************************************ 00:13:53.333 END TEST nvmf_lvol 00:13:53.333 ************************************ 00:13:53.592 12:41:26 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:13:53.592 12:41:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:53.592 12:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:53.592 12:41:26 -- common/autotest_common.sh@10 -- # set +x 00:13:53.592 ************************************ 00:13:53.592 START TEST nvmf_lvs_grow 00:13:53.592 ************************************ 00:13:53.592 12:41:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:13:53.592 * Looking for test storage... 00:13:53.592 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:53.592 12:41:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:53.592 12:41:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:53.592 12:41:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:53.592 12:41:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:53.592 12:41:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:53.592 12:41:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:53.592 12:41:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:53.592 12:41:26 -- scripts/common.sh@335 -- # IFS=.-: 00:13:53.592 12:41:26 -- scripts/common.sh@335 -- # read -ra ver1 00:13:53.592 12:41:26 -- scripts/common.sh@336 -- # IFS=.-: 00:13:53.592 12:41:26 -- scripts/common.sh@336 -- # read -ra ver2 00:13:53.592 12:41:26 -- scripts/common.sh@337 -- # local 'op=<' 00:13:53.592 12:41:26 -- scripts/common.sh@339 -- # ver1_l=2 00:13:53.592 12:41:26 -- scripts/common.sh@340 -- # ver2_l=1 00:13:53.592 12:41:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:53.592 12:41:26 -- scripts/common.sh@343 -- # case "$op" in 00:13:53.592 12:41:26 -- scripts/common.sh@344 -- # : 1 00:13:53.592 12:41:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:53.592 12:41:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:53.592 12:41:26 -- scripts/common.sh@364 -- # decimal 1 00:13:53.592 12:41:26 -- scripts/common.sh@352 -- # local d=1 00:13:53.592 12:41:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:53.592 12:41:26 -- scripts/common.sh@354 -- # echo 1 00:13:53.592 12:41:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:53.592 12:41:26 -- scripts/common.sh@365 -- # decimal 2 00:13:53.592 12:41:26 -- scripts/common.sh@352 -- # local d=2 00:13:53.592 12:41:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:53.592 12:41:26 -- scripts/common.sh@354 -- # echo 2 00:13:53.592 12:41:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:53.592 12:41:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:53.592 12:41:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:53.592 12:41:26 -- scripts/common.sh@367 -- # return 0 00:13:53.592 12:41:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:53.592 12:41:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:53.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.592 --rc genhtml_branch_coverage=1 00:13:53.592 --rc genhtml_function_coverage=1 00:13:53.592 --rc genhtml_legend=1 00:13:53.592 --rc geninfo_all_blocks=1 00:13:53.592 --rc geninfo_unexecuted_blocks=1 00:13:53.592 00:13:53.592 ' 00:13:53.592 12:41:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:53.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.592 --rc genhtml_branch_coverage=1 00:13:53.592 --rc genhtml_function_coverage=1 00:13:53.592 --rc genhtml_legend=1 00:13:53.592 --rc geninfo_all_blocks=1 00:13:53.592 --rc geninfo_unexecuted_blocks=1 00:13:53.592 00:13:53.592 ' 00:13:53.592 12:41:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:53.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.592 --rc genhtml_branch_coverage=1 00:13:53.592 --rc genhtml_function_coverage=1 00:13:53.592 --rc genhtml_legend=1 00:13:53.592 --rc geninfo_all_blocks=1 00:13:53.592 --rc geninfo_unexecuted_blocks=1 00:13:53.592 00:13:53.592 ' 00:13:53.592 12:41:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:53.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.592 --rc genhtml_branch_coverage=1 00:13:53.592 --rc genhtml_function_coverage=1 00:13:53.592 --rc genhtml_legend=1 00:13:53.592 --rc geninfo_all_blocks=1 00:13:53.592 --rc geninfo_unexecuted_blocks=1 00:13:53.592 00:13:53.592 ' 00:13:53.592 12:41:26 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.592 12:41:26 -- nvmf/common.sh@7 -- # uname -s 00:13:53.592 12:41:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.592 12:41:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.592 12:41:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.592 12:41:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.592 12:41:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.593 12:41:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.593 12:41:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.593 12:41:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.593 12:41:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.593 12:41:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.593 12:41:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.593 12:41:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.593 12:41:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.593 12:41:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.593 12:41:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.593 12:41:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.593 12:41:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.593 12:41:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.593 12:41:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.593 12:41:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.593 12:41:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.593 12:41:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.593 12:41:26 -- paths/export.sh@5 -- # export PATH 00:13:53.593 12:41:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.593 12:41:26 -- nvmf/common.sh@46 -- # : 0 00:13:53.593 12:41:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.593 12:41:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.593 12:41:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.593 12:41:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.593 12:41:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.593 12:41:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.593 12:41:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.593 12:41:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.593 12:41:26 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:53.593 12:41:26 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:53.593 12:41:26 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:13:53.593 12:41:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.593 12:41:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.593 12:41:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.593 12:41:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.593 12:41:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.593 12:41:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.593 12:41:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.593 12:41:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.593 12:41:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.593 12:41:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.593 12:41:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.593 12:41:26 -- common/autotest_common.sh@10 -- # set +x 00:13:56.143 12:41:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:56.143 12:41:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:56.143 12:41:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:56.143 12:41:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:56.143 12:41:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:56.143 12:41:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:56.143 12:41:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:56.143 12:41:28 -- nvmf/common.sh@294 -- # net_devs=() 00:13:56.143 12:41:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:56.143 12:41:28 -- nvmf/common.sh@295 -- # e810=() 00:13:56.143 12:41:28 -- nvmf/common.sh@295 -- # local -ga e810 00:13:56.143 12:41:28 -- nvmf/common.sh@296 -- # x722=() 00:13:56.143 12:41:28 -- nvmf/common.sh@296 -- # local -ga x722 00:13:56.143 12:41:28 -- nvmf/common.sh@297 -- # mlx=() 00:13:56.143 12:41:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:56.143 12:41:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:56.143 12:41:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:56.143 12:41:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:56.143 12:41:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:56.143 12:41:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.143 12:41:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:56.143 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:56.143 12:41:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.143 12:41:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:56.143 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:56.143 12:41:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:56.143 12:41:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.143 12:41:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.143 12:41:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.143 12:41:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.143 12:41:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:56.143 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:56.143 12:41:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.143 12:41:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.143 12:41:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.143 12:41:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.143 12:41:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.143 12:41:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:56.143 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:56.143 12:41:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.143 12:41:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:56.143 12:41:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:56.143 12:41:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:56.143 12:41:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:56.143 12:41:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:56.143 12:41:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:56.143 12:41:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:56.143 12:41:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:56.143 12:41:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:56.143 12:41:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:56.143 12:41:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:56.143 12:41:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:56.143 12:41:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:56.143 12:41:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:56.143 12:41:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:56.143 12:41:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:56.143 12:41:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:56.143 12:41:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:56.143 12:41:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:56.143 12:41:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:56.143 12:41:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:56.143 12:41:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:56.143 12:41:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:56.143 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:56.143 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:13:56.143 00:13:56.143 --- 10.0.0.2 ping statistics --- 00:13:56.143 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.143 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:13:56.143 12:41:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:56.143 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:56.143 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:13:56.143 00:13:56.143 --- 10.0.0.1 ping statistics --- 00:13:56.143 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.143 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:13:56.143 12:41:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:56.143 12:41:28 -- nvmf/common.sh@410 -- # return 0 00:13:56.143 12:41:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:56.143 12:41:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:56.143 12:41:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:56.143 12:41:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:56.143 12:41:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:56.143 12:41:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:56.143 12:41:28 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:13:56.143 12:41:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:56.143 12:41:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:56.143 12:41:28 -- common/autotest_common.sh@10 -- # set +x 00:13:56.143 12:41:28 -- nvmf/common.sh@469 -- # nvmfpid=3504074 00:13:56.143 12:41:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:13:56.143 12:41:28 -- nvmf/common.sh@470 -- # waitforlisten 3504074 00:13:56.143 12:41:28 -- common/autotest_common.sh@829 -- # '[' -z 3504074 ']' 00:13:56.143 12:41:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:56.143 12:41:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:56.143 12:41:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:56.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:56.144 12:41:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:56.144 12:41:28 -- common/autotest_common.sh@10 -- # set +x 00:13:56.144 [2024-11-20 12:41:28.926165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:56.144 [2024-11-20 12:41:28.926256] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:56.144 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.144 [2024-11-20 12:41:28.987884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:56.144 [2024-11-20 12:41:29.092510] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:56.144 [2024-11-20 12:41:29.092686] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:56.144 [2024-11-20 12:41:29.092705] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:56.144 [2024-11-20 12:41:29.092717] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:56.144 [2024-11-20 12:41:29.092751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:57.081 12:41:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:57.081 12:41:29 -- common/autotest_common.sh@862 -- # return 0 00:13:57.081 12:41:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:57.081 12:41:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:57.081 12:41:29 -- common/autotest_common.sh@10 -- # set +x 00:13:57.081 12:41:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:57.081 12:41:29 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:57.340 [2024-11-20 12:41:30.235616] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:13:57.340 12:41:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:57.340 12:41:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:57.340 12:41:30 -- common/autotest_common.sh@10 -- # set +x 00:13:57.340 ************************************ 00:13:57.340 START TEST lvs_grow_clean 00:13:57.340 ************************************ 00:13:57.340 12:41:30 -- common/autotest_common.sh@1114 -- # lvs_grow 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:57.340 12:41:30 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:57.600 12:41:30 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:13:57.600 12:41:30 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:13:57.861 12:41:30 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:13:57.861 12:41:30 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:13:57.861 12:41:30 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:13:58.120 12:41:31 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:13:58.120 12:41:31 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:13:58.120 12:41:31 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 lvol 150 00:13:58.380 12:41:31 -- target/nvmf_lvs_grow.sh@33 -- # lvol=dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f 00:13:58.380 12:41:31 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:58.380 12:41:31 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:13:58.640 [2024-11-20 12:41:31.553375] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:13:58.640 [2024-11-20 12:41:31.553464] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:13:58.640 true 00:13:58.640 12:41:31 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:13:58.640 12:41:31 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:13:58.899 12:41:31 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:13:58.899 12:41:31 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:59.158 12:41:32 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f 00:13:59.417 12:41:32 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:59.677 [2024-11-20 12:41:32.568554] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:59.677 12:41:32 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:59.936 12:41:32 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3504533 00:13:59.936 12:41:32 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:13:59.936 12:41:32 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:59.936 12:41:32 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3504533 /var/tmp/bdevperf.sock 00:13:59.936 12:41:32 -- common/autotest_common.sh@829 -- # '[' -z 3504533 ']' 00:13:59.936 12:41:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:59.936 12:41:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:59.936 12:41:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:59.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:59.936 12:41:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:59.936 12:41:32 -- common/autotest_common.sh@10 -- # set +x 00:13:59.936 [2024-11-20 12:41:32.877768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:59.936 [2024-11-20 12:41:32.877853] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3504533 ] 00:13:59.936 EAL: No free 2048 kB hugepages reported on node 1 00:13:59.936 [2024-11-20 12:41:32.939266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:00.196 [2024-11-20 12:41:33.053447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:00.839 12:41:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:00.839 12:41:33 -- common/autotest_common.sh@862 -- # return 0 00:14:00.839 12:41:33 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:01.424 Nvme0n1 00:14:01.424 12:41:34 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:01.684 [ 00:14:01.684 { 00:14:01.684 "name": "Nvme0n1", 00:14:01.684 "aliases": [ 00:14:01.684 "dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f" 00:14:01.684 ], 00:14:01.684 "product_name": "NVMe disk", 00:14:01.684 "block_size": 4096, 00:14:01.684 "num_blocks": 38912, 00:14:01.684 "uuid": "dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f", 00:14:01.684 "assigned_rate_limits": { 00:14:01.684 "rw_ios_per_sec": 0, 00:14:01.684 "rw_mbytes_per_sec": 0, 00:14:01.684 "r_mbytes_per_sec": 0, 00:14:01.684 "w_mbytes_per_sec": 0 00:14:01.684 }, 00:14:01.684 "claimed": false, 00:14:01.684 "zoned": false, 00:14:01.684 "supported_io_types": { 00:14:01.684 "read": true, 00:14:01.684 "write": true, 00:14:01.684 "unmap": true, 00:14:01.684 "write_zeroes": true, 00:14:01.684 "flush": true, 00:14:01.684 "reset": true, 00:14:01.684 "compare": true, 00:14:01.684 "compare_and_write": true, 00:14:01.684 "abort": true, 00:14:01.684 "nvme_admin": true, 00:14:01.684 "nvme_io": true 00:14:01.684 }, 00:14:01.684 "driver_specific": { 00:14:01.684 "nvme": [ 00:14:01.684 { 00:14:01.684 "trid": { 00:14:01.684 "trtype": "TCP", 00:14:01.684 "adrfam": "IPv4", 00:14:01.684 "traddr": "10.0.0.2", 00:14:01.684 "trsvcid": "4420", 00:14:01.684 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:01.684 }, 00:14:01.684 "ctrlr_data": { 00:14:01.684 "cntlid": 1, 00:14:01.684 "vendor_id": "0x8086", 00:14:01.684 "model_number": "SPDK bdev Controller", 00:14:01.684 "serial_number": "SPDK0", 00:14:01.684 "firmware_revision": "24.01.1", 00:14:01.684 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:01.684 "oacs": { 00:14:01.684 "security": 0, 00:14:01.684 "format": 0, 00:14:01.684 "firmware": 0, 00:14:01.684 "ns_manage": 0 00:14:01.684 }, 00:14:01.684 "multi_ctrlr": true, 00:14:01.684 "ana_reporting": false 00:14:01.684 }, 00:14:01.684 "vs": { 00:14:01.684 "nvme_version": "1.3" 00:14:01.684 }, 00:14:01.684 "ns_data": { 00:14:01.684 "id": 1, 00:14:01.684 "can_share": true 00:14:01.684 } 00:14:01.684 } 00:14:01.684 ], 00:14:01.684 "mp_policy": "active_passive" 00:14:01.684 } 00:14:01.684 } 00:14:01.684 ] 00:14:01.684 12:41:34 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3504800 00:14:01.684 12:41:34 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:01.684 12:41:34 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:01.684 Running I/O for 10 seconds... 00:14:02.624 Latency(us) 00:14:02.624 [2024-11-20T11:41:35.732Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:02.624 [2024-11-20T11:41:35.732Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:02.624 Nvme0n1 : 1.00 15104.00 59.00 0.00 0.00 0.00 0.00 0.00 00:14:02.624 [2024-11-20T11:41:35.732Z] =================================================================================================================== 00:14:02.624 [2024-11-20T11:41:35.732Z] Total : 15104.00 59.00 0.00 0.00 0.00 0.00 0.00 00:14:02.624 00:14:03.560 12:41:36 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:03.560 [2024-11-20T11:41:36.668Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:03.560 Nvme0n1 : 2.00 15085.50 58.93 0.00 0.00 0.00 0.00 0.00 00:14:03.560 [2024-11-20T11:41:36.668Z] =================================================================================================================== 00:14:03.560 [2024-11-20T11:41:36.668Z] Total : 15085.50 58.93 0.00 0.00 0.00 0.00 0.00 00:14:03.560 00:14:03.817 true 00:14:03.817 12:41:36 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:03.817 12:41:36 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:04.076 12:41:37 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:04.076 12:41:37 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:04.076 12:41:37 -- target/nvmf_lvs_grow.sh@65 -- # wait 3504800 00:14:04.644 [2024-11-20T11:41:37.752Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:04.644 Nvme0n1 : 3.00 15165.67 59.24 0.00 0.00 0.00 0.00 0.00 00:14:04.644 [2024-11-20T11:41:37.752Z] =================================================================================================================== 00:14:04.644 [2024-11-20T11:41:37.752Z] Total : 15165.67 59.24 0.00 0.00 0.00 0.00 0.00 00:14:04.644 00:14:05.583 [2024-11-20T11:41:38.691Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:05.583 Nvme0n1 : 4.00 15187.00 59.32 0.00 0.00 0.00 0.00 0.00 00:14:05.583 [2024-11-20T11:41:38.691Z] =================================================================================================================== 00:14:05.583 [2024-11-20T11:41:38.691Z] Total : 15187.00 59.32 0.00 0.00 0.00 0.00 0.00 00:14:05.583 00:14:06.962 [2024-11-20T11:41:40.070Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:06.962 Nvme0n1 : 5.00 15239.00 59.53 0.00 0.00 0.00 0.00 0.00 00:14:06.962 [2024-11-20T11:41:40.070Z] =================================================================================================================== 00:14:06.962 [2024-11-20T11:41:40.070Z] Total : 15239.00 59.53 0.00 0.00 0.00 0.00 0.00 00:14:06.962 00:14:07.900 [2024-11-20T11:41:41.008Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:07.900 Nvme0n1 : 6.00 15286.50 59.71 0.00 0.00 0.00 0.00 0.00 00:14:07.900 [2024-11-20T11:41:41.008Z] =================================================================================================================== 00:14:07.900 [2024-11-20T11:41:41.008Z] Total : 15286.50 59.71 0.00 0.00 0.00 0.00 0.00 00:14:07.900 00:14:08.838 [2024-11-20T11:41:41.946Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:08.838 Nvme0n1 : 7.00 15307.43 59.79 0.00 0.00 0.00 0.00 0.00 00:14:08.838 [2024-11-20T11:41:41.946Z] =================================================================================================================== 00:14:08.838 [2024-11-20T11:41:41.946Z] Total : 15307.43 59.79 0.00 0.00 0.00 0.00 0.00 00:14:08.838 00:14:09.776 [2024-11-20T11:41:42.884Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:09.776 Nvme0n1 : 8.00 15347.25 59.95 0.00 0.00 0.00 0.00 0.00 00:14:09.776 [2024-11-20T11:41:42.884Z] =================================================================================================================== 00:14:09.776 [2024-11-20T11:41:42.884Z] Total : 15347.25 59.95 0.00 0.00 0.00 0.00 0.00 00:14:09.776 00:14:10.711 [2024-11-20T11:41:43.819Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:10.711 Nvme0n1 : 9.00 15373.78 60.05 0.00 0.00 0.00 0.00 0.00 00:14:10.711 [2024-11-20T11:41:43.819Z] =================================================================================================================== 00:14:10.711 [2024-11-20T11:41:43.819Z] Total : 15373.78 60.05 0.00 0.00 0.00 0.00 0.00 00:14:10.711 00:14:11.648 [2024-11-20T11:41:44.756Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:11.648 Nvme0n1 : 10.00 15399.70 60.16 0.00 0.00 0.00 0.00 0.00 00:14:11.648 [2024-11-20T11:41:44.756Z] =================================================================================================================== 00:14:11.648 [2024-11-20T11:41:44.756Z] Total : 15399.70 60.16 0.00 0.00 0.00 0.00 0.00 00:14:11.648 00:14:11.648 00:14:11.648 Latency(us) 00:14:11.648 [2024-11-20T11:41:44.756Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:11.648 [2024-11-20T11:41:44.756Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:11.648 Nvme0n1 : 10.00 15405.24 60.18 0.00 0.00 8304.21 2245.21 16214.09 00:14:11.648 [2024-11-20T11:41:44.756Z] =================================================================================================================== 00:14:11.648 [2024-11-20T11:41:44.756Z] Total : 15405.24 60.18 0.00 0.00 8304.21 2245.21 16214.09 00:14:11.648 0 00:14:11.648 12:41:44 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3504533 00:14:11.648 12:41:44 -- common/autotest_common.sh@936 -- # '[' -z 3504533 ']' 00:14:11.648 12:41:44 -- common/autotest_common.sh@940 -- # kill -0 3504533 00:14:11.648 12:41:44 -- common/autotest_common.sh@941 -- # uname 00:14:11.648 12:41:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:11.648 12:41:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3504533 00:14:11.648 12:41:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:11.648 12:41:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:11.648 12:41:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3504533' 00:14:11.648 killing process with pid 3504533 00:14:11.648 12:41:44 -- common/autotest_common.sh@955 -- # kill 3504533 00:14:11.648 Received shutdown signal, test time was about 10.000000 seconds 00:14:11.648 00:14:11.648 Latency(us) 00:14:11.648 [2024-11-20T11:41:44.756Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:11.648 [2024-11-20T11:41:44.756Z] =================================================================================================================== 00:14:11.648 [2024-11-20T11:41:44.756Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:11.648 12:41:44 -- common/autotest_common.sh@960 -- # wait 3504533 00:14:11.906 12:41:45 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:12.471 12:41:45 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:12.471 12:41:45 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:12.471 12:41:45 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:12.471 12:41:45 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:12.471 12:41:45 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:12.729 [2024-11-20 12:41:45.756839] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:12.729 12:41:45 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:12.729 12:41:45 -- common/autotest_common.sh@650 -- # local es=0 00:14:12.729 12:41:45 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:12.729 12:41:45 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.729 12:41:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.729 12:41:45 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.729 12:41:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.729 12:41:45 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.729 12:41:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.729 12:41:45 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.729 12:41:45 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:12.729 12:41:45 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:12.988 request: 00:14:12.988 { 00:14:12.988 "uuid": "e5feaf37-b51d-4542-bdfc-0e27c7ddbc79", 00:14:12.988 "method": "bdev_lvol_get_lvstores", 00:14:12.988 "req_id": 1 00:14:12.988 } 00:14:12.988 Got JSON-RPC error response 00:14:12.988 response: 00:14:12.988 { 00:14:12.988 "code": -19, 00:14:12.988 "message": "No such device" 00:14:12.988 } 00:14:12.988 12:41:46 -- common/autotest_common.sh@653 -- # es=1 00:14:12.988 12:41:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:12.988 12:41:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:12.988 12:41:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:12.988 12:41:46 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:13.246 aio_bdev 00:14:13.246 12:41:46 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f 00:14:13.246 12:41:46 -- common/autotest_common.sh@897 -- # local bdev_name=dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f 00:14:13.246 12:41:46 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:13.246 12:41:46 -- common/autotest_common.sh@899 -- # local i 00:14:13.246 12:41:46 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:13.246 12:41:46 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:13.246 12:41:46 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:13.504 12:41:46 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f -t 2000 00:14:13.763 [ 00:14:13.763 { 00:14:13.763 "name": "dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f", 00:14:13.763 "aliases": [ 00:14:13.763 "lvs/lvol" 00:14:13.763 ], 00:14:13.763 "product_name": "Logical Volume", 00:14:13.763 "block_size": 4096, 00:14:13.763 "num_blocks": 38912, 00:14:13.763 "uuid": "dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f", 00:14:13.763 "assigned_rate_limits": { 00:14:13.763 "rw_ios_per_sec": 0, 00:14:13.763 "rw_mbytes_per_sec": 0, 00:14:13.763 "r_mbytes_per_sec": 0, 00:14:13.763 "w_mbytes_per_sec": 0 00:14:13.763 }, 00:14:13.763 "claimed": false, 00:14:13.763 "zoned": false, 00:14:13.763 "supported_io_types": { 00:14:13.763 "read": true, 00:14:13.763 "write": true, 00:14:13.763 "unmap": true, 00:14:13.763 "write_zeroes": true, 00:14:13.763 "flush": false, 00:14:13.763 "reset": true, 00:14:13.763 "compare": false, 00:14:13.763 "compare_and_write": false, 00:14:13.763 "abort": false, 00:14:13.763 "nvme_admin": false, 00:14:13.763 "nvme_io": false 00:14:13.763 }, 00:14:13.763 "driver_specific": { 00:14:13.763 "lvol": { 00:14:13.763 "lvol_store_uuid": "e5feaf37-b51d-4542-bdfc-0e27c7ddbc79", 00:14:13.763 "base_bdev": "aio_bdev", 00:14:13.763 "thin_provision": false, 00:14:13.763 "snapshot": false, 00:14:13.763 "clone": false, 00:14:13.763 "esnap_clone": false 00:14:13.763 } 00:14:13.763 } 00:14:13.763 } 00:14:13.763 ] 00:14:13.763 12:41:46 -- common/autotest_common.sh@905 -- # return 0 00:14:13.763 12:41:46 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:13.763 12:41:46 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:14.022 12:41:47 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:14.022 12:41:47 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:14.022 12:41:47 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:14.282 12:41:47 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:14.282 12:41:47 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete dbf96c6e-1070-43dc-a62d-bfb9d3cacc8f 00:14:14.541 12:41:47 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e5feaf37-b51d-4542-bdfc-0e27c7ddbc79 00:14:14.798 12:41:47 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:15.057 00:14:15.057 real 0m17.839s 00:14:15.057 user 0m17.719s 00:14:15.057 sys 0m1.716s 00:14:15.057 12:41:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:15.057 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:14:15.057 ************************************ 00:14:15.057 END TEST lvs_grow_clean 00:14:15.057 ************************************ 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:15.057 12:41:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:15.057 12:41:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:15.057 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:14:15.057 ************************************ 00:14:15.057 START TEST lvs_grow_dirty 00:14:15.057 ************************************ 00:14:15.057 12:41:48 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:15.057 12:41:48 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:15.058 12:41:48 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:15.317 12:41:48 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:15.317 12:41:48 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:15.575 12:41:48 -- target/nvmf_lvs_grow.sh@28 -- # lvs=414a97ec-e02c-4807-809b-6a87014bf65b 00:14:15.575 12:41:48 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:15.575 12:41:48 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:15.843 12:41:48 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:15.843 12:41:48 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:15.843 12:41:48 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 414a97ec-e02c-4807-809b-6a87014bf65b lvol 150 00:14:16.410 12:41:49 -- target/nvmf_lvs_grow.sh@33 -- # lvol=8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:16.410 12:41:49 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:16.410 12:41:49 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:16.410 [2024-11-20 12:41:49.453547] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:16.410 [2024-11-20 12:41:49.453642] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:16.410 true 00:14:16.410 12:41:49 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:16.410 12:41:49 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:16.670 12:41:49 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:16.670 12:41:49 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:16.930 12:41:49 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:17.190 12:41:50 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:17.450 12:41:50 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:17.709 12:41:50 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3506772 00:14:17.709 12:41:50 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:17.709 12:41:50 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:17.709 12:41:50 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3506772 /var/tmp/bdevperf.sock 00:14:17.709 12:41:50 -- common/autotest_common.sh@829 -- # '[' -z 3506772 ']' 00:14:17.709 12:41:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:17.709 12:41:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:17.709 12:41:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:17.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:17.709 12:41:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:17.709 12:41:50 -- common/autotest_common.sh@10 -- # set +x 00:14:17.709 [2024-11-20 12:41:50.798495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:17.709 [2024-11-20 12:41:50.798566] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3506772 ] 00:14:17.967 EAL: No free 2048 kB hugepages reported on node 1 00:14:17.967 [2024-11-20 12:41:50.861231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:17.967 [2024-11-20 12:41:50.977837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:18.905 12:41:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:18.905 12:41:51 -- common/autotest_common.sh@862 -- # return 0 00:14:18.905 12:41:51 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:19.164 Nvme0n1 00:14:19.164 12:41:52 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:19.423 [ 00:14:19.423 { 00:14:19.423 "name": "Nvme0n1", 00:14:19.423 "aliases": [ 00:14:19.423 "8e6a4338-b457-4fd0-b006-26d7d0fd2757" 00:14:19.423 ], 00:14:19.423 "product_name": "NVMe disk", 00:14:19.423 "block_size": 4096, 00:14:19.423 "num_blocks": 38912, 00:14:19.423 "uuid": "8e6a4338-b457-4fd0-b006-26d7d0fd2757", 00:14:19.423 "assigned_rate_limits": { 00:14:19.423 "rw_ios_per_sec": 0, 00:14:19.423 "rw_mbytes_per_sec": 0, 00:14:19.423 "r_mbytes_per_sec": 0, 00:14:19.423 "w_mbytes_per_sec": 0 00:14:19.423 }, 00:14:19.423 "claimed": false, 00:14:19.423 "zoned": false, 00:14:19.423 "supported_io_types": { 00:14:19.423 "read": true, 00:14:19.423 "write": true, 00:14:19.423 "unmap": true, 00:14:19.423 "write_zeroes": true, 00:14:19.423 "flush": true, 00:14:19.423 "reset": true, 00:14:19.423 "compare": true, 00:14:19.423 "compare_and_write": true, 00:14:19.423 "abort": true, 00:14:19.423 "nvme_admin": true, 00:14:19.423 "nvme_io": true 00:14:19.423 }, 00:14:19.423 "driver_specific": { 00:14:19.423 "nvme": [ 00:14:19.423 { 00:14:19.423 "trid": { 00:14:19.423 "trtype": "TCP", 00:14:19.423 "adrfam": "IPv4", 00:14:19.423 "traddr": "10.0.0.2", 00:14:19.423 "trsvcid": "4420", 00:14:19.423 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:19.423 }, 00:14:19.423 "ctrlr_data": { 00:14:19.423 "cntlid": 1, 00:14:19.423 "vendor_id": "0x8086", 00:14:19.423 "model_number": "SPDK bdev Controller", 00:14:19.423 "serial_number": "SPDK0", 00:14:19.423 "firmware_revision": "24.01.1", 00:14:19.423 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:19.423 "oacs": { 00:14:19.423 "security": 0, 00:14:19.423 "format": 0, 00:14:19.423 "firmware": 0, 00:14:19.423 "ns_manage": 0 00:14:19.423 }, 00:14:19.423 "multi_ctrlr": true, 00:14:19.423 "ana_reporting": false 00:14:19.423 }, 00:14:19.423 "vs": { 00:14:19.423 "nvme_version": "1.3" 00:14:19.423 }, 00:14:19.423 "ns_data": { 00:14:19.423 "id": 1, 00:14:19.423 "can_share": true 00:14:19.423 } 00:14:19.423 } 00:14:19.423 ], 00:14:19.423 "mp_policy": "active_passive" 00:14:19.423 } 00:14:19.423 } 00:14:19.423 ] 00:14:19.683 12:41:52 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3506976 00:14:19.683 12:41:52 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:19.683 12:41:52 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:19.683 Running I/O for 10 seconds... 00:14:20.622 Latency(us) 00:14:20.622 [2024-11-20T11:41:53.730Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:20.622 [2024-11-20T11:41:53.730Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.622 Nvme0n1 : 1.00 14689.00 57.38 0.00 0.00 0.00 0.00 0.00 00:14:20.622 [2024-11-20T11:41:53.730Z] =================================================================================================================== 00:14:20.622 [2024-11-20T11:41:53.730Z] Total : 14689.00 57.38 0.00 0.00 0.00 0.00 0.00 00:14:20.622 00:14:21.558 12:41:54 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:21.558 [2024-11-20T11:41:54.666Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.558 Nvme0n1 : 2.00 14860.50 58.05 0.00 0.00 0.00 0.00 0.00 00:14:21.558 [2024-11-20T11:41:54.666Z] =================================================================================================================== 00:14:21.558 [2024-11-20T11:41:54.666Z] Total : 14860.50 58.05 0.00 0.00 0.00 0.00 0.00 00:14:21.558 00:14:21.816 true 00:14:21.816 12:41:54 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:21.816 12:41:54 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:22.076 12:41:55 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:22.076 12:41:55 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:22.076 12:41:55 -- target/nvmf_lvs_grow.sh@65 -- # wait 3506976 00:14:22.645 [2024-11-20T11:41:55.753Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:22.645 Nvme0n1 : 3.00 14956.67 58.42 0.00 0.00 0.00 0.00 0.00 00:14:22.645 [2024-11-20T11:41:55.753Z] =================================================================================================================== 00:14:22.645 [2024-11-20T11:41:55.753Z] Total : 14956.67 58.42 0.00 0.00 0.00 0.00 0.00 00:14:22.645 00:14:23.582 [2024-11-20T11:41:56.690Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:23.582 Nvme0n1 : 4.00 15046.75 58.78 0.00 0.00 0.00 0.00 0.00 00:14:23.582 [2024-11-20T11:41:56.690Z] =================================================================================================================== 00:14:23.582 [2024-11-20T11:41:56.690Z] Total : 15046.75 58.78 0.00 0.00 0.00 0.00 0.00 00:14:23.582 00:14:24.964 [2024-11-20T11:41:58.072Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:24.964 Nvme0n1 : 5.00 15225.40 59.47 0.00 0.00 0.00 0.00 0.00 00:14:24.964 [2024-11-20T11:41:58.072Z] =================================================================================================================== 00:14:24.964 [2024-11-20T11:41:58.072Z] Total : 15225.40 59.47 0.00 0.00 0.00 0.00 0.00 00:14:24.964 00:14:25.594 [2024-11-20T11:41:58.702Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:25.594 Nvme0n1 : 6.00 15264.17 59.63 0.00 0.00 0.00 0.00 0.00 00:14:25.594 [2024-11-20T11:41:58.702Z] =================================================================================================================== 00:14:25.594 [2024-11-20T11:41:58.702Z] Total : 15264.17 59.63 0.00 0.00 0.00 0.00 0.00 00:14:25.594 00:14:26.978 [2024-11-20T11:42:00.086Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.978 Nvme0n1 : 7.00 15306.86 59.79 0.00 0.00 0.00 0.00 0.00 00:14:26.978 [2024-11-20T11:42:00.086Z] =================================================================================================================== 00:14:26.978 [2024-11-20T11:42:00.086Z] Total : 15306.86 59.79 0.00 0.00 0.00 0.00 0.00 00:14:26.978 00:14:27.913 [2024-11-20T11:42:01.021Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.913 Nvme0n1 : 8.00 15316.50 59.83 0.00 0.00 0.00 0.00 0.00 00:14:27.913 [2024-11-20T11:42:01.021Z] =================================================================================================================== 00:14:27.913 [2024-11-20T11:42:01.021Z] Total : 15316.50 59.83 0.00 0.00 0.00 0.00 0.00 00:14:27.913 00:14:28.848 [2024-11-20T11:42:01.956Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:28.848 Nvme0n1 : 9.00 15382.56 60.09 0.00 0.00 0.00 0.00 0.00 00:14:28.848 [2024-11-20T11:42:01.956Z] =================================================================================================================== 00:14:28.848 [2024-11-20T11:42:01.956Z] Total : 15382.56 60.09 0.00 0.00 0.00 0.00 0.00 00:14:28.848 00:14:29.784 [2024-11-20T11:42:02.892Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:29.784 Nvme0n1 : 10.00 15389.70 60.12 0.00 0.00 0.00 0.00 0.00 00:14:29.784 [2024-11-20T11:42:02.892Z] =================================================================================================================== 00:14:29.784 [2024-11-20T11:42:02.892Z] Total : 15389.70 60.12 0.00 0.00 0.00 0.00 0.00 00:14:29.784 00:14:29.784 00:14:29.784 Latency(us) 00:14:29.784 [2024-11-20T11:42:02.892Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:29.784 [2024-11-20T11:42:02.892Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:29.784 Nvme0n1 : 10.00 15394.82 60.14 0.00 0.00 8309.87 4733.16 17961.72 00:14:29.784 [2024-11-20T11:42:02.892Z] =================================================================================================================== 00:14:29.784 [2024-11-20T11:42:02.892Z] Total : 15394.82 60.14 0.00 0.00 8309.87 4733.16 17961.72 00:14:29.784 0 00:14:29.784 12:42:02 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3506772 00:14:29.784 12:42:02 -- common/autotest_common.sh@936 -- # '[' -z 3506772 ']' 00:14:29.784 12:42:02 -- common/autotest_common.sh@940 -- # kill -0 3506772 00:14:29.784 12:42:02 -- common/autotest_common.sh@941 -- # uname 00:14:29.784 12:42:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:29.784 12:42:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3506772 00:14:29.784 12:42:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:29.784 12:42:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:29.784 12:42:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3506772' 00:14:29.784 killing process with pid 3506772 00:14:29.784 12:42:02 -- common/autotest_common.sh@955 -- # kill 3506772 00:14:29.784 Received shutdown signal, test time was about 10.000000 seconds 00:14:29.784 00:14:29.784 Latency(us) 00:14:29.784 [2024-11-20T11:42:02.892Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:29.784 [2024-11-20T11:42:02.892Z] =================================================================================================================== 00:14:29.784 [2024-11-20T11:42:02.892Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:29.784 12:42:02 -- common/autotest_common.sh@960 -- # wait 3506772 00:14:30.041 12:42:02 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:30.299 12:42:03 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:30.299 12:42:03 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:30.557 12:42:03 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:30.557 12:42:03 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:30.557 12:42:03 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3504074 00:14:30.557 12:42:03 -- target/nvmf_lvs_grow.sh@74 -- # wait 3504074 00:14:30.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3504074 Killed "${NVMF_APP[@]}" "$@" 00:14:30.557 12:42:03 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:30.557 12:42:03 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:30.557 12:42:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:30.557 12:42:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:30.557 12:42:03 -- common/autotest_common.sh@10 -- # set +x 00:14:30.557 12:42:03 -- nvmf/common.sh@469 -- # nvmfpid=3508403 00:14:30.557 12:42:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:30.557 12:42:03 -- nvmf/common.sh@470 -- # waitforlisten 3508403 00:14:30.557 12:42:03 -- common/autotest_common.sh@829 -- # '[' -z 3508403 ']' 00:14:30.557 12:42:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:30.557 12:42:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:30.557 12:42:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:30.557 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:30.557 12:42:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:30.557 12:42:03 -- common/autotest_common.sh@10 -- # set +x 00:14:30.557 [2024-11-20 12:42:03.579536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:30.557 [2024-11-20 12:42:03.579633] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:30.557 EAL: No free 2048 kB hugepages reported on node 1 00:14:30.557 [2024-11-20 12:42:03.659785] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:30.816 [2024-11-20 12:42:03.792771] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:30.816 [2024-11-20 12:42:03.792970] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:30.816 [2024-11-20 12:42:03.793012] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:30.816 [2024-11-20 12:42:03.793034] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:30.816 [2024-11-20 12:42:03.793107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:30.816 12:42:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:30.816 12:42:03 -- common/autotest_common.sh@862 -- # return 0 00:14:30.816 12:42:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:30.816 12:42:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:30.816 12:42:03 -- common/autotest_common.sh@10 -- # set +x 00:14:31.074 12:42:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:31.074 12:42:03 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:31.333 [2024-11-20 12:42:04.224750] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:31.333 [2024-11-20 12:42:04.224884] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:31.333 [2024-11-20 12:42:04.224929] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:31.333 12:42:04 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:31.333 12:42:04 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:31.333 12:42:04 -- common/autotest_common.sh@897 -- # local bdev_name=8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:31.333 12:42:04 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:31.333 12:42:04 -- common/autotest_common.sh@899 -- # local i 00:14:31.333 12:42:04 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:31.333 12:42:04 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:31.333 12:42:04 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:31.590 12:42:04 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8e6a4338-b457-4fd0-b006-26d7d0fd2757 -t 2000 00:14:31.848 [ 00:14:31.848 { 00:14:31.848 "name": "8e6a4338-b457-4fd0-b006-26d7d0fd2757", 00:14:31.848 "aliases": [ 00:14:31.848 "lvs/lvol" 00:14:31.848 ], 00:14:31.848 "product_name": "Logical Volume", 00:14:31.848 "block_size": 4096, 00:14:31.848 "num_blocks": 38912, 00:14:31.848 "uuid": "8e6a4338-b457-4fd0-b006-26d7d0fd2757", 00:14:31.848 "assigned_rate_limits": { 00:14:31.848 "rw_ios_per_sec": 0, 00:14:31.848 "rw_mbytes_per_sec": 0, 00:14:31.848 "r_mbytes_per_sec": 0, 00:14:31.848 "w_mbytes_per_sec": 0 00:14:31.848 }, 00:14:31.848 "claimed": false, 00:14:31.848 "zoned": false, 00:14:31.848 "supported_io_types": { 00:14:31.848 "read": true, 00:14:31.848 "write": true, 00:14:31.848 "unmap": true, 00:14:31.848 "write_zeroes": true, 00:14:31.848 "flush": false, 00:14:31.848 "reset": true, 00:14:31.848 "compare": false, 00:14:31.848 "compare_and_write": false, 00:14:31.848 "abort": false, 00:14:31.848 "nvme_admin": false, 00:14:31.848 "nvme_io": false 00:14:31.848 }, 00:14:31.848 "driver_specific": { 00:14:31.848 "lvol": { 00:14:31.848 "lvol_store_uuid": "414a97ec-e02c-4807-809b-6a87014bf65b", 00:14:31.848 "base_bdev": "aio_bdev", 00:14:31.848 "thin_provision": false, 00:14:31.848 "snapshot": false, 00:14:31.848 "clone": false, 00:14:31.848 "esnap_clone": false 00:14:31.848 } 00:14:31.848 } 00:14:31.848 } 00:14:31.848 ] 00:14:31.848 12:42:04 -- common/autotest_common.sh@905 -- # return 0 00:14:31.848 12:42:04 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:31.848 12:42:04 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:32.106 12:42:05 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:32.106 12:42:05 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:32.107 12:42:05 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:32.365 12:42:05 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:32.365 12:42:05 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:32.623 [2024-11-20 12:42:05.510260] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:32.623 12:42:05 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:32.623 12:42:05 -- common/autotest_common.sh@650 -- # local es=0 00:14:32.623 12:42:05 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:32.623 12:42:05 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:32.623 12:42:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:32.623 12:42:05 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:32.623 12:42:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:32.623 12:42:05 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:32.623 12:42:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:32.623 12:42:05 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:32.623 12:42:05 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:32.623 12:42:05 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:32.881 request: 00:14:32.881 { 00:14:32.881 "uuid": "414a97ec-e02c-4807-809b-6a87014bf65b", 00:14:32.881 "method": "bdev_lvol_get_lvstores", 00:14:32.881 "req_id": 1 00:14:32.881 } 00:14:32.881 Got JSON-RPC error response 00:14:32.881 response: 00:14:32.881 { 00:14:32.881 "code": -19, 00:14:32.881 "message": "No such device" 00:14:32.881 } 00:14:32.881 12:42:05 -- common/autotest_common.sh@653 -- # es=1 00:14:32.881 12:42:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:32.881 12:42:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:32.881 12:42:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:32.881 12:42:05 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:33.140 aio_bdev 00:14:33.140 12:42:06 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:33.140 12:42:06 -- common/autotest_common.sh@897 -- # local bdev_name=8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:33.140 12:42:06 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:33.140 12:42:06 -- common/autotest_common.sh@899 -- # local i 00:14:33.140 12:42:06 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:33.140 12:42:06 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:33.140 12:42:06 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:33.399 12:42:06 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8e6a4338-b457-4fd0-b006-26d7d0fd2757 -t 2000 00:14:33.657 [ 00:14:33.657 { 00:14:33.657 "name": "8e6a4338-b457-4fd0-b006-26d7d0fd2757", 00:14:33.657 "aliases": [ 00:14:33.657 "lvs/lvol" 00:14:33.657 ], 00:14:33.657 "product_name": "Logical Volume", 00:14:33.658 "block_size": 4096, 00:14:33.658 "num_blocks": 38912, 00:14:33.658 "uuid": "8e6a4338-b457-4fd0-b006-26d7d0fd2757", 00:14:33.658 "assigned_rate_limits": { 00:14:33.658 "rw_ios_per_sec": 0, 00:14:33.658 "rw_mbytes_per_sec": 0, 00:14:33.658 "r_mbytes_per_sec": 0, 00:14:33.658 "w_mbytes_per_sec": 0 00:14:33.658 }, 00:14:33.658 "claimed": false, 00:14:33.658 "zoned": false, 00:14:33.658 "supported_io_types": { 00:14:33.658 "read": true, 00:14:33.658 "write": true, 00:14:33.658 "unmap": true, 00:14:33.658 "write_zeroes": true, 00:14:33.658 "flush": false, 00:14:33.658 "reset": true, 00:14:33.658 "compare": false, 00:14:33.658 "compare_and_write": false, 00:14:33.658 "abort": false, 00:14:33.658 "nvme_admin": false, 00:14:33.658 "nvme_io": false 00:14:33.658 }, 00:14:33.658 "driver_specific": { 00:14:33.658 "lvol": { 00:14:33.658 "lvol_store_uuid": "414a97ec-e02c-4807-809b-6a87014bf65b", 00:14:33.658 "base_bdev": "aio_bdev", 00:14:33.658 "thin_provision": false, 00:14:33.658 "snapshot": false, 00:14:33.658 "clone": false, 00:14:33.658 "esnap_clone": false 00:14:33.658 } 00:14:33.658 } 00:14:33.658 } 00:14:33.658 ] 00:14:33.658 12:42:06 -- common/autotest_common.sh@905 -- # return 0 00:14:33.658 12:42:06 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:33.658 12:42:06 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:33.916 12:42:06 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:33.916 12:42:06 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:33.916 12:42:06 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:34.174 12:42:07 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:34.174 12:42:07 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8e6a4338-b457-4fd0-b006-26d7d0fd2757 00:14:34.432 12:42:07 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 414a97ec-e02c-4807-809b-6a87014bf65b 00:14:34.690 12:42:07 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:34.948 12:42:07 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:34.948 00:14:34.948 real 0m19.868s 00:14:34.948 user 0m51.136s 00:14:34.948 sys 0m4.632s 00:14:34.948 12:42:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:34.948 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:14:34.948 ************************************ 00:14:34.948 END TEST lvs_grow_dirty 00:14:34.948 ************************************ 00:14:34.948 12:42:08 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:34.948 12:42:08 -- common/autotest_common.sh@806 -- # type=--id 00:14:34.948 12:42:08 -- common/autotest_common.sh@807 -- # id=0 00:14:34.948 12:42:08 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:14:34.948 12:42:08 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:34.948 12:42:08 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:14:34.948 12:42:08 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:14:34.948 12:42:08 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:14:34.948 12:42:08 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:34.948 nvmf_trace.0 00:14:34.948 12:42:08 -- common/autotest_common.sh@821 -- # return 0 00:14:34.948 12:42:08 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:34.948 12:42:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:34.948 12:42:08 -- nvmf/common.sh@116 -- # sync 00:14:34.948 12:42:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:34.948 12:42:08 -- nvmf/common.sh@119 -- # set +e 00:14:34.949 12:42:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:34.949 12:42:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:34.949 rmmod nvme_tcp 00:14:34.949 rmmod nvme_fabrics 00:14:35.207 rmmod nvme_keyring 00:14:35.207 12:42:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:35.207 12:42:08 -- nvmf/common.sh@123 -- # set -e 00:14:35.207 12:42:08 -- nvmf/common.sh@124 -- # return 0 00:14:35.207 12:42:08 -- nvmf/common.sh@477 -- # '[' -n 3508403 ']' 00:14:35.207 12:42:08 -- nvmf/common.sh@478 -- # killprocess 3508403 00:14:35.207 12:42:08 -- common/autotest_common.sh@936 -- # '[' -z 3508403 ']' 00:14:35.207 12:42:08 -- common/autotest_common.sh@940 -- # kill -0 3508403 00:14:35.207 12:42:08 -- common/autotest_common.sh@941 -- # uname 00:14:35.207 12:42:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:35.207 12:42:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3508403 00:14:35.207 12:42:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:35.207 12:42:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:35.207 12:42:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3508403' 00:14:35.207 killing process with pid 3508403 00:14:35.207 12:42:08 -- common/autotest_common.sh@955 -- # kill 3508403 00:14:35.207 12:42:08 -- common/autotest_common.sh@960 -- # wait 3508403 00:14:35.466 12:42:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:35.466 12:42:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:35.466 12:42:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:35.466 12:42:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:35.466 12:42:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:35.466 12:42:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:35.466 12:42:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:35.466 12:42:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.368 12:42:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:37.368 00:14:37.368 real 0m43.989s 00:14:37.368 user 1m15.151s 00:14:37.368 sys 0m8.303s 00:14:37.368 12:42:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:37.368 12:42:10 -- common/autotest_common.sh@10 -- # set +x 00:14:37.368 ************************************ 00:14:37.368 END TEST nvmf_lvs_grow 00:14:37.368 ************************************ 00:14:37.368 12:42:10 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:37.368 12:42:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:37.368 12:42:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:37.368 12:42:10 -- common/autotest_common.sh@10 -- # set +x 00:14:37.368 ************************************ 00:14:37.368 START TEST nvmf_bdev_io_wait 00:14:37.368 ************************************ 00:14:37.368 12:42:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:37.627 * Looking for test storage... 00:14:37.627 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:37.627 12:42:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:37.627 12:42:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:37.627 12:42:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:37.627 12:42:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:37.627 12:42:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:37.627 12:42:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:37.627 12:42:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:37.627 12:42:10 -- scripts/common.sh@335 -- # IFS=.-: 00:14:37.627 12:42:10 -- scripts/common.sh@335 -- # read -ra ver1 00:14:37.627 12:42:10 -- scripts/common.sh@336 -- # IFS=.-: 00:14:37.627 12:42:10 -- scripts/common.sh@336 -- # read -ra ver2 00:14:37.627 12:42:10 -- scripts/common.sh@337 -- # local 'op=<' 00:14:37.627 12:42:10 -- scripts/common.sh@339 -- # ver1_l=2 00:14:37.627 12:42:10 -- scripts/common.sh@340 -- # ver2_l=1 00:14:37.627 12:42:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:37.627 12:42:10 -- scripts/common.sh@343 -- # case "$op" in 00:14:37.627 12:42:10 -- scripts/common.sh@344 -- # : 1 00:14:37.627 12:42:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:37.627 12:42:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:37.627 12:42:10 -- scripts/common.sh@364 -- # decimal 1 00:14:37.627 12:42:10 -- scripts/common.sh@352 -- # local d=1 00:14:37.627 12:42:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:37.627 12:42:10 -- scripts/common.sh@354 -- # echo 1 00:14:37.627 12:42:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:37.627 12:42:10 -- scripts/common.sh@365 -- # decimal 2 00:14:37.627 12:42:10 -- scripts/common.sh@352 -- # local d=2 00:14:37.627 12:42:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:37.627 12:42:10 -- scripts/common.sh@354 -- # echo 2 00:14:37.627 12:42:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:37.627 12:42:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:37.627 12:42:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:37.627 12:42:10 -- scripts/common.sh@367 -- # return 0 00:14:37.627 12:42:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:37.627 12:42:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:37.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.627 --rc genhtml_branch_coverage=1 00:14:37.627 --rc genhtml_function_coverage=1 00:14:37.627 --rc genhtml_legend=1 00:14:37.627 --rc geninfo_all_blocks=1 00:14:37.627 --rc geninfo_unexecuted_blocks=1 00:14:37.627 00:14:37.627 ' 00:14:37.627 12:42:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:37.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.627 --rc genhtml_branch_coverage=1 00:14:37.627 --rc genhtml_function_coverage=1 00:14:37.627 --rc genhtml_legend=1 00:14:37.627 --rc geninfo_all_blocks=1 00:14:37.627 --rc geninfo_unexecuted_blocks=1 00:14:37.627 00:14:37.627 ' 00:14:37.627 12:42:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:37.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.627 --rc genhtml_branch_coverage=1 00:14:37.628 --rc genhtml_function_coverage=1 00:14:37.628 --rc genhtml_legend=1 00:14:37.628 --rc geninfo_all_blocks=1 00:14:37.628 --rc geninfo_unexecuted_blocks=1 00:14:37.628 00:14:37.628 ' 00:14:37.628 12:42:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:37.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.628 --rc genhtml_branch_coverage=1 00:14:37.628 --rc genhtml_function_coverage=1 00:14:37.628 --rc genhtml_legend=1 00:14:37.628 --rc geninfo_all_blocks=1 00:14:37.628 --rc geninfo_unexecuted_blocks=1 00:14:37.628 00:14:37.628 ' 00:14:37.628 12:42:10 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:37.628 12:42:10 -- nvmf/common.sh@7 -- # uname -s 00:14:37.628 12:42:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:37.628 12:42:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:37.628 12:42:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:37.628 12:42:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:37.628 12:42:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:37.628 12:42:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:37.628 12:42:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:37.628 12:42:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:37.628 12:42:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:37.628 12:42:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:37.628 12:42:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.628 12:42:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.628 12:42:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:37.628 12:42:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:37.628 12:42:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:37.628 12:42:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:37.628 12:42:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:37.628 12:42:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:37.628 12:42:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:37.628 12:42:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.628 12:42:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.628 12:42:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.628 12:42:10 -- paths/export.sh@5 -- # export PATH 00:14:37.628 12:42:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.628 12:42:10 -- nvmf/common.sh@46 -- # : 0 00:14:37.628 12:42:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:37.628 12:42:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:37.628 12:42:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:37.628 12:42:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:37.628 12:42:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:37.628 12:42:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:37.628 12:42:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:37.628 12:42:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:37.628 12:42:10 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:37.628 12:42:10 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:37.628 12:42:10 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:37.628 12:42:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:37.628 12:42:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:37.628 12:42:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:37.628 12:42:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:37.628 12:42:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:37.628 12:42:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.628 12:42:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:37.628 12:42:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.628 12:42:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:37.628 12:42:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:37.628 12:42:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:37.628 12:42:10 -- common/autotest_common.sh@10 -- # set +x 00:14:39.530 12:42:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:39.530 12:42:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:39.530 12:42:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:39.530 12:42:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:39.530 12:42:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:39.530 12:42:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:39.530 12:42:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:39.530 12:42:12 -- nvmf/common.sh@294 -- # net_devs=() 00:14:39.530 12:42:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:39.530 12:42:12 -- nvmf/common.sh@295 -- # e810=() 00:14:39.530 12:42:12 -- nvmf/common.sh@295 -- # local -ga e810 00:14:39.530 12:42:12 -- nvmf/common.sh@296 -- # x722=() 00:14:39.530 12:42:12 -- nvmf/common.sh@296 -- # local -ga x722 00:14:39.530 12:42:12 -- nvmf/common.sh@297 -- # mlx=() 00:14:39.530 12:42:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:39.530 12:42:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:39.530 12:42:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:39.530 12:42:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:39.530 12:42:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:39.530 12:42:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.530 12:42:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:39.530 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:39.530 12:42:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.530 12:42:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:39.530 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:39.530 12:42:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:39.530 12:42:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.530 12:42:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.530 12:42:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.530 12:42:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.530 12:42:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:39.530 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:39.530 12:42:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.530 12:42:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.530 12:42:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.530 12:42:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.530 12:42:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.530 12:42:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:39.530 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:39.530 12:42:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.530 12:42:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:39.530 12:42:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:39.530 12:42:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:39.530 12:42:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:39.530 12:42:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:39.530 12:42:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:39.530 12:42:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:39.531 12:42:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:39.531 12:42:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:39.531 12:42:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:39.531 12:42:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:39.531 12:42:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:39.531 12:42:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:39.531 12:42:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:39.531 12:42:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:39.531 12:42:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:39.531 12:42:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:39.531 12:42:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:39.531 12:42:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:39.531 12:42:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:39.531 12:42:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:39.789 12:42:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:39.790 12:42:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:39.790 12:42:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:39.790 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:39.790 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:14:39.790 00:14:39.790 --- 10.0.0.2 ping statistics --- 00:14:39.790 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.790 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:14:39.790 12:42:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:39.790 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:39.790 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.053 ms 00:14:39.790 00:14:39.790 --- 10.0.0.1 ping statistics --- 00:14:39.790 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.790 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:14:39.790 12:42:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:39.790 12:42:12 -- nvmf/common.sh@410 -- # return 0 00:14:39.790 12:42:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:39.790 12:42:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:39.790 12:42:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:39.790 12:42:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:39.790 12:42:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:39.790 12:42:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:39.790 12:42:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:39.790 12:42:12 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:39.790 12:42:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:39.790 12:42:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:39.790 12:42:12 -- common/autotest_common.sh@10 -- # set +x 00:14:39.790 12:42:12 -- nvmf/common.sh@469 -- # nvmfpid=3511463 00:14:39.790 12:42:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:39.790 12:42:12 -- nvmf/common.sh@470 -- # waitforlisten 3511463 00:14:39.790 12:42:12 -- common/autotest_common.sh@829 -- # '[' -z 3511463 ']' 00:14:39.790 12:42:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:39.790 12:42:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:39.790 12:42:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:39.790 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:39.790 12:42:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:39.790 12:42:12 -- common/autotest_common.sh@10 -- # set +x 00:14:39.790 [2024-11-20 12:42:12.741952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:39.790 [2024-11-20 12:42:12.742041] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:39.790 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.790 [2024-11-20 12:42:12.809856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:40.048 [2024-11-20 12:42:12.929231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:40.048 [2024-11-20 12:42:12.929396] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:40.048 [2024-11-20 12:42:12.929415] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:40.048 [2024-11-20 12:42:12.929428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:40.048 [2024-11-20 12:42:12.929490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:40.048 [2024-11-20 12:42:12.929542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:40.048 [2024-11-20 12:42:12.929517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:40.048 [2024-11-20 12:42:12.929545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:40.048 12:42:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:40.048 12:42:12 -- common/autotest_common.sh@862 -- # return 0 00:14:40.048 12:42:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:40.048 12:42:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:40.048 12:42:12 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 12:42:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:40.048 12:42:12 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:40.048 12:42:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:12 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 12:42:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:12 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:40.048 12:42:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:12 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 12:42:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:40.048 12:42:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:13 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 [2024-11-20 12:42:13.071129] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:40.048 12:42:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:40.048 12:42:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:13 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 Malloc0 00:14:40.048 12:42:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:40.048 12:42:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:13 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 12:42:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:40.048 12:42:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:13 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 12:42:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:40.048 12:42:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.048 12:42:13 -- common/autotest_common.sh@10 -- # set +x 00:14:40.048 [2024-11-20 12:42:13.130548] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:40.048 12:42:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3511607 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@30 -- # READ_PID=3511609 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:40.048 12:42:13 -- nvmf/common.sh@520 -- # config=() 00:14:40.048 12:42:13 -- nvmf/common.sh@520 -- # local subsystem config 00:14:40.048 12:42:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3511611 00:14:40.048 12:42:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:40.048 { 00:14:40.048 "params": { 00:14:40.048 "name": "Nvme$subsystem", 00:14:40.048 "trtype": "$TEST_TRANSPORT", 00:14:40.048 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:40.048 "adrfam": "ipv4", 00:14:40.048 "trsvcid": "$NVMF_PORT", 00:14:40.048 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:40.048 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:40.048 "hdgst": ${hdgst:-false}, 00:14:40.048 "ddgst": ${ddgst:-false} 00:14:40.048 }, 00:14:40.048 "method": "bdev_nvme_attach_controller" 00:14:40.048 } 00:14:40.048 EOF 00:14:40.048 )") 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:40.048 12:42:13 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:40.048 12:42:13 -- nvmf/common.sh@520 -- # config=() 00:14:40.048 12:42:13 -- nvmf/common.sh@520 -- # local subsystem config 00:14:40.048 12:42:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:40.048 12:42:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:40.048 { 00:14:40.048 "params": { 00:14:40.048 "name": "Nvme$subsystem", 00:14:40.048 "trtype": "$TEST_TRANSPORT", 00:14:40.048 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:40.048 "adrfam": "ipv4", 00:14:40.048 "trsvcid": "$NVMF_PORT", 00:14:40.048 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:40.048 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:40.048 "hdgst": ${hdgst:-false}, 00:14:40.048 "ddgst": ${ddgst:-false} 00:14:40.048 }, 00:14:40.048 "method": "bdev_nvme_attach_controller" 00:14:40.048 } 00:14:40.048 EOF 00:14:40.048 )") 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3511613 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@35 -- # sync 00:14:40.049 12:42:13 -- nvmf/common.sh@520 -- # config=() 00:14:40.049 12:42:13 -- nvmf/common.sh@542 -- # cat 00:14:40.049 12:42:13 -- nvmf/common.sh@520 -- # local subsystem config 00:14:40.049 12:42:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:40.049 12:42:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:40.049 { 00:14:40.049 "params": { 00:14:40.049 "name": "Nvme$subsystem", 00:14:40.049 "trtype": "$TEST_TRANSPORT", 00:14:40.049 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:40.049 "adrfam": "ipv4", 00:14:40.049 "trsvcid": "$NVMF_PORT", 00:14:40.049 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:40.049 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:40.049 "hdgst": ${hdgst:-false}, 00:14:40.049 "ddgst": ${ddgst:-false} 00:14:40.049 }, 00:14:40.049 "method": "bdev_nvme_attach_controller" 00:14:40.049 } 00:14:40.049 EOF 00:14:40.049 )") 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:40.049 12:42:13 -- nvmf/common.sh@520 -- # config=() 00:14:40.049 12:42:13 -- nvmf/common.sh@520 -- # local subsystem config 00:14:40.049 12:42:13 -- nvmf/common.sh@542 -- # cat 00:14:40.049 12:42:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:40.049 12:42:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:40.049 { 00:14:40.049 "params": { 00:14:40.049 "name": "Nvme$subsystem", 00:14:40.049 "trtype": "$TEST_TRANSPORT", 00:14:40.049 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:40.049 "adrfam": "ipv4", 00:14:40.049 "trsvcid": "$NVMF_PORT", 00:14:40.049 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:40.049 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:40.049 "hdgst": ${hdgst:-false}, 00:14:40.049 "ddgst": ${ddgst:-false} 00:14:40.049 }, 00:14:40.049 "method": "bdev_nvme_attach_controller" 00:14:40.049 } 00:14:40.049 EOF 00:14:40.049 )") 00:14:40.049 12:42:13 -- nvmf/common.sh@542 -- # cat 00:14:40.049 12:42:13 -- target/bdev_io_wait.sh@37 -- # wait 3511607 00:14:40.049 12:42:13 -- nvmf/common.sh@542 -- # cat 00:14:40.049 12:42:13 -- nvmf/common.sh@544 -- # jq . 00:14:40.049 12:42:13 -- nvmf/common.sh@544 -- # jq . 00:14:40.049 12:42:13 -- nvmf/common.sh@545 -- # IFS=, 00:14:40.049 12:42:13 -- nvmf/common.sh@544 -- # jq . 00:14:40.049 12:42:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:40.049 "params": { 00:14:40.049 "name": "Nvme1", 00:14:40.049 "trtype": "tcp", 00:14:40.049 "traddr": "10.0.0.2", 00:14:40.049 "adrfam": "ipv4", 00:14:40.049 "trsvcid": "4420", 00:14:40.049 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:40.049 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:40.049 "hdgst": false, 00:14:40.049 "ddgst": false 00:14:40.049 }, 00:14:40.049 "method": "bdev_nvme_attach_controller" 00:14:40.049 }' 00:14:40.049 12:42:13 -- nvmf/common.sh@544 -- # jq . 00:14:40.049 12:42:13 -- nvmf/common.sh@545 -- # IFS=, 00:14:40.049 12:42:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:40.049 "params": { 00:14:40.049 "name": "Nvme1", 00:14:40.049 "trtype": "tcp", 00:14:40.049 "traddr": "10.0.0.2", 00:14:40.049 "adrfam": "ipv4", 00:14:40.049 "trsvcid": "4420", 00:14:40.049 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:40.049 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:40.049 "hdgst": false, 00:14:40.049 "ddgst": false 00:14:40.049 }, 00:14:40.049 "method": "bdev_nvme_attach_controller" 00:14:40.049 }' 00:14:40.049 12:42:13 -- nvmf/common.sh@545 -- # IFS=, 00:14:40.049 12:42:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:40.049 "params": { 00:14:40.049 "name": "Nvme1", 00:14:40.049 "trtype": "tcp", 00:14:40.049 "traddr": "10.0.0.2", 00:14:40.049 "adrfam": "ipv4", 00:14:40.049 "trsvcid": "4420", 00:14:40.049 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:40.049 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:40.049 "hdgst": false, 00:14:40.049 "ddgst": false 00:14:40.049 }, 00:14:40.049 "method": "bdev_nvme_attach_controller" 00:14:40.049 }' 00:14:40.049 12:42:13 -- nvmf/common.sh@545 -- # IFS=, 00:14:40.049 12:42:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:40.049 "params": { 00:14:40.049 "name": "Nvme1", 00:14:40.049 "trtype": "tcp", 00:14:40.049 "traddr": "10.0.0.2", 00:14:40.049 "adrfam": "ipv4", 00:14:40.049 "trsvcid": "4420", 00:14:40.049 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:40.049 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:40.049 "hdgst": false, 00:14:40.049 "ddgst": false 00:14:40.049 }, 00:14:40.049 "method": "bdev_nvme_attach_controller" 00:14:40.049 }' 00:14:40.308 [2024-11-20 12:42:13.173170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:40.308 [2024-11-20 12:42:13.173170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:40.308 [2024-11-20 12:42:13.173248] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 12:42:13.173248] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:40.308 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:40.308 [2024-11-20 12:42:13.173623] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:40.308 [2024-11-20 12:42:13.173680] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:40.308 [2024-11-20 12:42:13.174535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:40.308 [2024-11-20 12:42:13.174606] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:40.308 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.308 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.308 [2024-11-20 12:42:13.343095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:40.308 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.567 [2024-11-20 12:42:13.435970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:40.567 [2024-11-20 12:42:13.453499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:40.567 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.567 [2024-11-20 12:42:13.538207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:40.567 [2024-11-20 12:42:13.578449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:40.567 [2024-11-20 12:42:13.614876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:40.567 [2024-11-20 12:42:13.638610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:40.827 [2024-11-20 12:42:13.708452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:40.827 Running I/O for 1 seconds... 00:14:40.827 Running I/O for 1 seconds... 00:14:40.827 Running I/O for 1 seconds... 00:14:41.087 Running I/O for 1 seconds... 00:14:41.663 00:14:41.663 Latency(us) 00:14:41.663 [2024-11-20T11:42:14.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:41.663 [2024-11-20T11:42:14.771Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:41.663 Nvme1n1 : 1.00 144157.98 563.12 0.00 0.00 884.44 382.29 1341.06 00:14:41.663 [2024-11-20T11:42:14.771Z] =================================================================================================================== 00:14:41.663 [2024-11-20T11:42:14.771Z] Total : 144157.98 563.12 0.00 0.00 884.44 382.29 1341.06 00:14:41.922 00:14:41.922 Latency(us) 00:14:41.922 [2024-11-20T11:42:15.030Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:41.922 [2024-11-20T11:42:15.030Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:41.922 Nvme1n1 : 1.02 6829.85 26.68 0.00 0.00 18552.13 7815.77 26991.12 00:14:41.922 [2024-11-20T11:42:15.030Z] =================================================================================================================== 00:14:41.922 [2024-11-20T11:42:15.030Z] Total : 6829.85 26.68 0.00 0.00 18552.13 7815.77 26991.12 00:14:41.922 00:14:41.922 Latency(us) 00:14:41.922 [2024-11-20T11:42:15.030Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:41.922 [2024-11-20T11:42:15.030Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:41.922 Nvme1n1 : 1.01 9171.95 35.83 0.00 0.00 13893.61 7815.77 26991.12 00:14:41.922 [2024-11-20T11:42:15.030Z] =================================================================================================================== 00:14:41.922 [2024-11-20T11:42:15.030Z] Total : 9171.95 35.83 0.00 0.00 13893.61 7815.77 26991.12 00:14:41.922 00:14:41.922 Latency(us) 00:14:41.922 [2024-11-20T11:42:15.030Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:41.922 [2024-11-20T11:42:15.030Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:41.922 Nvme1n1 : 1.01 6497.46 25.38 0.00 0.00 19624.72 6844.87 40777.96 00:14:41.922 [2024-11-20T11:42:15.030Z] =================================================================================================================== 00:14:41.922 [2024-11-20T11:42:15.030Z] Total : 6497.46 25.38 0.00 0.00 19624.72 6844.87 40777.96 00:14:42.181 12:42:15 -- target/bdev_io_wait.sh@38 -- # wait 3511609 00:14:42.181 12:42:15 -- target/bdev_io_wait.sh@39 -- # wait 3511611 00:14:42.181 12:42:15 -- target/bdev_io_wait.sh@40 -- # wait 3511613 00:14:42.181 12:42:15 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:42.181 12:42:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.181 12:42:15 -- common/autotest_common.sh@10 -- # set +x 00:14:42.181 12:42:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.181 12:42:15 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:42.181 12:42:15 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:42.181 12:42:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:42.181 12:42:15 -- nvmf/common.sh@116 -- # sync 00:14:42.181 12:42:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:42.181 12:42:15 -- nvmf/common.sh@119 -- # set +e 00:14:42.181 12:42:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:42.181 12:42:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:42.181 rmmod nvme_tcp 00:14:42.181 rmmod nvme_fabrics 00:14:42.181 rmmod nvme_keyring 00:14:42.441 12:42:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:42.441 12:42:15 -- nvmf/common.sh@123 -- # set -e 00:14:42.441 12:42:15 -- nvmf/common.sh@124 -- # return 0 00:14:42.441 12:42:15 -- nvmf/common.sh@477 -- # '[' -n 3511463 ']' 00:14:42.441 12:42:15 -- nvmf/common.sh@478 -- # killprocess 3511463 00:14:42.441 12:42:15 -- common/autotest_common.sh@936 -- # '[' -z 3511463 ']' 00:14:42.441 12:42:15 -- common/autotest_common.sh@940 -- # kill -0 3511463 00:14:42.441 12:42:15 -- common/autotest_common.sh@941 -- # uname 00:14:42.441 12:42:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:42.441 12:42:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3511463 00:14:42.441 12:42:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:42.441 12:42:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:42.441 12:42:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3511463' 00:14:42.441 killing process with pid 3511463 00:14:42.441 12:42:15 -- common/autotest_common.sh@955 -- # kill 3511463 00:14:42.441 12:42:15 -- common/autotest_common.sh@960 -- # wait 3511463 00:14:42.701 12:42:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:42.701 12:42:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:42.701 12:42:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:42.701 12:42:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:42.701 12:42:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:42.701 12:42:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:42.701 12:42:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:42.701 12:42:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.611 12:42:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:44.611 00:14:44.611 real 0m7.157s 00:14:44.611 user 0m16.031s 00:14:44.611 sys 0m3.663s 00:14:44.611 12:42:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:44.611 12:42:17 -- common/autotest_common.sh@10 -- # set +x 00:14:44.611 ************************************ 00:14:44.611 END TEST nvmf_bdev_io_wait 00:14:44.611 ************************************ 00:14:44.611 12:42:17 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:14:44.611 12:42:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:44.611 12:42:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:44.611 12:42:17 -- common/autotest_common.sh@10 -- # set +x 00:14:44.611 ************************************ 00:14:44.611 START TEST nvmf_queue_depth 00:14:44.611 ************************************ 00:14:44.611 12:42:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:14:44.611 * Looking for test storage... 00:14:44.611 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:44.611 12:42:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:44.611 12:42:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:44.611 12:42:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:44.870 12:42:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:44.870 12:42:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:44.870 12:42:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:44.870 12:42:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:44.870 12:42:17 -- scripts/common.sh@335 -- # IFS=.-: 00:14:44.870 12:42:17 -- scripts/common.sh@335 -- # read -ra ver1 00:14:44.870 12:42:17 -- scripts/common.sh@336 -- # IFS=.-: 00:14:44.870 12:42:17 -- scripts/common.sh@336 -- # read -ra ver2 00:14:44.870 12:42:17 -- scripts/common.sh@337 -- # local 'op=<' 00:14:44.870 12:42:17 -- scripts/common.sh@339 -- # ver1_l=2 00:14:44.870 12:42:17 -- scripts/common.sh@340 -- # ver2_l=1 00:14:44.870 12:42:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:44.870 12:42:17 -- scripts/common.sh@343 -- # case "$op" in 00:14:44.870 12:42:17 -- scripts/common.sh@344 -- # : 1 00:14:44.870 12:42:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:44.870 12:42:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:44.870 12:42:17 -- scripts/common.sh@364 -- # decimal 1 00:14:44.870 12:42:17 -- scripts/common.sh@352 -- # local d=1 00:14:44.870 12:42:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:44.870 12:42:17 -- scripts/common.sh@354 -- # echo 1 00:14:44.870 12:42:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:44.870 12:42:17 -- scripts/common.sh@365 -- # decimal 2 00:14:44.870 12:42:17 -- scripts/common.sh@352 -- # local d=2 00:14:44.870 12:42:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:44.870 12:42:17 -- scripts/common.sh@354 -- # echo 2 00:14:44.870 12:42:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:44.870 12:42:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:44.870 12:42:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:44.870 12:42:17 -- scripts/common.sh@367 -- # return 0 00:14:44.870 12:42:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:44.870 12:42:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:44.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.870 --rc genhtml_branch_coverage=1 00:14:44.870 --rc genhtml_function_coverage=1 00:14:44.870 --rc genhtml_legend=1 00:14:44.870 --rc geninfo_all_blocks=1 00:14:44.870 --rc geninfo_unexecuted_blocks=1 00:14:44.870 00:14:44.870 ' 00:14:44.870 12:42:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:44.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.870 --rc genhtml_branch_coverage=1 00:14:44.870 --rc genhtml_function_coverage=1 00:14:44.870 --rc genhtml_legend=1 00:14:44.870 --rc geninfo_all_blocks=1 00:14:44.870 --rc geninfo_unexecuted_blocks=1 00:14:44.870 00:14:44.870 ' 00:14:44.870 12:42:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:44.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.870 --rc genhtml_branch_coverage=1 00:14:44.870 --rc genhtml_function_coverage=1 00:14:44.870 --rc genhtml_legend=1 00:14:44.870 --rc geninfo_all_blocks=1 00:14:44.870 --rc geninfo_unexecuted_blocks=1 00:14:44.870 00:14:44.870 ' 00:14:44.870 12:42:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:44.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.870 --rc genhtml_branch_coverage=1 00:14:44.870 --rc genhtml_function_coverage=1 00:14:44.870 --rc genhtml_legend=1 00:14:44.870 --rc geninfo_all_blocks=1 00:14:44.870 --rc geninfo_unexecuted_blocks=1 00:14:44.870 00:14:44.870 ' 00:14:44.870 12:42:17 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:44.870 12:42:17 -- nvmf/common.sh@7 -- # uname -s 00:14:44.870 12:42:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:44.870 12:42:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:44.870 12:42:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:44.870 12:42:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:44.870 12:42:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:44.870 12:42:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:44.870 12:42:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:44.870 12:42:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:44.870 12:42:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:44.870 12:42:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:44.870 12:42:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.870 12:42:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.870 12:42:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:44.870 12:42:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:44.870 12:42:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:44.870 12:42:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:44.870 12:42:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:44.870 12:42:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:44.870 12:42:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:44.871 12:42:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.871 12:42:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.871 12:42:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.871 12:42:17 -- paths/export.sh@5 -- # export PATH 00:14:44.871 12:42:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.871 12:42:17 -- nvmf/common.sh@46 -- # : 0 00:14:44.871 12:42:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:44.871 12:42:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:44.871 12:42:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:44.871 12:42:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:44.871 12:42:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:44.871 12:42:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:44.871 12:42:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:44.871 12:42:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:44.871 12:42:17 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:14:44.871 12:42:17 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:14:44.871 12:42:17 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:44.871 12:42:17 -- target/queue_depth.sh@19 -- # nvmftestinit 00:14:44.871 12:42:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:44.871 12:42:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:44.871 12:42:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:44.871 12:42:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:44.871 12:42:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:44.871 12:42:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.871 12:42:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.871 12:42:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.871 12:42:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:44.871 12:42:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:44.871 12:42:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:44.871 12:42:17 -- common/autotest_common.sh@10 -- # set +x 00:14:47.411 12:42:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:47.411 12:42:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:47.411 12:42:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:47.411 12:42:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:47.411 12:42:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:47.411 12:42:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:47.411 12:42:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:47.411 12:42:19 -- nvmf/common.sh@294 -- # net_devs=() 00:14:47.411 12:42:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:47.411 12:42:19 -- nvmf/common.sh@295 -- # e810=() 00:14:47.411 12:42:19 -- nvmf/common.sh@295 -- # local -ga e810 00:14:47.411 12:42:19 -- nvmf/common.sh@296 -- # x722=() 00:14:47.411 12:42:19 -- nvmf/common.sh@296 -- # local -ga x722 00:14:47.411 12:42:19 -- nvmf/common.sh@297 -- # mlx=() 00:14:47.411 12:42:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:47.411 12:42:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:47.411 12:42:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:47.411 12:42:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:47.411 12:42:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:47.411 12:42:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:47.411 12:42:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:47.411 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:47.411 12:42:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:47.411 12:42:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:47.411 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:47.411 12:42:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:47.411 12:42:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:47.411 12:42:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:47.411 12:42:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:47.411 12:42:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:47.411 12:42:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:47.411 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:47.411 12:42:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:47.411 12:42:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:47.411 12:42:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:47.411 12:42:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:47.411 12:42:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:47.411 12:42:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:47.411 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:47.411 12:42:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:47.411 12:42:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:47.411 12:42:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:47.411 12:42:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:47.411 12:42:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:47.411 12:42:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:47.411 12:42:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:47.411 12:42:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:47.411 12:42:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:47.411 12:42:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:47.411 12:42:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:47.411 12:42:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:47.411 12:42:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:47.411 12:42:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:47.412 12:42:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:47.412 12:42:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:47.412 12:42:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:47.412 12:42:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:47.412 12:42:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:47.412 12:42:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:47.412 12:42:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:47.412 12:42:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:47.412 12:42:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:47.412 12:42:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:47.412 12:42:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:47.412 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:47.412 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.358 ms 00:14:47.412 00:14:47.412 --- 10.0.0.2 ping statistics --- 00:14:47.412 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:47.412 rtt min/avg/max/mdev = 0.358/0.358/0.358/0.000 ms 00:14:47.412 12:42:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:47.412 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:47.412 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:14:47.412 00:14:47.412 --- 10.0.0.1 ping statistics --- 00:14:47.412 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:47.412 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:14:47.412 12:42:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:47.412 12:42:20 -- nvmf/common.sh@410 -- # return 0 00:14:47.412 12:42:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:47.412 12:42:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:47.412 12:42:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:47.412 12:42:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:47.412 12:42:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:47.412 12:42:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:47.412 12:42:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:47.412 12:42:20 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:14:47.412 12:42:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:47.412 12:42:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:47.412 12:42:20 -- common/autotest_common.sh@10 -- # set +x 00:14:47.412 12:42:20 -- nvmf/common.sh@469 -- # nvmfpid=3513864 00:14:47.412 12:42:20 -- nvmf/common.sh@470 -- # waitforlisten 3513864 00:14:47.412 12:42:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:47.412 12:42:20 -- common/autotest_common.sh@829 -- # '[' -z 3513864 ']' 00:14:47.412 12:42:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:47.412 12:42:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:47.412 12:42:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:47.412 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:47.412 12:42:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:47.412 12:42:20 -- common/autotest_common.sh@10 -- # set +x 00:14:47.412 [2024-11-20 12:42:20.107349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:47.412 [2024-11-20 12:42:20.107418] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:47.412 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.412 [2024-11-20 12:42:20.171897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:47.412 [2024-11-20 12:42:20.280217] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:47.412 [2024-11-20 12:42:20.280372] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:47.412 [2024-11-20 12:42:20.280389] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:47.412 [2024-11-20 12:42:20.280400] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:47.412 [2024-11-20 12:42:20.280446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:47.979 12:42:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:47.979 12:42:21 -- common/autotest_common.sh@862 -- # return 0 00:14:47.979 12:42:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:47.979 12:42:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:47.980 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 12:42:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:48.238 12:42:21 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:48.238 12:42:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.238 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 [2024-11-20 12:42:21.099494] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:48.238 12:42:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.238 12:42:21 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:48.238 12:42:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.238 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 Malloc0 00:14:48.238 12:42:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.238 12:42:21 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:48.238 12:42:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.238 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 12:42:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.238 12:42:21 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:48.238 12:42:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.238 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 12:42:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.238 12:42:21 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:48.238 12:42:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.238 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 [2024-11-20 12:42:21.164249] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:48.238 12:42:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.238 12:42:21 -- target/queue_depth.sh@30 -- # bdevperf_pid=3514020 00:14:48.238 12:42:21 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:14:48.238 12:42:21 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:48.238 12:42:21 -- target/queue_depth.sh@33 -- # waitforlisten 3514020 /var/tmp/bdevperf.sock 00:14:48.238 12:42:21 -- common/autotest_common.sh@829 -- # '[' -z 3514020 ']' 00:14:48.238 12:42:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:48.238 12:42:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:48.238 12:42:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:48.238 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:48.238 12:42:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:48.238 12:42:21 -- common/autotest_common.sh@10 -- # set +x 00:14:48.238 [2024-11-20 12:42:21.207937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:48.238 [2024-11-20 12:42:21.207997] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3514020 ] 00:14:48.238 EAL: No free 2048 kB hugepages reported on node 1 00:14:48.238 [2024-11-20 12:42:21.269157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:48.498 [2024-11-20 12:42:21.384174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:49.436 12:42:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:49.436 12:42:22 -- common/autotest_common.sh@862 -- # return 0 00:14:49.436 12:42:22 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:14:49.436 12:42:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.436 12:42:22 -- common/autotest_common.sh@10 -- # set +x 00:14:49.436 NVMe0n1 00:14:49.436 12:42:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.436 12:42:22 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:49.436 Running I/O for 10 seconds... 00:15:01.663 00:15:01.663 Latency(us) 00:15:01.663 [2024-11-20T11:42:34.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.663 [2024-11-20T11:42:34.771Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:01.663 Verification LBA range: start 0x0 length 0x4000 00:15:01.663 NVMe0n1 : 10.07 12451.02 48.64 0.00 0.00 81921.76 13883.92 62526.20 00:15:01.663 [2024-11-20T11:42:34.771Z] =================================================================================================================== 00:15:01.663 [2024-11-20T11:42:34.771Z] Total : 12451.02 48.64 0.00 0.00 81921.76 13883.92 62526.20 00:15:01.663 0 00:15:01.663 12:42:32 -- target/queue_depth.sh@39 -- # killprocess 3514020 00:15:01.663 12:42:32 -- common/autotest_common.sh@936 -- # '[' -z 3514020 ']' 00:15:01.663 12:42:32 -- common/autotest_common.sh@940 -- # kill -0 3514020 00:15:01.663 12:42:32 -- common/autotest_common.sh@941 -- # uname 00:15:01.663 12:42:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:01.663 12:42:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3514020 00:15:01.663 12:42:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:01.663 12:42:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:01.663 12:42:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3514020' 00:15:01.663 killing process with pid 3514020 00:15:01.663 12:42:32 -- common/autotest_common.sh@955 -- # kill 3514020 00:15:01.663 Received shutdown signal, test time was about 10.000000 seconds 00:15:01.663 00:15:01.663 Latency(us) 00:15:01.663 [2024-11-20T11:42:34.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.663 [2024-11-20T11:42:34.771Z] =================================================================================================================== 00:15:01.663 [2024-11-20T11:42:34.771Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:01.663 12:42:32 -- common/autotest_common.sh@960 -- # wait 3514020 00:15:01.663 12:42:32 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:01.663 12:42:32 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:01.663 12:42:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:01.663 12:42:32 -- nvmf/common.sh@116 -- # sync 00:15:01.663 12:42:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:01.663 12:42:32 -- nvmf/common.sh@119 -- # set +e 00:15:01.663 12:42:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:01.663 12:42:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:01.663 rmmod nvme_tcp 00:15:01.663 rmmod nvme_fabrics 00:15:01.663 rmmod nvme_keyring 00:15:01.663 12:42:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:01.663 12:42:32 -- nvmf/common.sh@123 -- # set -e 00:15:01.663 12:42:32 -- nvmf/common.sh@124 -- # return 0 00:15:01.663 12:42:32 -- nvmf/common.sh@477 -- # '[' -n 3513864 ']' 00:15:01.663 12:42:32 -- nvmf/common.sh@478 -- # killprocess 3513864 00:15:01.663 12:42:32 -- common/autotest_common.sh@936 -- # '[' -z 3513864 ']' 00:15:01.663 12:42:32 -- common/autotest_common.sh@940 -- # kill -0 3513864 00:15:01.663 12:42:32 -- common/autotest_common.sh@941 -- # uname 00:15:01.663 12:42:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:01.663 12:42:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3513864 00:15:01.663 12:42:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:01.663 12:42:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:01.663 12:42:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3513864' 00:15:01.663 killing process with pid 3513864 00:15:01.663 12:42:33 -- common/autotest_common.sh@955 -- # kill 3513864 00:15:01.663 12:42:33 -- common/autotest_common.sh@960 -- # wait 3513864 00:15:01.663 12:42:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:01.663 12:42:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:01.663 12:42:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:01.663 12:42:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:01.663 12:42:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:01.663 12:42:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:01.663 12:42:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:01.663 12:42:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.605 12:42:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:02.605 00:15:02.605 real 0m17.689s 00:15:02.605 user 0m25.314s 00:15:02.605 sys 0m3.229s 00:15:02.605 12:42:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:02.605 12:42:35 -- common/autotest_common.sh@10 -- # set +x 00:15:02.605 ************************************ 00:15:02.605 END TEST nvmf_queue_depth 00:15:02.605 ************************************ 00:15:02.605 12:42:35 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:02.605 12:42:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:02.605 12:42:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:02.605 12:42:35 -- common/autotest_common.sh@10 -- # set +x 00:15:02.605 ************************************ 00:15:02.605 START TEST nvmf_multipath 00:15:02.605 ************************************ 00:15:02.605 12:42:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:02.605 * Looking for test storage... 00:15:02.605 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:02.605 12:42:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:02.605 12:42:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:02.605 12:42:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:02.605 12:42:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:02.605 12:42:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:02.605 12:42:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:02.605 12:42:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:02.605 12:42:35 -- scripts/common.sh@335 -- # IFS=.-: 00:15:02.605 12:42:35 -- scripts/common.sh@335 -- # read -ra ver1 00:15:02.605 12:42:35 -- scripts/common.sh@336 -- # IFS=.-: 00:15:02.605 12:42:35 -- scripts/common.sh@336 -- # read -ra ver2 00:15:02.605 12:42:35 -- scripts/common.sh@337 -- # local 'op=<' 00:15:02.605 12:42:35 -- scripts/common.sh@339 -- # ver1_l=2 00:15:02.605 12:42:35 -- scripts/common.sh@340 -- # ver2_l=1 00:15:02.605 12:42:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:02.605 12:42:35 -- scripts/common.sh@343 -- # case "$op" in 00:15:02.605 12:42:35 -- scripts/common.sh@344 -- # : 1 00:15:02.605 12:42:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:02.605 12:42:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:02.605 12:42:35 -- scripts/common.sh@364 -- # decimal 1 00:15:02.605 12:42:35 -- scripts/common.sh@352 -- # local d=1 00:15:02.605 12:42:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:02.605 12:42:35 -- scripts/common.sh@354 -- # echo 1 00:15:02.605 12:42:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:02.605 12:42:35 -- scripts/common.sh@365 -- # decimal 2 00:15:02.605 12:42:35 -- scripts/common.sh@352 -- # local d=2 00:15:02.605 12:42:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:02.605 12:42:35 -- scripts/common.sh@354 -- # echo 2 00:15:02.605 12:42:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:02.605 12:42:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:02.605 12:42:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:02.605 12:42:35 -- scripts/common.sh@367 -- # return 0 00:15:02.605 12:42:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:02.605 12:42:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:02.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.605 --rc genhtml_branch_coverage=1 00:15:02.605 --rc genhtml_function_coverage=1 00:15:02.605 --rc genhtml_legend=1 00:15:02.605 --rc geninfo_all_blocks=1 00:15:02.605 --rc geninfo_unexecuted_blocks=1 00:15:02.605 00:15:02.605 ' 00:15:02.605 12:42:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:02.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.605 --rc genhtml_branch_coverage=1 00:15:02.605 --rc genhtml_function_coverage=1 00:15:02.605 --rc genhtml_legend=1 00:15:02.605 --rc geninfo_all_blocks=1 00:15:02.605 --rc geninfo_unexecuted_blocks=1 00:15:02.605 00:15:02.605 ' 00:15:02.605 12:42:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:02.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.605 --rc genhtml_branch_coverage=1 00:15:02.605 --rc genhtml_function_coverage=1 00:15:02.605 --rc genhtml_legend=1 00:15:02.605 --rc geninfo_all_blocks=1 00:15:02.605 --rc geninfo_unexecuted_blocks=1 00:15:02.605 00:15:02.605 ' 00:15:02.605 12:42:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:02.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.605 --rc genhtml_branch_coverage=1 00:15:02.605 --rc genhtml_function_coverage=1 00:15:02.605 --rc genhtml_legend=1 00:15:02.605 --rc geninfo_all_blocks=1 00:15:02.605 --rc geninfo_unexecuted_blocks=1 00:15:02.605 00:15:02.605 ' 00:15:02.605 12:42:35 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:02.605 12:42:35 -- nvmf/common.sh@7 -- # uname -s 00:15:02.605 12:42:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:02.605 12:42:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:02.605 12:42:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:02.605 12:42:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:02.605 12:42:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:02.605 12:42:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:02.605 12:42:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:02.605 12:42:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:02.605 12:42:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:02.605 12:42:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:02.605 12:42:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.605 12:42:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.605 12:42:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:02.605 12:42:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:02.606 12:42:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:02.606 12:42:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:02.606 12:42:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:02.606 12:42:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:02.606 12:42:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:02.606 12:42:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.606 12:42:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.606 12:42:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.606 12:42:35 -- paths/export.sh@5 -- # export PATH 00:15:02.606 12:42:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.606 12:42:35 -- nvmf/common.sh@46 -- # : 0 00:15:02.606 12:42:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:02.606 12:42:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:02.606 12:42:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:02.606 12:42:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:02.606 12:42:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:02.606 12:42:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:02.606 12:42:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:02.606 12:42:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:02.606 12:42:35 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:02.606 12:42:35 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:02.606 12:42:35 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:02.606 12:42:35 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:02.606 12:42:35 -- target/multipath.sh@43 -- # nvmftestinit 00:15:02.606 12:42:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:02.606 12:42:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:02.606 12:42:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:02.606 12:42:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:02.606 12:42:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:02.606 12:42:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.606 12:42:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.606 12:42:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.606 12:42:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:02.606 12:42:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:02.606 12:42:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:02.606 12:42:35 -- common/autotest_common.sh@10 -- # set +x 00:15:04.513 12:42:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:04.513 12:42:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:04.513 12:42:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:04.513 12:42:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:04.513 12:42:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:04.513 12:42:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:04.513 12:42:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:04.513 12:42:37 -- nvmf/common.sh@294 -- # net_devs=() 00:15:04.513 12:42:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:04.513 12:42:37 -- nvmf/common.sh@295 -- # e810=() 00:15:04.513 12:42:37 -- nvmf/common.sh@295 -- # local -ga e810 00:15:04.513 12:42:37 -- nvmf/common.sh@296 -- # x722=() 00:15:04.513 12:42:37 -- nvmf/common.sh@296 -- # local -ga x722 00:15:04.513 12:42:37 -- nvmf/common.sh@297 -- # mlx=() 00:15:04.513 12:42:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:04.513 12:42:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:04.513 12:42:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:04.513 12:42:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:04.513 12:42:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:04.513 12:42:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.513 12:42:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:04.513 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:04.513 12:42:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.513 12:42:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:04.513 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:04.513 12:42:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:04.513 12:42:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.513 12:42:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.513 12:42:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.513 12:42:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.513 12:42:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:04.513 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:04.513 12:42:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.513 12:42:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.513 12:42:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.513 12:42:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.513 12:42:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.513 12:42:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:04.513 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:04.513 12:42:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.513 12:42:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:04.513 12:42:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:04.513 12:42:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:04.513 12:42:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:04.513 12:42:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:04.513 12:42:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:04.513 12:42:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:04.513 12:42:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:04.513 12:42:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:04.513 12:42:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:04.513 12:42:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:04.513 12:42:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:04.513 12:42:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:04.513 12:42:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:04.513 12:42:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:04.513 12:42:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:04.513 12:42:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:04.773 12:42:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:04.773 12:42:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:04.773 12:42:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:04.773 12:42:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:04.773 12:42:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:04.773 12:42:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:04.773 12:42:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:04.773 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:04.773 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:15:04.773 00:15:04.773 --- 10.0.0.2 ping statistics --- 00:15:04.773 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.773 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:15:04.773 12:42:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:04.773 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:04.773 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:15:04.773 00:15:04.773 --- 10.0.0.1 ping statistics --- 00:15:04.773 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.773 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:15:04.773 12:42:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:04.773 12:42:37 -- nvmf/common.sh@410 -- # return 0 00:15:04.773 12:42:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:04.773 12:42:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:04.773 12:42:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:04.773 12:42:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:04.773 12:42:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:04.773 12:42:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:04.773 12:42:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:04.773 12:42:37 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:04.773 12:42:37 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:04.773 only one NIC for nvmf test 00:15:04.773 12:42:37 -- target/multipath.sh@47 -- # nvmftestfini 00:15:04.773 12:42:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:04.773 12:42:37 -- nvmf/common.sh@116 -- # sync 00:15:04.773 12:42:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:04.773 12:42:37 -- nvmf/common.sh@119 -- # set +e 00:15:04.773 12:42:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:04.773 12:42:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:04.773 rmmod nvme_tcp 00:15:05.033 rmmod nvme_fabrics 00:15:05.033 rmmod nvme_keyring 00:15:05.033 12:42:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:05.033 12:42:37 -- nvmf/common.sh@123 -- # set -e 00:15:05.033 12:42:37 -- nvmf/common.sh@124 -- # return 0 00:15:05.033 12:42:37 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:05.033 12:42:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:05.033 12:42:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:05.033 12:42:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:05.033 12:42:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:05.033 12:42:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:05.033 12:42:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:05.033 12:42:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:05.033 12:42:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.943 12:42:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:06.944 12:42:39 -- target/multipath.sh@48 -- # exit 0 00:15:06.944 12:42:39 -- target/multipath.sh@1 -- # nvmftestfini 00:15:06.944 12:42:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:06.944 12:42:39 -- nvmf/common.sh@116 -- # sync 00:15:06.944 12:42:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:06.944 12:42:39 -- nvmf/common.sh@119 -- # set +e 00:15:06.944 12:42:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:06.944 12:42:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:06.944 12:42:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:06.944 12:42:39 -- nvmf/common.sh@123 -- # set -e 00:15:06.944 12:42:39 -- nvmf/common.sh@124 -- # return 0 00:15:06.944 12:42:39 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:06.944 12:42:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:06.944 12:42:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:06.944 12:42:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:06.944 12:42:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:06.944 12:42:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:06.944 12:42:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.944 12:42:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.944 12:42:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.944 12:42:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:06.944 00:15:06.944 real 0m4.616s 00:15:06.944 user 0m0.896s 00:15:06.944 sys 0m1.586s 00:15:06.944 12:42:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:06.944 12:42:39 -- common/autotest_common.sh@10 -- # set +x 00:15:06.944 ************************************ 00:15:06.944 END TEST nvmf_multipath 00:15:06.944 ************************************ 00:15:06.944 12:42:40 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:06.944 12:42:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:06.944 12:42:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:06.944 12:42:40 -- common/autotest_common.sh@10 -- # set +x 00:15:06.944 ************************************ 00:15:06.944 START TEST nvmf_zcopy 00:15:06.944 ************************************ 00:15:06.944 12:42:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:07.202 * Looking for test storage... 00:15:07.202 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:07.202 12:42:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:07.202 12:42:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:07.202 12:42:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:07.202 12:42:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:07.202 12:42:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:07.202 12:42:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:07.202 12:42:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:07.202 12:42:40 -- scripts/common.sh@335 -- # IFS=.-: 00:15:07.202 12:42:40 -- scripts/common.sh@335 -- # read -ra ver1 00:15:07.202 12:42:40 -- scripts/common.sh@336 -- # IFS=.-: 00:15:07.202 12:42:40 -- scripts/common.sh@336 -- # read -ra ver2 00:15:07.202 12:42:40 -- scripts/common.sh@337 -- # local 'op=<' 00:15:07.202 12:42:40 -- scripts/common.sh@339 -- # ver1_l=2 00:15:07.202 12:42:40 -- scripts/common.sh@340 -- # ver2_l=1 00:15:07.202 12:42:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:07.202 12:42:40 -- scripts/common.sh@343 -- # case "$op" in 00:15:07.202 12:42:40 -- scripts/common.sh@344 -- # : 1 00:15:07.202 12:42:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:07.202 12:42:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:07.202 12:42:40 -- scripts/common.sh@364 -- # decimal 1 00:15:07.202 12:42:40 -- scripts/common.sh@352 -- # local d=1 00:15:07.202 12:42:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:07.202 12:42:40 -- scripts/common.sh@354 -- # echo 1 00:15:07.202 12:42:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:07.202 12:42:40 -- scripts/common.sh@365 -- # decimal 2 00:15:07.202 12:42:40 -- scripts/common.sh@352 -- # local d=2 00:15:07.202 12:42:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:07.202 12:42:40 -- scripts/common.sh@354 -- # echo 2 00:15:07.202 12:42:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:07.202 12:42:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:07.202 12:42:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:07.202 12:42:40 -- scripts/common.sh@367 -- # return 0 00:15:07.202 12:42:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:07.202 12:42:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:07.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:07.202 --rc genhtml_branch_coverage=1 00:15:07.202 --rc genhtml_function_coverage=1 00:15:07.202 --rc genhtml_legend=1 00:15:07.202 --rc geninfo_all_blocks=1 00:15:07.202 --rc geninfo_unexecuted_blocks=1 00:15:07.202 00:15:07.202 ' 00:15:07.202 12:42:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:07.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:07.202 --rc genhtml_branch_coverage=1 00:15:07.202 --rc genhtml_function_coverage=1 00:15:07.202 --rc genhtml_legend=1 00:15:07.202 --rc geninfo_all_blocks=1 00:15:07.202 --rc geninfo_unexecuted_blocks=1 00:15:07.202 00:15:07.202 ' 00:15:07.202 12:42:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:07.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:07.202 --rc genhtml_branch_coverage=1 00:15:07.202 --rc genhtml_function_coverage=1 00:15:07.202 --rc genhtml_legend=1 00:15:07.202 --rc geninfo_all_blocks=1 00:15:07.202 --rc geninfo_unexecuted_blocks=1 00:15:07.202 00:15:07.202 ' 00:15:07.202 12:42:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:07.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:07.202 --rc genhtml_branch_coverage=1 00:15:07.203 --rc genhtml_function_coverage=1 00:15:07.203 --rc genhtml_legend=1 00:15:07.203 --rc geninfo_all_blocks=1 00:15:07.203 --rc geninfo_unexecuted_blocks=1 00:15:07.203 00:15:07.203 ' 00:15:07.203 12:42:40 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:07.203 12:42:40 -- nvmf/common.sh@7 -- # uname -s 00:15:07.203 12:42:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:07.203 12:42:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:07.203 12:42:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:07.203 12:42:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:07.203 12:42:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:07.203 12:42:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:07.203 12:42:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:07.203 12:42:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:07.203 12:42:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:07.203 12:42:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:07.203 12:42:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:07.203 12:42:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:07.203 12:42:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:07.203 12:42:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:07.203 12:42:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:07.203 12:42:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:07.203 12:42:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:07.203 12:42:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:07.203 12:42:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:07.203 12:42:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.203 12:42:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.203 12:42:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.203 12:42:40 -- paths/export.sh@5 -- # export PATH 00:15:07.203 12:42:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.203 12:42:40 -- nvmf/common.sh@46 -- # : 0 00:15:07.203 12:42:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:07.203 12:42:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:07.203 12:42:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:07.203 12:42:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:07.203 12:42:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:07.203 12:42:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:07.203 12:42:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:07.203 12:42:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:07.203 12:42:40 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:07.203 12:42:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:07.203 12:42:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:07.203 12:42:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:07.203 12:42:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:07.203 12:42:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:07.203 12:42:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:07.203 12:42:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:07.203 12:42:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:07.203 12:42:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:07.203 12:42:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:07.203 12:42:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:07.203 12:42:40 -- common/autotest_common.sh@10 -- # set +x 00:15:09.107 12:42:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:09.107 12:42:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:09.107 12:42:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:09.107 12:42:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:09.107 12:42:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:09.107 12:42:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:09.107 12:42:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:09.107 12:42:42 -- nvmf/common.sh@294 -- # net_devs=() 00:15:09.107 12:42:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:09.107 12:42:42 -- nvmf/common.sh@295 -- # e810=() 00:15:09.107 12:42:42 -- nvmf/common.sh@295 -- # local -ga e810 00:15:09.107 12:42:42 -- nvmf/common.sh@296 -- # x722=() 00:15:09.107 12:42:42 -- nvmf/common.sh@296 -- # local -ga x722 00:15:09.107 12:42:42 -- nvmf/common.sh@297 -- # mlx=() 00:15:09.107 12:42:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:09.107 12:42:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:09.107 12:42:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:09.107 12:42:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:09.107 12:42:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:09.107 12:42:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:09.107 12:42:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:09.107 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:09.107 12:42:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:09.107 12:42:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:09.108 12:42:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:09.108 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:09.108 12:42:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:09.108 12:42:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:09.108 12:42:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:09.108 12:42:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:09.108 12:42:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:09.108 12:42:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:09.108 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:09.108 12:42:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:09.108 12:42:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:09.108 12:42:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:09.108 12:42:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:09.108 12:42:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:09.108 12:42:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:09.108 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:09.108 12:42:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:09.108 12:42:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:09.108 12:42:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:09.108 12:42:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:09.108 12:42:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:09.108 12:42:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:09.108 12:42:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:09.108 12:42:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:09.108 12:42:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:09.108 12:42:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:09.108 12:42:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:09.108 12:42:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:09.108 12:42:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:09.108 12:42:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:09.108 12:42:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:09.108 12:42:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:09.108 12:42:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:09.108 12:42:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:09.380 12:42:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:09.380 12:42:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:09.380 12:42:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:09.380 12:42:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:09.380 12:42:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:09.380 12:42:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:09.380 12:42:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:09.380 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:09.380 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.162 ms 00:15:09.380 00:15:09.380 --- 10.0.0.2 ping statistics --- 00:15:09.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:09.380 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:15:09.380 12:42:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:09.380 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:09.380 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:15:09.380 00:15:09.380 --- 10.0.0.1 ping statistics --- 00:15:09.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:09.380 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:15:09.380 12:42:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:09.380 12:42:42 -- nvmf/common.sh@410 -- # return 0 00:15:09.380 12:42:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:09.380 12:42:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:09.380 12:42:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:09.380 12:42:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:09.380 12:42:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:09.380 12:42:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:09.380 12:42:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:09.380 12:42:42 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:09.380 12:42:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:09.380 12:42:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:09.380 12:42:42 -- common/autotest_common.sh@10 -- # set +x 00:15:09.380 12:42:42 -- nvmf/common.sh@469 -- # nvmfpid=3519289 00:15:09.380 12:42:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:09.380 12:42:42 -- nvmf/common.sh@470 -- # waitforlisten 3519289 00:15:09.380 12:42:42 -- common/autotest_common.sh@829 -- # '[' -z 3519289 ']' 00:15:09.380 12:42:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:09.380 12:42:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:09.380 12:42:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:09.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:09.380 12:42:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:09.380 12:42:42 -- common/autotest_common.sh@10 -- # set +x 00:15:09.380 [2024-11-20 12:42:42.376626] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:09.380 [2024-11-20 12:42:42.376705] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:09.380 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.380 [2024-11-20 12:42:42.454228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:09.668 [2024-11-20 12:42:42.575184] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:09.668 [2024-11-20 12:42:42.575348] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:09.668 [2024-11-20 12:42:42.575366] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:09.668 [2024-11-20 12:42:42.575379] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:09.668 [2024-11-20 12:42:42.575427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:10.637 12:42:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:10.637 12:42:43 -- common/autotest_common.sh@862 -- # return 0 00:15:10.637 12:42:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:10.637 12:42:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 12:42:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:10.637 12:42:43 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:10.637 12:42:43 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:10.637 12:42:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 [2024-11-20 12:42:43.453913] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:10.637 12:42:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.637 12:42:43 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:10.637 12:42:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 12:42:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.637 12:42:43 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:10.637 12:42:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 [2024-11-20 12:42:43.470124] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:10.637 12:42:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.637 12:42:43 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:10.637 12:42:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 12:42:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.637 12:42:43 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:10.637 12:42:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 malloc0 00:15:10.637 12:42:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.637 12:42:43 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:10.637 12:42:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.637 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.637 12:42:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.637 12:42:43 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:10.637 12:42:43 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:10.637 12:42:43 -- nvmf/common.sh@520 -- # config=() 00:15:10.637 12:42:43 -- nvmf/common.sh@520 -- # local subsystem config 00:15:10.637 12:42:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:10.637 12:42:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:10.637 { 00:15:10.637 "params": { 00:15:10.637 "name": "Nvme$subsystem", 00:15:10.637 "trtype": "$TEST_TRANSPORT", 00:15:10.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:10.637 "adrfam": "ipv4", 00:15:10.637 "trsvcid": "$NVMF_PORT", 00:15:10.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:10.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:10.637 "hdgst": ${hdgst:-false}, 00:15:10.637 "ddgst": ${ddgst:-false} 00:15:10.637 }, 00:15:10.637 "method": "bdev_nvme_attach_controller" 00:15:10.637 } 00:15:10.637 EOF 00:15:10.637 )") 00:15:10.637 12:42:43 -- nvmf/common.sh@542 -- # cat 00:15:10.637 12:42:43 -- nvmf/common.sh@544 -- # jq . 00:15:10.637 12:42:43 -- nvmf/common.sh@545 -- # IFS=, 00:15:10.637 12:42:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:10.637 "params": { 00:15:10.637 "name": "Nvme1", 00:15:10.637 "trtype": "tcp", 00:15:10.637 "traddr": "10.0.0.2", 00:15:10.637 "adrfam": "ipv4", 00:15:10.637 "trsvcid": "4420", 00:15:10.637 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:10.637 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:10.637 "hdgst": false, 00:15:10.637 "ddgst": false 00:15:10.637 }, 00:15:10.637 "method": "bdev_nvme_attach_controller" 00:15:10.637 }' 00:15:10.637 [2024-11-20 12:42:43.543690] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:10.637 [2024-11-20 12:42:43.543780] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3519499 ] 00:15:10.637 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.637 [2024-11-20 12:42:43.609134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:10.638 [2024-11-20 12:42:43.724985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:11.207 Running I/O for 10 seconds... 00:15:21.191 00:15:21.191 Latency(us) 00:15:21.191 [2024-11-20T11:42:54.299Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:21.191 [2024-11-20T11:42:54.299Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:21.191 Verification LBA range: start 0x0 length 0x1000 00:15:21.191 Nvme1n1 : 10.01 8520.31 66.56 0.00 0.00 14987.43 1565.58 21942.42 00:15:21.191 [2024-11-20T11:42:54.299Z] =================================================================================================================== 00:15:21.191 [2024-11-20T11:42:54.299Z] Total : 8520.31 66.56 0.00 0.00 14987.43 1565.58 21942.42 00:15:21.451 12:42:54 -- target/zcopy.sh@39 -- # perfpid=3520799 00:15:21.451 12:42:54 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:21.451 12:42:54 -- common/autotest_common.sh@10 -- # set +x 00:15:21.451 12:42:54 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:21.451 12:42:54 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:21.451 12:42:54 -- nvmf/common.sh@520 -- # config=() 00:15:21.451 12:42:54 -- nvmf/common.sh@520 -- # local subsystem config 00:15:21.451 12:42:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:21.451 12:42:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:21.451 { 00:15:21.451 "params": { 00:15:21.451 "name": "Nvme$subsystem", 00:15:21.451 "trtype": "$TEST_TRANSPORT", 00:15:21.451 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:21.451 "adrfam": "ipv4", 00:15:21.451 "trsvcid": "$NVMF_PORT", 00:15:21.451 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:21.451 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:21.451 "hdgst": ${hdgst:-false}, 00:15:21.451 "ddgst": ${ddgst:-false} 00:15:21.451 }, 00:15:21.451 "method": "bdev_nvme_attach_controller" 00:15:21.451 } 00:15:21.451 EOF 00:15:21.451 )") 00:15:21.451 12:42:54 -- nvmf/common.sh@542 -- # cat 00:15:21.451 [2024-11-20 12:42:54.380109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.451 [2024-11-20 12:42:54.380164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.451 12:42:54 -- nvmf/common.sh@544 -- # jq . 00:15:21.451 12:42:54 -- nvmf/common.sh@545 -- # IFS=, 00:15:21.451 12:42:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:21.451 "params": { 00:15:21.451 "name": "Nvme1", 00:15:21.451 "trtype": "tcp", 00:15:21.451 "traddr": "10.0.0.2", 00:15:21.451 "adrfam": "ipv4", 00:15:21.451 "trsvcid": "4420", 00:15:21.451 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:21.451 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:21.451 "hdgst": false, 00:15:21.451 "ddgst": false 00:15:21.451 }, 00:15:21.451 "method": "bdev_nvme_attach_controller" 00:15:21.451 }' 00:15:21.451 [2024-11-20 12:42:54.388055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.451 [2024-11-20 12:42:54.388091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.451 [2024-11-20 12:42:54.396082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.396108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.404102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.404135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.412129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.412151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.414487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:21.452 [2024-11-20 12:42:54.414542] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3520799 ] 00:15:21.452 [2024-11-20 12:42:54.420164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.420186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.428178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.428199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.436202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.436224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.452 [2024-11-20 12:42:54.444215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.444236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.452241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.452263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.460262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.460284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.468284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.468307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.476303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.476325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.478432] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.452 [2024-11-20 12:42:54.484339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.484393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.492413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.492457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.500390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.500425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.508428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.508454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.516436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.516471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.524464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.524489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.532492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.532534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.540512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.540538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.548558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.548594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.452 [2024-11-20 12:42:54.556557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.452 [2024-11-20 12:42:54.556584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.564576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.564602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.572599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.572624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.580622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.580646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.588644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.588669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.596663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.596689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.596972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:21.712 [2024-11-20 12:42:54.604685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.604710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.612724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.612755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.620761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.620800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.628788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.628826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.636811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.636852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.644837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.644880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.652857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.652898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.660881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.660923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.668872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.668897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.676924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.676964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.684948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.684988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.692973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.693014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.700963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.700987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.708978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.709000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.717031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.717062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.725041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.725077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.733064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.733115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.741095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.741134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.749115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.749142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.757148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.757169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.765144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.765165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.773184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.773206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.781216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.781240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.789238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.789263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.797269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.797293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.805277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.805299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.712 [2024-11-20 12:42:54.813302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.712 [2024-11-20 12:42:54.813335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.821326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.821348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.829348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.829385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.837390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.837428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.845405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.845443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.853442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.853466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.861457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.861483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.869480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.869508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.877515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.877542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.885540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.885567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.893556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.893591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.901589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.901614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.909613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.909647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.917628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.917652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.925650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.925676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.933770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.933797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.941782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.941810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 Running I/O for 5 seconds... 00:15:21.973 [2024-11-20 12:42:54.949806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.949833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.965850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.965882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.977318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.977350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.988747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.988779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:54.999678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:54.999710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.010973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.011004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.022091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.022122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.032666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.032697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.043551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.043582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.055862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.055893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.065931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.065963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:21.973 [2024-11-20 12:42:55.077014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:21.973 [2024-11-20 12:42:55.077045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.232 [2024-11-20 12:42:55.089877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.232 [2024-11-20 12:42:55.089909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.232 [2024-11-20 12:42:55.100327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.232 [2024-11-20 12:42:55.100357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.232 [2024-11-20 12:42:55.111187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.232 [2024-11-20 12:42:55.111218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.232 [2024-11-20 12:42:55.124090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.232 [2024-11-20 12:42:55.124121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.232 [2024-11-20 12:42:55.134288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.232 [2024-11-20 12:42:55.134318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.144843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.144874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.155856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.155887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.168729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.168759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.179038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.179077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.189511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.189542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.200355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.200386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.211148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.211187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.224034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.224064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.234168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.234199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.244882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.244913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.257664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.257694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.269180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.269211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.277802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.277833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.290808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.290839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.301390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.301421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.312418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.312449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.323176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.323207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.233 [2024-11-20 12:42:55.334092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.233 [2024-11-20 12:42:55.334123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.346281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.346312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.355672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.355702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.366903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.366933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.378021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.378051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.389261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.389291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.400220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.400250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.410834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.410864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.421389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.421428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.431910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.431941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.442593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.442623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.453455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.453486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.466866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.466897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.477066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.477105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.487730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.487760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.498708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.498738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.509487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.509517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.520613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.520644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.531532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.531562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.544913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.544943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.555285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.555315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.566379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.566408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.579289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.579318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.492 [2024-11-20 12:42:55.589941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.492 [2024-11-20 12:42:55.589972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.600446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.600478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.611448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.611479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.622278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.622308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.634986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.635026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.645370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.645401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.656595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.656626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.667353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.667383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.678357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.678387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.690714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.690744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.699961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.699991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.711875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.711906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.724579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.724610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.735120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.735150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.745996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.746026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.758513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.758543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.767834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.767865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.778891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.778921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.789888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.789919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.802790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.802821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.813021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.813051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.824761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.824791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.835747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.835777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.846519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.846563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:22.753 [2024-11-20 12:42:55.857792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:22.753 [2024-11-20 12:42:55.857823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.869335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.869366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.880879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.880909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.891583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.891613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.902383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.902413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.914986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.915016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.925239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.925271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.936331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.936363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.946854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.013 [2024-11-20 12:42:55.946886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.013 [2024-11-20 12:42:55.957677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:55.957708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:55.970787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:55.970818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:55.981039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:55.981080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:55.992107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:55.992149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.004742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.004773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.014898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.014931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.026106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.026137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.038923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.038954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.048766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.048797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.060570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.060600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.071631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.071662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.082733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.082764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.093545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.093576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.106485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.106516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.014 [2024-11-20 12:42:56.116513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.014 [2024-11-20 12:42:56.116543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.274 [2024-11-20 12:42:56.128140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.274 [2024-11-20 12:42:56.128172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.274 [2024-11-20 12:42:56.138861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.274 [2024-11-20 12:42:56.138893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.274 [2024-11-20 12:42:56.150925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.274 [2024-11-20 12:42:56.150956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.274 [2024-11-20 12:42:56.160594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.274 [2024-11-20 12:42:56.160625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.274 [2024-11-20 12:42:56.172553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.172583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.183574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.183604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.196317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.196348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.206126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.206157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.217083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.217113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.227691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.227723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.238535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.238566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.249294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.249325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.259978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.260009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.270778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.270810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.281616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.281646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.292916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.292946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.303645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.303676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.316464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.316495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.326828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.326858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.338262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.338292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.348929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.348960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.359565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.359597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.275 [2024-11-20 12:42:56.372673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.275 [2024-11-20 12:42:56.372704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.383323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.383354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.394175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.394206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.405165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.405196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.416509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.416540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.429402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.429432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.440017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.440049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.450741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.450773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.463344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.463375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.473205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.473236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.484626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.484656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.495499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.495530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.506705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.506737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.517048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.517093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.528034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.528065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.540697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.535 [2024-11-20 12:42:56.540728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.535 [2024-11-20 12:42:56.550722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.550752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.562240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.562270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.573601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.573632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.586722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.586753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.597021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.597051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.607978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.608009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.620973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.621004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.630950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.630981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.536 [2024-11-20 12:42:56.641979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.536 [2024-11-20 12:42:56.642010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.654491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.654523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.664444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.664475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.675561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.675592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.686403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.686433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.697106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.697137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.708245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.708276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.719386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.719418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.732307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.732348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.742635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.742666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.753349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.753381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.764229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.764261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.775164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.775195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.787733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.787765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.797263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.797294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.808986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.809017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.821916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.821947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.832246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.832277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.843420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.843450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.795 [2024-11-20 12:42:56.856473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.795 [2024-11-20 12:42:56.856503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.796 [2024-11-20 12:42:56.866972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.796 [2024-11-20 12:42:56.867002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.796 [2024-11-20 12:42:56.877803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.796 [2024-11-20 12:42:56.877832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.796 [2024-11-20 12:42:56.890857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.796 [2024-11-20 12:42:56.890888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:23.796 [2024-11-20 12:42:56.901100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:23.796 [2024-11-20 12:42:56.901138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.911898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.911929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.922751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.922781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.933560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.933591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.946337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.946367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.956496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.956526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.968046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.968085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.054 [2024-11-20 12:42:56.978730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.054 [2024-11-20 12:42:56.978761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:56.989509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:56.989540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.002265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.002295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.012510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.012541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.023059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.023099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.034096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.034127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.044736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.044766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.056870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.056900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.066765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.066795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.077628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.077658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.088401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.088432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.099042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.099095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.111647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.111686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.121535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.121566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.132567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.132598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.144864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.144894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.055 [2024-11-20 12:42:57.155197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.055 [2024-11-20 12:42:57.155228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.315 [2024-11-20 12:42:57.166312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.315 [2024-11-20 12:42:57.166343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.315 [2024-11-20 12:42:57.177241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.315 [2024-11-20 12:42:57.177272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.315 [2024-11-20 12:42:57.188414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.315 [2024-11-20 12:42:57.188453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.315 [2024-11-20 12:42:57.201603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.201635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.211886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.211917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.222852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.222882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.235786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.235817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.246106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.246136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.256875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.256905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.270090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.270128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.280373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.280410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.291165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.291197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.304037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.304077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.313802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.313833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.324802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.324845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.337297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.337327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.347472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.347503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.358129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.358161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.369162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.369192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.380078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.380108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.392592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.392623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.402536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.402566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.316 [2024-11-20 12:42:57.414289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.316 [2024-11-20 12:42:57.414321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.425051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.425095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.436514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.436544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.447504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.447536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.458290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.458322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.469262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.469293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.481872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.481902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.491857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.491887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.502518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.502549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.513808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.513839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.524795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.524826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.537389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.537431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.547517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.547547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.559332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.559363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.570269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.570300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.581030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.581061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.591819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.591850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.604475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.604506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.614288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.614319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.625854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.625885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.636689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.577 [2024-11-20 12:42:57.636721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.577 [2024-11-20 12:42:57.647564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.578 [2024-11-20 12:42:57.647596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.578 [2024-11-20 12:42:57.660937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.578 [2024-11-20 12:42:57.660968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.578 [2024-11-20 12:42:57.671012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.578 [2024-11-20 12:42:57.671042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.578 [2024-11-20 12:42:57.682319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.578 [2024-11-20 12:42:57.682350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.693867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.838 [2024-11-20 12:42:57.693898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.704280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.838 [2024-11-20 12:42:57.704311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.715143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.838 [2024-11-20 12:42:57.715175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.726364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.838 [2024-11-20 12:42:57.726395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.739444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.838 [2024-11-20 12:42:57.739475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.749573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.838 [2024-11-20 12:42:57.749604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.838 [2024-11-20 12:42:57.760594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.760625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.773489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.773520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.783768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.783798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.794690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.794721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.807121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.807152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.817035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.817066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.828197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.828228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.841738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.841769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.852566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.852596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.863690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.863720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.876523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.876554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.886017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.886047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.897493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.897524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.908938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.908969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.919662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.919693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.932748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.932779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:24.839 [2024-11-20 12:42:57.942821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:24.839 [2024-11-20 12:42:57.942852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:57.954173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:57.954204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:57.966934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:57.966964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:57.976782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:57.976812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:57.987790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:57.987821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:58.000663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:58.000694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:58.011112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:58.011143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:58.021782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:58.021812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:58.034615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:58.034647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.098 [2024-11-20 12:42:58.044698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.098 [2024-11-20 12:42:58.044729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.055808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.055840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.068834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.068866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.079223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.079255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.089901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.089932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.102546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.102577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.114472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.114504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.123941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.123973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.135566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.135596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.146460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.146492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.157373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.157404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.168095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.168126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.180921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.180952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.190806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.190837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.099 [2024-11-20 12:42:58.201584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.099 [2024-11-20 12:42:58.201614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.214416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.214447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.224443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.224475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.235374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.235406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.246344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.246375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.257381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.257412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.270126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.270157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.280301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.280333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.290948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.290977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.303860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.303888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.315236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.315264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.323627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.323655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.335776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.335805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.347260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.347289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.355842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.355870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.368258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.368286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.378062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.378098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.388105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.388132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.398045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.398079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.407986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.408014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.417901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.417930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.427639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.427667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.437914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.437942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.448116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.448145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.359 [2024-11-20 12:42:58.457841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.359 [2024-11-20 12:42:58.457870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.467665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.467694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.477728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.477757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.487382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.487410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.497254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.497281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.507095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.507123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.516911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.516939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.526813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.526841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.536526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.536553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.546120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.546148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.555961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.555989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.565599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.565639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.575593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.575621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.585366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.585394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.595663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.595690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.605605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.605633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.616845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.616873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.626237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.626265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.638446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.638473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.648114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.648142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.658293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.658321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.668160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.668188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.677992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.678021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.688088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.688115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.698117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.698145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.707949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.707977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.619 [2024-11-20 12:42:58.717715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.619 [2024-11-20 12:42:58.717742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.727084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.727113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.736774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.736802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.746809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.746836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.756917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.756958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.767218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.767246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.777531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.777558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.790601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.790629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.800182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.800209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.810237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.810265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.820228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.820256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.830348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.830386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.841223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.841252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.853711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.853742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.864724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.864756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.875096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.875124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.885807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.885837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.896163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.896191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.906796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.906832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.917943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.917973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.928904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.928931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.941775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.941807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.951941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.951969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.962973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.963011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:25.878 [2024-11-20 12:42:58.974331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:25.878 [2024-11-20 12:42:58.974361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.138 [2024-11-20 12:42:58.985082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:58.985110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:58.997753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:58.997785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.007848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.007879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.018334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.018362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.030921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.030953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.041204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.041232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.051671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.051702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.064392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.064420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.075197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.075225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.086439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.086471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.098822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.098853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.110371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.110399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.118658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.118686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.131779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.131809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.142021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.142048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.152715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.152742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.165353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.165384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.175054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.175107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.186554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.186584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.199948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.199976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.209862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.209893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.220687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.220715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.233328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.233356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.139 [2024-11-20 12:42:59.241661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.139 [2024-11-20 12:42:59.241689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.252004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.252032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.262214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.262242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.272589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.272621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.285352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.285380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.295379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.295411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.306523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.306554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.319416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.319461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.329639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.329670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.340454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.340482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.353121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.353151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.362828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.362860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.373288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.373317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.384395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.384426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.395008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.395039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.407787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.407818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.417825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.417856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.428861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.428891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.440021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.440053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.451017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.451045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.463871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.463902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.473809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.473840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.484558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.484589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.399 [2024-11-20 12:42:59.498241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.399 [2024-11-20 12:42:59.498277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.508357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.508385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.518860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.518892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.529516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.529547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.542613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.542644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.554416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.554444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.563323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.563351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.574939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.574967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.585864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.585895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.596353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.596382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.608934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.608965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.619313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.619342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.630245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.630275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.642987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.643016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.653010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.653040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.663988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.664019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.676496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.676524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.694812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.694843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.705217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.705245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.715390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.715417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.726090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.726118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.736840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.736868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.749634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.749665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.660 [2024-11-20 12:42:59.759890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.660 [2024-11-20 12:42:59.759921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.770187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.770215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.781335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.781366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.792134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.792161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.804610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.804641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.816440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.816484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.825160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.825188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.836503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.836534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.848632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.848663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.858494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.858525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.869335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.869378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.881818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.881849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.891972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.892002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.902852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.902882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.915353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.915397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.925543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.925574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.920 [2024-11-20 12:42:59.935912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.920 [2024-11-20 12:42:59.935943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:42:59.946546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.946577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:42:59.957270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.957298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:42:59.966952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.966982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 00:15:26.921 Latency(us) 00:15:26.921 [2024-11-20T11:43:00.029Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:26.921 [2024-11-20T11:43:00.029Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:26.921 Nvme1n1 : 5.01 11830.21 92.42 0.00 0.00 10805.92 4514.70 24175.50 00:15:26.921 [2024-11-20T11:43:00.029Z] =================================================================================================================== 00:15:26.921 [2024-11-20T11:43:00.029Z] Total : 11830.21 92.42 0.00 0.00 10805.92 4514.70 24175.50 00:15:26.921 [2024-11-20 12:42:59.973966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.973995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:42:59.981985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.982013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:42:59.989995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.990018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:42:59.998092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:42:59.998141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:43:00.006109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:43:00.006157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:43:00.014128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:43:00.014176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:26.921 [2024-11-20 12:43:00.022178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:26.921 [2024-11-20 12:43:00.022233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.030209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.030261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.038224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.038274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.046233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.046284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.054252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.054304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.062289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.062346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.070305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.070358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.078326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.078379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.086333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.086401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.094383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.094438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.102362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.102405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.110339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.110382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.118406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.118433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.126396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.126447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.134425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.134450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.142485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.142533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.150508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.150553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.158512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.158544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.166502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.166526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.174521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.174546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.182545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.182571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.190564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.190586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.198637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.198683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.206659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.206705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.214637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.214662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.222658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.222682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 [2024-11-20 12:43:00.230703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:27.180 [2024-11-20 12:43:00.230733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:27.180 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3520799) - No such process 00:15:27.180 12:43:00 -- target/zcopy.sh@49 -- # wait 3520799 00:15:27.180 12:43:00 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:27.180 12:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.180 12:43:00 -- common/autotest_common.sh@10 -- # set +x 00:15:27.180 12:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.180 12:43:00 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:27.180 12:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.180 12:43:00 -- common/autotest_common.sh@10 -- # set +x 00:15:27.180 delay0 00:15:27.180 12:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.180 12:43:00 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:27.180 12:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.180 12:43:00 -- common/autotest_common.sh@10 -- # set +x 00:15:27.180 12:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.180 12:43:00 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:27.439 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.439 [2024-11-20 12:43:00.355935] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:35.565 Initializing NVMe Controllers 00:15:35.565 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:35.565 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:35.565 Initialization complete. Launching workers. 00:15:35.565 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 266, failed: 16928 00:15:35.565 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 17104, failed to submit 90 00:15:35.565 success 17000, unsuccess 104, failed 0 00:15:35.565 12:43:07 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:35.565 12:43:07 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:35.565 12:43:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:35.565 12:43:07 -- nvmf/common.sh@116 -- # sync 00:15:35.565 12:43:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:35.565 12:43:07 -- nvmf/common.sh@119 -- # set +e 00:15:35.565 12:43:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:35.565 12:43:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:35.565 rmmod nvme_tcp 00:15:35.565 rmmod nvme_fabrics 00:15:35.565 rmmod nvme_keyring 00:15:35.565 12:43:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:35.565 12:43:07 -- nvmf/common.sh@123 -- # set -e 00:15:35.565 12:43:07 -- nvmf/common.sh@124 -- # return 0 00:15:35.565 12:43:07 -- nvmf/common.sh@477 -- # '[' -n 3519289 ']' 00:15:35.565 12:43:07 -- nvmf/common.sh@478 -- # killprocess 3519289 00:15:35.565 12:43:07 -- common/autotest_common.sh@936 -- # '[' -z 3519289 ']' 00:15:35.565 12:43:07 -- common/autotest_common.sh@940 -- # kill -0 3519289 00:15:35.565 12:43:07 -- common/autotest_common.sh@941 -- # uname 00:15:35.565 12:43:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:35.565 12:43:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3519289 00:15:35.565 12:43:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:35.565 12:43:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:35.565 12:43:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3519289' 00:15:35.565 killing process with pid 3519289 00:15:35.565 12:43:07 -- common/autotest_common.sh@955 -- # kill 3519289 00:15:35.565 12:43:07 -- common/autotest_common.sh@960 -- # wait 3519289 00:15:35.565 12:43:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:35.565 12:43:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:35.565 12:43:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:35.565 12:43:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:35.565 12:43:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:35.565 12:43:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:35.565 12:43:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:35.565 12:43:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.947 12:43:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:36.947 00:15:36.947 real 0m29.851s 00:15:36.947 user 0m43.300s 00:15:36.947 sys 0m9.369s 00:15:36.947 12:43:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:36.947 12:43:09 -- common/autotest_common.sh@10 -- # set +x 00:15:36.947 ************************************ 00:15:36.947 END TEST nvmf_zcopy 00:15:36.947 ************************************ 00:15:36.947 12:43:09 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:36.947 12:43:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:36.947 12:43:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:36.947 12:43:09 -- common/autotest_common.sh@10 -- # set +x 00:15:36.947 ************************************ 00:15:36.947 START TEST nvmf_nmic 00:15:36.947 ************************************ 00:15:36.947 12:43:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:36.947 * Looking for test storage... 00:15:36.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:36.947 12:43:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:36.947 12:43:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:36.947 12:43:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:36.947 12:43:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:36.947 12:43:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:36.947 12:43:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:36.947 12:43:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:36.947 12:43:10 -- scripts/common.sh@335 -- # IFS=.-: 00:15:36.947 12:43:10 -- scripts/common.sh@335 -- # read -ra ver1 00:15:36.947 12:43:10 -- scripts/common.sh@336 -- # IFS=.-: 00:15:36.947 12:43:10 -- scripts/common.sh@336 -- # read -ra ver2 00:15:36.947 12:43:10 -- scripts/common.sh@337 -- # local 'op=<' 00:15:36.947 12:43:10 -- scripts/common.sh@339 -- # ver1_l=2 00:15:36.947 12:43:10 -- scripts/common.sh@340 -- # ver2_l=1 00:15:36.947 12:43:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:36.947 12:43:10 -- scripts/common.sh@343 -- # case "$op" in 00:15:36.947 12:43:10 -- scripts/common.sh@344 -- # : 1 00:15:36.947 12:43:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:36.947 12:43:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:36.947 12:43:10 -- scripts/common.sh@364 -- # decimal 1 00:15:36.947 12:43:10 -- scripts/common.sh@352 -- # local d=1 00:15:36.947 12:43:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:36.947 12:43:10 -- scripts/common.sh@354 -- # echo 1 00:15:36.947 12:43:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:36.947 12:43:10 -- scripts/common.sh@365 -- # decimal 2 00:15:36.947 12:43:10 -- scripts/common.sh@352 -- # local d=2 00:15:36.947 12:43:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:36.947 12:43:10 -- scripts/common.sh@354 -- # echo 2 00:15:36.947 12:43:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:36.947 12:43:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:36.947 12:43:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:36.947 12:43:10 -- scripts/common.sh@367 -- # return 0 00:15:36.947 12:43:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:36.947 12:43:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:36.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.947 --rc genhtml_branch_coverage=1 00:15:36.947 --rc genhtml_function_coverage=1 00:15:36.947 --rc genhtml_legend=1 00:15:36.947 --rc geninfo_all_blocks=1 00:15:36.947 --rc geninfo_unexecuted_blocks=1 00:15:36.947 00:15:36.947 ' 00:15:36.947 12:43:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:36.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.947 --rc genhtml_branch_coverage=1 00:15:36.947 --rc genhtml_function_coverage=1 00:15:36.947 --rc genhtml_legend=1 00:15:36.947 --rc geninfo_all_blocks=1 00:15:36.947 --rc geninfo_unexecuted_blocks=1 00:15:36.947 00:15:36.947 ' 00:15:36.948 12:43:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:36.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.948 --rc genhtml_branch_coverage=1 00:15:36.948 --rc genhtml_function_coverage=1 00:15:36.948 --rc genhtml_legend=1 00:15:36.948 --rc geninfo_all_blocks=1 00:15:36.948 --rc geninfo_unexecuted_blocks=1 00:15:36.948 00:15:36.948 ' 00:15:36.948 12:43:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:36.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.948 --rc genhtml_branch_coverage=1 00:15:36.948 --rc genhtml_function_coverage=1 00:15:36.948 --rc genhtml_legend=1 00:15:36.948 --rc geninfo_all_blocks=1 00:15:36.948 --rc geninfo_unexecuted_blocks=1 00:15:36.948 00:15:36.948 ' 00:15:36.948 12:43:10 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:36.948 12:43:10 -- nvmf/common.sh@7 -- # uname -s 00:15:37.208 12:43:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:37.208 12:43:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:37.208 12:43:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:37.208 12:43:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:37.208 12:43:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:37.208 12:43:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:37.208 12:43:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:37.208 12:43:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:37.208 12:43:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:37.208 12:43:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:37.208 12:43:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:37.208 12:43:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:37.208 12:43:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:37.208 12:43:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:37.208 12:43:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:37.208 12:43:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:37.208 12:43:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:37.208 12:43:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:37.208 12:43:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:37.208 12:43:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.208 12:43:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.208 12:43:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.208 12:43:10 -- paths/export.sh@5 -- # export PATH 00:15:37.208 12:43:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.208 12:43:10 -- nvmf/common.sh@46 -- # : 0 00:15:37.208 12:43:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:37.208 12:43:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:37.208 12:43:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:37.208 12:43:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:37.208 12:43:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:37.208 12:43:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:37.208 12:43:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:37.208 12:43:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:37.208 12:43:10 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:37.208 12:43:10 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:37.208 12:43:10 -- target/nmic.sh@14 -- # nvmftestinit 00:15:37.208 12:43:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:37.208 12:43:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:37.208 12:43:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:37.208 12:43:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:37.208 12:43:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:37.208 12:43:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.208 12:43:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:37.208 12:43:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.208 12:43:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:37.208 12:43:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:37.208 12:43:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:37.208 12:43:10 -- common/autotest_common.sh@10 -- # set +x 00:15:39.117 12:43:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:39.117 12:43:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:39.117 12:43:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:39.117 12:43:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:39.117 12:43:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:39.117 12:43:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:39.117 12:43:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:39.117 12:43:12 -- nvmf/common.sh@294 -- # net_devs=() 00:15:39.117 12:43:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:39.117 12:43:12 -- nvmf/common.sh@295 -- # e810=() 00:15:39.117 12:43:12 -- nvmf/common.sh@295 -- # local -ga e810 00:15:39.117 12:43:12 -- nvmf/common.sh@296 -- # x722=() 00:15:39.117 12:43:12 -- nvmf/common.sh@296 -- # local -ga x722 00:15:39.117 12:43:12 -- nvmf/common.sh@297 -- # mlx=() 00:15:39.117 12:43:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:39.117 12:43:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:39.117 12:43:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:39.117 12:43:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:39.117 12:43:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:39.117 12:43:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:39.117 12:43:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:39.117 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:39.117 12:43:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:39.117 12:43:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:39.117 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:39.117 12:43:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:39.117 12:43:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:39.117 12:43:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:39.117 12:43:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:39.117 12:43:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:39.117 12:43:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:39.117 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:39.117 12:43:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:39.117 12:43:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:39.117 12:43:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:39.117 12:43:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:39.117 12:43:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:39.117 12:43:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:39.117 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:39.117 12:43:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:39.117 12:43:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:39.117 12:43:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:39.117 12:43:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:39.117 12:43:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:39.117 12:43:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:39.117 12:43:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:39.117 12:43:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:39.117 12:43:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:39.117 12:43:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:39.117 12:43:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:39.376 12:43:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:39.376 12:43:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:39.376 12:43:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:39.376 12:43:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:39.376 12:43:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:39.376 12:43:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:39.376 12:43:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:39.376 12:43:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:39.376 12:43:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:39.376 12:43:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:39.376 12:43:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:39.376 12:43:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:39.377 12:43:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:39.377 12:43:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:39.377 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:39.377 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:15:39.377 00:15:39.377 --- 10.0.0.2 ping statistics --- 00:15:39.377 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:39.377 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:15:39.377 12:43:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:39.377 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:39.377 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:15:39.377 00:15:39.377 --- 10.0.0.1 ping statistics --- 00:15:39.377 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:39.377 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:15:39.377 12:43:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:39.377 12:43:12 -- nvmf/common.sh@410 -- # return 0 00:15:39.377 12:43:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:39.377 12:43:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:39.377 12:43:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:39.377 12:43:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:39.377 12:43:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:39.377 12:43:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:39.377 12:43:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:39.377 12:43:12 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:39.377 12:43:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:39.377 12:43:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:39.377 12:43:12 -- common/autotest_common.sh@10 -- # set +x 00:15:39.377 12:43:12 -- nvmf/common.sh@469 -- # nvmfpid=3524375 00:15:39.377 12:43:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:39.377 12:43:12 -- nvmf/common.sh@470 -- # waitforlisten 3524375 00:15:39.377 12:43:12 -- common/autotest_common.sh@829 -- # '[' -z 3524375 ']' 00:15:39.377 12:43:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:39.377 12:43:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:39.377 12:43:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:39.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:39.377 12:43:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:39.377 12:43:12 -- common/autotest_common.sh@10 -- # set +x 00:15:39.377 [2024-11-20 12:43:12.417823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:39.377 [2024-11-20 12:43:12.417892] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:39.377 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.377 [2024-11-20 12:43:12.480987] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:39.636 [2024-11-20 12:43:12.588365] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:39.636 [2024-11-20 12:43:12.588498] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:39.636 [2024-11-20 12:43:12.588515] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:39.636 [2024-11-20 12:43:12.588527] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:39.636 [2024-11-20 12:43:12.588583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.636 [2024-11-20 12:43:12.588642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:39.636 [2024-11-20 12:43:12.588708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:39.636 [2024-11-20 12:43:12.588710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:40.572 12:43:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:40.572 12:43:13 -- common/autotest_common.sh@862 -- # return 0 00:15:40.572 12:43:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:40.572 12:43:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 12:43:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:40.572 12:43:13 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 [2024-11-20 12:43:13.501922] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 Malloc0 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 [2024-11-20 12:43:13.555516] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:40.572 test case1: single bdev can't be used in multiple subsystems 00:15:40.572 12:43:13 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.572 12:43:13 -- target/nmic.sh@28 -- # nmic_status=0 00:15:40.572 12:43:13 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:40.572 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.572 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.572 [2024-11-20 12:43:13.579297] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:40.572 [2024-11-20 12:43:13.579328] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:40.572 [2024-11-20 12:43:13.579344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.572 request: 00:15:40.572 { 00:15:40.572 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:40.572 "namespace": { 00:15:40.572 "bdev_name": "Malloc0" 00:15:40.572 }, 00:15:40.572 "method": "nvmf_subsystem_add_ns", 00:15:40.572 "req_id": 1 00:15:40.572 } 00:15:40.572 Got JSON-RPC error response 00:15:40.572 response: 00:15:40.572 { 00:15:40.572 "code": -32602, 00:15:40.573 "message": "Invalid parameters" 00:15:40.573 } 00:15:40.573 12:43:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:15:40.573 12:43:13 -- target/nmic.sh@29 -- # nmic_status=1 00:15:40.573 12:43:13 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:40.573 12:43:13 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:40.573 Adding namespace failed - expected result. 00:15:40.573 12:43:13 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:40.573 test case2: host connect to nvmf target in multiple paths 00:15:40.573 12:43:13 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:15:40.573 12:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.573 12:43:13 -- common/autotest_common.sh@10 -- # set +x 00:15:40.573 [2024-11-20 12:43:13.587453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:15:40.573 12:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.573 12:43:13 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:41.508 12:43:14 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:15:42.077 12:43:14 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:42.077 12:43:14 -- common/autotest_common.sh@1187 -- # local i=0 00:15:42.077 12:43:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:42.077 12:43:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:15:42.077 12:43:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:43.981 12:43:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:43.981 12:43:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:43.981 12:43:16 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:43.981 12:43:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:15:43.981 12:43:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:43.981 12:43:16 -- common/autotest_common.sh@1197 -- # return 0 00:15:43.981 12:43:16 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:43.981 [global] 00:15:43.981 thread=1 00:15:43.981 invalidate=1 00:15:43.981 rw=write 00:15:43.982 time_based=1 00:15:43.982 runtime=1 00:15:43.982 ioengine=libaio 00:15:43.982 direct=1 00:15:43.982 bs=4096 00:15:43.982 iodepth=1 00:15:43.982 norandommap=0 00:15:43.982 numjobs=1 00:15:43.982 00:15:43.982 verify_dump=1 00:15:43.982 verify_backlog=512 00:15:43.982 verify_state_save=0 00:15:43.982 do_verify=1 00:15:43.982 verify=crc32c-intel 00:15:43.982 [job0] 00:15:43.982 filename=/dev/nvme0n1 00:15:43.982 Could not set queue depth (nvme0n1) 00:15:44.240 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:44.240 fio-3.35 00:15:44.240 Starting 1 thread 00:15:45.617 00:15:45.617 job0: (groupid=0, jobs=1): err= 0: pid=3525037: Wed Nov 20 12:43:18 2024 00:15:45.617 read: IOPS=21, BW=85.2KiB/s (87.2kB/s)(88.0KiB/1033msec) 00:15:45.617 slat (nsec): min=7342, max=36413, avg=27759.91, stdev=10284.31 00:15:45.617 clat (usec): min=40898, max=42051, avg=41382.03, stdev=491.21 00:15:45.617 lat (usec): min=40934, max=42067, avg=41409.79, stdev=492.98 00:15:45.617 clat percentiles (usec): 00:15:45.617 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:15:45.617 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:15:45.617 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:15:45.617 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:15:45.617 | 99.99th=[42206] 00:15:45.617 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:15:45.617 slat (usec): min=7, max=28302, avg=68.16, stdev=1250.27 00:15:45.617 clat (usec): min=134, max=269, avg=166.52, stdev=24.84 00:15:45.617 lat (usec): min=142, max=28519, avg=234.68, stdev=1252.74 00:15:45.617 clat percentiles (usec): 00:15:45.617 | 1.00th=[ 137], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 149], 00:15:45.617 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 165], 00:15:45.617 | 70.00th=[ 169], 80.00th=[ 178], 90.00th=[ 188], 95.00th=[ 241], 00:15:45.617 | 99.00th=[ 247], 99.50th=[ 260], 99.90th=[ 269], 99.95th=[ 269], 00:15:45.617 | 99.99th=[ 269] 00:15:45.617 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:15:45.617 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:15:45.617 lat (usec) : 250=95.32%, 500=0.56% 00:15:45.617 lat (msec) : 50=4.12% 00:15:45.617 cpu : usr=0.87%, sys=0.39%, ctx=537, majf=0, minf=1 00:15:45.617 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:45.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:45.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:45.617 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:45.617 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:45.617 00:15:45.617 Run status group 0 (all jobs): 00:15:45.617 READ: bw=85.2KiB/s (87.2kB/s), 85.2KiB/s-85.2KiB/s (87.2kB/s-87.2kB/s), io=88.0KiB (90.1kB), run=1033-1033msec 00:15:45.617 WRITE: bw=1983KiB/s (2030kB/s), 1983KiB/s-1983KiB/s (2030kB/s-2030kB/s), io=2048KiB (2097kB), run=1033-1033msec 00:15:45.617 00:15:45.617 Disk stats (read/write): 00:15:45.617 nvme0n1: ios=43/512, merge=0/0, ticks=1699/85, in_queue=1784, util=98.60% 00:15:45.617 12:43:18 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:45.617 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:15:45.617 12:43:18 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:45.617 12:43:18 -- common/autotest_common.sh@1208 -- # local i=0 00:15:45.617 12:43:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:45.617 12:43:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:45.617 12:43:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:45.617 12:43:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:45.617 12:43:18 -- common/autotest_common.sh@1220 -- # return 0 00:15:45.617 12:43:18 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:15:45.617 12:43:18 -- target/nmic.sh@53 -- # nvmftestfini 00:15:45.617 12:43:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:45.617 12:43:18 -- nvmf/common.sh@116 -- # sync 00:15:45.617 12:43:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:45.617 12:43:18 -- nvmf/common.sh@119 -- # set +e 00:15:45.617 12:43:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:45.617 12:43:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:45.617 rmmod nvme_tcp 00:15:45.617 rmmod nvme_fabrics 00:15:45.617 rmmod nvme_keyring 00:15:45.617 12:43:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:45.617 12:43:18 -- nvmf/common.sh@123 -- # set -e 00:15:45.617 12:43:18 -- nvmf/common.sh@124 -- # return 0 00:15:45.617 12:43:18 -- nvmf/common.sh@477 -- # '[' -n 3524375 ']' 00:15:45.617 12:43:18 -- nvmf/common.sh@478 -- # killprocess 3524375 00:15:45.617 12:43:18 -- common/autotest_common.sh@936 -- # '[' -z 3524375 ']' 00:15:45.617 12:43:18 -- common/autotest_common.sh@940 -- # kill -0 3524375 00:15:45.617 12:43:18 -- common/autotest_common.sh@941 -- # uname 00:15:45.617 12:43:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:45.617 12:43:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3524375 00:15:45.617 12:43:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:45.617 12:43:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:45.617 12:43:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3524375' 00:15:45.617 killing process with pid 3524375 00:15:45.617 12:43:18 -- common/autotest_common.sh@955 -- # kill 3524375 00:15:45.617 12:43:18 -- common/autotest_common.sh@960 -- # wait 3524375 00:15:45.878 12:43:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:45.878 12:43:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:45.878 12:43:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:45.878 12:43:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:45.878 12:43:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:45.878 12:43:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.878 12:43:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:45.878 12:43:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:47.786 12:43:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:47.786 00:15:47.786 real 0m10.980s 00:15:47.786 user 0m26.121s 00:15:47.786 sys 0m2.448s 00:15:47.786 12:43:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:47.786 12:43:20 -- common/autotest_common.sh@10 -- # set +x 00:15:47.786 ************************************ 00:15:47.786 END TEST nvmf_nmic 00:15:47.786 ************************************ 00:15:48.046 12:43:20 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:15:48.046 12:43:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:48.046 12:43:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:48.046 12:43:20 -- common/autotest_common.sh@10 -- # set +x 00:15:48.046 ************************************ 00:15:48.046 START TEST nvmf_fio_target 00:15:48.046 ************************************ 00:15:48.046 12:43:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:15:48.046 * Looking for test storage... 00:15:48.046 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:48.046 12:43:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:48.046 12:43:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:48.046 12:43:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:48.046 12:43:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:48.046 12:43:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:48.046 12:43:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:48.046 12:43:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:48.046 12:43:21 -- scripts/common.sh@335 -- # IFS=.-: 00:15:48.046 12:43:21 -- scripts/common.sh@335 -- # read -ra ver1 00:15:48.046 12:43:21 -- scripts/common.sh@336 -- # IFS=.-: 00:15:48.046 12:43:21 -- scripts/common.sh@336 -- # read -ra ver2 00:15:48.046 12:43:21 -- scripts/common.sh@337 -- # local 'op=<' 00:15:48.046 12:43:21 -- scripts/common.sh@339 -- # ver1_l=2 00:15:48.046 12:43:21 -- scripts/common.sh@340 -- # ver2_l=1 00:15:48.046 12:43:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:48.046 12:43:21 -- scripts/common.sh@343 -- # case "$op" in 00:15:48.046 12:43:21 -- scripts/common.sh@344 -- # : 1 00:15:48.046 12:43:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:48.046 12:43:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:48.046 12:43:21 -- scripts/common.sh@364 -- # decimal 1 00:15:48.046 12:43:21 -- scripts/common.sh@352 -- # local d=1 00:15:48.046 12:43:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:48.046 12:43:21 -- scripts/common.sh@354 -- # echo 1 00:15:48.046 12:43:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:48.046 12:43:21 -- scripts/common.sh@365 -- # decimal 2 00:15:48.046 12:43:21 -- scripts/common.sh@352 -- # local d=2 00:15:48.046 12:43:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:48.046 12:43:21 -- scripts/common.sh@354 -- # echo 2 00:15:48.046 12:43:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:48.046 12:43:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:48.046 12:43:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:48.046 12:43:21 -- scripts/common.sh@367 -- # return 0 00:15:48.046 12:43:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:48.046 12:43:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:48.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.046 --rc genhtml_branch_coverage=1 00:15:48.046 --rc genhtml_function_coverage=1 00:15:48.046 --rc genhtml_legend=1 00:15:48.046 --rc geninfo_all_blocks=1 00:15:48.046 --rc geninfo_unexecuted_blocks=1 00:15:48.046 00:15:48.046 ' 00:15:48.046 12:43:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:48.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.046 --rc genhtml_branch_coverage=1 00:15:48.046 --rc genhtml_function_coverage=1 00:15:48.046 --rc genhtml_legend=1 00:15:48.046 --rc geninfo_all_blocks=1 00:15:48.046 --rc geninfo_unexecuted_blocks=1 00:15:48.046 00:15:48.046 ' 00:15:48.046 12:43:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:48.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.046 --rc genhtml_branch_coverage=1 00:15:48.046 --rc genhtml_function_coverage=1 00:15:48.046 --rc genhtml_legend=1 00:15:48.046 --rc geninfo_all_blocks=1 00:15:48.046 --rc geninfo_unexecuted_blocks=1 00:15:48.046 00:15:48.046 ' 00:15:48.046 12:43:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:48.046 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.046 --rc genhtml_branch_coverage=1 00:15:48.046 --rc genhtml_function_coverage=1 00:15:48.046 --rc genhtml_legend=1 00:15:48.046 --rc geninfo_all_blocks=1 00:15:48.046 --rc geninfo_unexecuted_blocks=1 00:15:48.046 00:15:48.046 ' 00:15:48.046 12:43:21 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:48.046 12:43:21 -- nvmf/common.sh@7 -- # uname -s 00:15:48.046 12:43:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:48.046 12:43:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:48.046 12:43:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:48.046 12:43:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:48.046 12:43:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:48.046 12:43:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:48.046 12:43:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:48.046 12:43:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:48.046 12:43:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:48.046 12:43:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:48.046 12:43:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:48.046 12:43:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:48.046 12:43:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:48.046 12:43:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:48.046 12:43:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:48.046 12:43:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:48.046 12:43:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:48.046 12:43:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:48.046 12:43:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:48.046 12:43:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.047 12:43:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.047 12:43:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.047 12:43:21 -- paths/export.sh@5 -- # export PATH 00:15:48.047 12:43:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.047 12:43:21 -- nvmf/common.sh@46 -- # : 0 00:15:48.047 12:43:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:48.047 12:43:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:48.047 12:43:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:48.047 12:43:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:48.047 12:43:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:48.047 12:43:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:48.047 12:43:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:48.047 12:43:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:48.047 12:43:21 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:48.047 12:43:21 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:48.047 12:43:21 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:48.047 12:43:21 -- target/fio.sh@16 -- # nvmftestinit 00:15:48.047 12:43:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:48.047 12:43:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:48.047 12:43:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:48.047 12:43:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:48.047 12:43:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:48.047 12:43:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:48.047 12:43:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:48.047 12:43:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:48.047 12:43:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:48.047 12:43:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:48.047 12:43:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:48.047 12:43:21 -- common/autotest_common.sh@10 -- # set +x 00:15:49.953 12:43:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:49.953 12:43:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:49.953 12:43:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:49.953 12:43:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:49.953 12:43:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:49.953 12:43:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:49.953 12:43:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:49.953 12:43:22 -- nvmf/common.sh@294 -- # net_devs=() 00:15:49.953 12:43:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:49.953 12:43:22 -- nvmf/common.sh@295 -- # e810=() 00:15:49.953 12:43:22 -- nvmf/common.sh@295 -- # local -ga e810 00:15:49.953 12:43:22 -- nvmf/common.sh@296 -- # x722=() 00:15:49.953 12:43:22 -- nvmf/common.sh@296 -- # local -ga x722 00:15:49.953 12:43:22 -- nvmf/common.sh@297 -- # mlx=() 00:15:49.953 12:43:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:49.953 12:43:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:49.953 12:43:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:49.953 12:43:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:49.953 12:43:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:49.953 12:43:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:49.953 12:43:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:49.953 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:49.953 12:43:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:49.953 12:43:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:49.953 12:43:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:49.954 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:49.954 12:43:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:49.954 12:43:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:49.954 12:43:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:49.954 12:43:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:49.954 12:43:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:49.954 12:43:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:49.954 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:49.954 12:43:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:49.954 12:43:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:49.954 12:43:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:49.954 12:43:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:49.954 12:43:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:49.954 12:43:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:49.954 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:49.954 12:43:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:49.954 12:43:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:49.954 12:43:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:49.954 12:43:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:49.954 12:43:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:49.954 12:43:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:49.954 12:43:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:49.954 12:43:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:49.954 12:43:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:49.954 12:43:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:49.954 12:43:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:49.954 12:43:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:49.954 12:43:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:49.954 12:43:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:49.954 12:43:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:49.954 12:43:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:49.954 12:43:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:49.954 12:43:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:49.954 12:43:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:50.213 12:43:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:50.213 12:43:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:50.213 12:43:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:50.213 12:43:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:50.213 12:43:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:50.213 12:43:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:50.213 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:50.213 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:15:50.213 00:15:50.213 --- 10.0.0.2 ping statistics --- 00:15:50.213 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:50.213 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:15:50.213 12:43:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:50.213 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:50.213 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:15:50.213 00:15:50.213 --- 10.0.0.1 ping statistics --- 00:15:50.213 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:50.213 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:15:50.213 12:43:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:50.213 12:43:23 -- nvmf/common.sh@410 -- # return 0 00:15:50.213 12:43:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:50.213 12:43:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:50.213 12:43:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:50.213 12:43:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:50.213 12:43:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:50.213 12:43:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:50.213 12:43:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:50.213 12:43:23 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:15:50.213 12:43:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:50.213 12:43:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:50.213 12:43:23 -- common/autotest_common.sh@10 -- # set +x 00:15:50.213 12:43:23 -- nvmf/common.sh@469 -- # nvmfpid=3527129 00:15:50.213 12:43:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:50.213 12:43:23 -- nvmf/common.sh@470 -- # waitforlisten 3527129 00:15:50.213 12:43:23 -- common/autotest_common.sh@829 -- # '[' -z 3527129 ']' 00:15:50.213 12:43:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:50.213 12:43:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:50.213 12:43:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:50.213 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:50.213 12:43:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:50.213 12:43:23 -- common/autotest_common.sh@10 -- # set +x 00:15:50.213 [2024-11-20 12:43:23.193374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:50.213 [2024-11-20 12:43:23.193448] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:50.213 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.213 [2024-11-20 12:43:23.259242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:50.472 [2024-11-20 12:43:23.380247] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:50.473 [2024-11-20 12:43:23.380405] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:50.473 [2024-11-20 12:43:23.380424] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:50.473 [2024-11-20 12:43:23.380438] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:50.473 [2024-11-20 12:43:23.380514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.473 [2024-11-20 12:43:23.380594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:50.473 [2024-11-20 12:43:23.380651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:50.473 [2024-11-20 12:43:23.380648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:51.482 12:43:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:51.482 12:43:24 -- common/autotest_common.sh@862 -- # return 0 00:15:51.482 12:43:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:51.482 12:43:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:51.482 12:43:24 -- common/autotest_common.sh@10 -- # set +x 00:15:51.482 12:43:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:51.482 12:43:24 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:51.482 [2024-11-20 12:43:24.473575] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:51.482 12:43:24 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:51.740 12:43:24 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:15:51.740 12:43:24 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:51.998 12:43:25 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:15:51.998 12:43:25 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:52.256 12:43:25 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:15:52.256 12:43:25 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:52.514 12:43:25 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:15:52.514 12:43:25 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:15:52.771 12:43:25 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:53.029 12:43:26 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:15:53.029 12:43:26 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:53.288 12:43:26 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:15:53.288 12:43:26 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:53.545 12:43:26 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:15:53.545 12:43:26 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:15:53.802 12:43:26 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:54.058 12:43:27 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:54.058 12:43:27 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:54.315 12:43:27 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:54.315 12:43:27 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:54.572 12:43:27 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:54.829 [2024-11-20 12:43:27.875665] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:54.829 12:43:27 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:15:55.086 12:43:28 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:15:55.346 12:43:28 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:55.912 12:43:29 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:15:55.912 12:43:29 -- common/autotest_common.sh@1187 -- # local i=0 00:15:55.912 12:43:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:55.912 12:43:29 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:15:55.912 12:43:29 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:15:55.912 12:43:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:58.448 12:43:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:58.448 12:43:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:58.448 12:43:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:58.448 12:43:31 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:15:58.448 12:43:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:58.448 12:43:31 -- common/autotest_common.sh@1197 -- # return 0 00:15:58.448 12:43:31 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:58.448 [global] 00:15:58.448 thread=1 00:15:58.448 invalidate=1 00:15:58.448 rw=write 00:15:58.448 time_based=1 00:15:58.448 runtime=1 00:15:58.448 ioengine=libaio 00:15:58.448 direct=1 00:15:58.448 bs=4096 00:15:58.448 iodepth=1 00:15:58.448 norandommap=0 00:15:58.448 numjobs=1 00:15:58.448 00:15:58.448 verify_dump=1 00:15:58.448 verify_backlog=512 00:15:58.448 verify_state_save=0 00:15:58.448 do_verify=1 00:15:58.448 verify=crc32c-intel 00:15:58.448 [job0] 00:15:58.448 filename=/dev/nvme0n1 00:15:58.448 [job1] 00:15:58.448 filename=/dev/nvme0n2 00:15:58.448 [job2] 00:15:58.448 filename=/dev/nvme0n3 00:15:58.448 [job3] 00:15:58.448 filename=/dev/nvme0n4 00:15:58.448 Could not set queue depth (nvme0n1) 00:15:58.448 Could not set queue depth (nvme0n2) 00:15:58.448 Could not set queue depth (nvme0n3) 00:15:58.448 Could not set queue depth (nvme0n4) 00:15:58.448 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:58.448 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:58.448 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:58.448 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:58.448 fio-3.35 00:15:58.448 Starting 4 threads 00:15:59.383 00:15:59.383 job0: (groupid=0, jobs=1): err= 0: pid=3528369: Wed Nov 20 12:43:32 2024 00:15:59.383 read: IOPS=63, BW=253KiB/s (259kB/s)(256KiB/1011msec) 00:15:59.383 slat (nsec): min=5274, max=34070, avg=13927.09, stdev=4012.32 00:15:59.383 clat (usec): min=274, max=42295, avg=13797.74, stdev=19247.08 00:15:59.383 lat (usec): min=286, max=42311, avg=13811.67, stdev=19248.64 00:15:59.383 clat percentiles (usec): 00:15:59.383 | 1.00th=[ 273], 5.00th=[ 302], 10.00th=[ 314], 20.00th=[ 383], 00:15:59.383 | 30.00th=[ 408], 40.00th=[ 429], 50.00th=[ 515], 60.00th=[ 553], 00:15:59.383 | 70.00th=[40633], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:15:59.383 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:15:59.383 | 99.99th=[42206] 00:15:59.383 write: IOPS=506, BW=2026KiB/s (2074kB/s)(2048KiB/1011msec); 0 zone resets 00:15:59.383 slat (nsec): min=7773, max=54739, avg=18352.15, stdev=7667.50 00:15:59.383 clat (usec): min=172, max=456, avg=225.13, stdev=34.96 00:15:59.383 lat (usec): min=190, max=474, avg=243.48, stdev=34.56 00:15:59.383 clat percentiles (usec): 00:15:59.383 | 1.00th=[ 178], 5.00th=[ 190], 10.00th=[ 198], 20.00th=[ 206], 00:15:59.383 | 30.00th=[ 210], 40.00th=[ 215], 50.00th=[ 217], 60.00th=[ 223], 00:15:59.383 | 70.00th=[ 229], 80.00th=[ 235], 90.00th=[ 251], 95.00th=[ 293], 00:15:59.383 | 99.00th=[ 367], 99.50th=[ 383], 99.90th=[ 457], 99.95th=[ 457], 00:15:59.383 | 99.99th=[ 457] 00:15:59.383 bw ( KiB/s): min= 4096, max= 4096, per=18.53%, avg=4096.00, stdev= 0.00, samples=1 00:15:59.383 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:15:59.383 lat (usec) : 250=78.65%, 500=15.10%, 750=2.43% 00:15:59.383 lat (msec) : 2=0.17%, 50=3.65% 00:15:59.383 cpu : usr=0.50%, sys=0.89%, ctx=577, majf=0, minf=1 00:15:59.383 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.383 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.383 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.383 issued rwts: total=64,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.383 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.383 job1: (groupid=0, jobs=1): err= 0: pid=3528370: Wed Nov 20 12:43:32 2024 00:15:59.383 read: IOPS=1854, BW=7419KiB/s (7597kB/s)(7508KiB/1012msec) 00:15:59.383 slat (nsec): min=4392, max=62032, avg=9338.63, stdev=5202.38 00:15:59.383 clat (usec): min=185, max=41014, avg=319.91, stdev=1874.95 00:15:59.383 lat (usec): min=190, max=41033, avg=329.25, stdev=1875.17 00:15:59.383 clat percentiles (usec): 00:15:59.384 | 1.00th=[ 192], 5.00th=[ 198], 10.00th=[ 202], 20.00th=[ 208], 00:15:59.384 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 227], 00:15:59.384 | 70.00th=[ 233], 80.00th=[ 247], 90.00th=[ 273], 95.00th=[ 293], 00:15:59.384 | 99.00th=[ 474], 99.50th=[ 545], 99.90th=[41157], 99.95th=[41157], 00:15:59.384 | 99.99th=[41157] 00:15:59.384 write: IOPS=2023, BW=8095KiB/s (8289kB/s)(8192KiB/1012msec); 0 zone resets 00:15:59.384 slat (nsec): min=6904, max=57030, avg=10474.36, stdev=5676.32 00:15:59.384 clat (usec): min=130, max=478, avg=176.49, stdev=35.08 00:15:59.384 lat (usec): min=137, max=498, avg=186.96, stdev=38.28 00:15:59.384 clat percentiles (usec): 00:15:59.384 | 1.00th=[ 137], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 153], 00:15:59.384 | 30.00th=[ 155], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 172], 00:15:59.384 | 70.00th=[ 180], 80.00th=[ 202], 90.00th=[ 223], 95.00th=[ 239], 00:15:59.384 | 99.00th=[ 314], 99.50th=[ 338], 99.90th=[ 379], 99.95th=[ 424], 00:15:59.384 | 99.99th=[ 478] 00:15:59.384 bw ( KiB/s): min= 6600, max= 9784, per=37.05%, avg=8192.00, stdev=2251.43, samples=2 00:15:59.384 iops : min= 1650, max= 2446, avg=2048.00, stdev=562.86, samples=2 00:15:59.384 lat (usec) : 250=88.87%, 500=10.73%, 750=0.31% 00:15:59.384 lat (msec) : 50=0.10% 00:15:59.384 cpu : usr=2.27%, sys=3.76%, ctx=3927, majf=0, minf=1 00:15:59.384 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.384 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.384 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.384 issued rwts: total=1877,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.384 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.384 job2: (groupid=0, jobs=1): err= 0: pid=3528371: Wed Nov 20 12:43:32 2024 00:15:59.384 read: IOPS=516, BW=2065KiB/s (2114kB/s)(2108KiB/1021msec) 00:15:59.384 slat (nsec): min=6989, max=57831, avg=13436.85, stdev=7265.67 00:15:59.384 clat (usec): min=227, max=41000, avg=1494.18, stdev=6762.66 00:15:59.384 lat (usec): min=234, max=41021, avg=1507.62, stdev=6763.08 00:15:59.384 clat percentiles (usec): 00:15:59.384 | 1.00th=[ 237], 5.00th=[ 241], 10.00th=[ 245], 20.00th=[ 253], 00:15:59.384 | 30.00th=[ 258], 40.00th=[ 269], 50.00th=[ 281], 60.00th=[ 306], 00:15:59.384 | 70.00th=[ 441], 80.00th=[ 474], 90.00th=[ 502], 95.00th=[ 553], 00:15:59.384 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:15:59.384 | 99.99th=[41157] 00:15:59.384 write: IOPS=1002, BW=4012KiB/s (4108kB/s)(4096KiB/1021msec); 0 zone resets 00:15:59.384 slat (nsec): min=8655, max=54781, avg=14732.32, stdev=7268.48 00:15:59.384 clat (usec): min=148, max=341, avg=200.15, stdev=21.99 00:15:59.384 lat (usec): min=158, max=366, avg=214.88, stdev=26.59 00:15:59.384 clat percentiles (usec): 00:15:59.384 | 1.00th=[ 161], 5.00th=[ 169], 10.00th=[ 174], 20.00th=[ 180], 00:15:59.384 | 30.00th=[ 188], 40.00th=[ 194], 50.00th=[ 200], 60.00th=[ 206], 00:15:59.384 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 227], 95.00th=[ 237], 00:15:59.384 | 99.00th=[ 249], 99.50th=[ 262], 99.90th=[ 334], 99.95th=[ 343], 00:15:59.384 | 99.99th=[ 343] 00:15:59.384 bw ( KiB/s): min= 8192, max= 8192, per=37.05%, avg=8192.00, stdev= 0.00, samples=1 00:15:59.384 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:15:59.384 lat (usec) : 250=70.92%, 500=25.66%, 750=2.45% 00:15:59.384 lat (msec) : 50=0.97% 00:15:59.384 cpu : usr=1.86%, sys=2.65%, ctx=1551, majf=0, minf=2 00:15:59.384 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.384 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.384 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.384 issued rwts: total=527,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.384 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.384 job3: (groupid=0, jobs=1): err= 0: pid=3528372: Wed Nov 20 12:43:32 2024 00:15:59.384 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:15:59.384 slat (nsec): min=4820, max=56354, avg=13287.31, stdev=6500.66 00:15:59.384 clat (usec): min=190, max=559, avg=261.57, stdev=49.03 00:15:59.384 lat (usec): min=203, max=570, avg=274.86, stdev=52.42 00:15:59.384 clat percentiles (usec): 00:15:59.384 | 1.00th=[ 204], 5.00th=[ 215], 10.00th=[ 223], 20.00th=[ 233], 00:15:59.384 | 30.00th=[ 237], 40.00th=[ 241], 50.00th=[ 245], 60.00th=[ 251], 00:15:59.384 | 70.00th=[ 265], 80.00th=[ 285], 90.00th=[ 326], 95.00th=[ 363], 00:15:59.384 | 99.00th=[ 457], 99.50th=[ 486], 99.90th=[ 553], 99.95th=[ 553], 00:15:59.384 | 99.99th=[ 562] 00:15:59.384 write: IOPS=2056, BW=8228KiB/s (8425kB/s)(8236KiB/1001msec); 0 zone resets 00:15:59.384 slat (usec): min=6, max=1394, avg=16.24, stdev=30.89 00:15:59.384 clat (usec): min=139, max=1488, avg=188.32, stdev=55.47 00:15:59.384 lat (usec): min=153, max=1742, avg=204.56, stdev=66.79 00:15:59.384 clat percentiles (usec): 00:15:59.384 | 1.00th=[ 149], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 163], 00:15:59.384 | 30.00th=[ 167], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 182], 00:15:59.384 | 70.00th=[ 188], 80.00th=[ 204], 90.00th=[ 227], 95.00th=[ 253], 00:15:59.384 | 99.00th=[ 400], 99.50th=[ 453], 99.90th=[ 701], 99.95th=[ 1156], 00:15:59.384 | 99.99th=[ 1483] 00:15:59.384 bw ( KiB/s): min= 8192, max= 8192, per=37.05%, avg=8192.00, stdev= 0.00, samples=1 00:15:59.384 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:15:59.384 lat (usec) : 250=77.09%, 500=22.64%, 750=0.22% 00:15:59.384 lat (msec) : 2=0.05% 00:15:59.384 cpu : usr=3.40%, sys=5.80%, ctx=4110, majf=0, minf=1 00:15:59.384 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.384 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.384 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.384 issued rwts: total=2048,2059,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.384 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.384 00:15:59.384 Run status group 0 (all jobs): 00:15:59.384 READ: bw=17.3MiB/s (18.1MB/s), 253KiB/s-8184KiB/s (259kB/s-8380kB/s), io=17.6MiB (18.5MB), run=1001-1021msec 00:15:59.384 WRITE: bw=21.6MiB/s (22.6MB/s), 2026KiB/s-8228KiB/s (2074kB/s-8425kB/s), io=22.0MiB (23.1MB), run=1001-1021msec 00:15:59.384 00:15:59.384 Disk stats (read/write): 00:15:59.384 nvme0n1: ios=88/512, merge=0/0, ticks=1584/105, in_queue=1689, util=85.87% 00:15:59.384 nvme0n2: ios=1897/2048, merge=0/0, ticks=1323/344, in_queue=1667, util=89.84% 00:15:59.384 nvme0n3: ios=579/1024, merge=0/0, ticks=658/202, in_queue=860, util=95.10% 00:15:59.384 nvme0n4: ios=1621/2048, merge=0/0, ticks=495/363, in_queue=858, util=94.43% 00:15:59.384 12:43:32 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:15:59.642 [global] 00:15:59.642 thread=1 00:15:59.642 invalidate=1 00:15:59.642 rw=randwrite 00:15:59.642 time_based=1 00:15:59.642 runtime=1 00:15:59.642 ioengine=libaio 00:15:59.642 direct=1 00:15:59.642 bs=4096 00:15:59.642 iodepth=1 00:15:59.642 norandommap=0 00:15:59.642 numjobs=1 00:15:59.642 00:15:59.642 verify_dump=1 00:15:59.642 verify_backlog=512 00:15:59.642 verify_state_save=0 00:15:59.642 do_verify=1 00:15:59.642 verify=crc32c-intel 00:15:59.642 [job0] 00:15:59.642 filename=/dev/nvme0n1 00:15:59.642 [job1] 00:15:59.642 filename=/dev/nvme0n2 00:15:59.642 [job2] 00:15:59.642 filename=/dev/nvme0n3 00:15:59.642 [job3] 00:15:59.642 filename=/dev/nvme0n4 00:15:59.642 Could not set queue depth (nvme0n1) 00:15:59.642 Could not set queue depth (nvme0n2) 00:15:59.642 Could not set queue depth (nvme0n3) 00:15:59.642 Could not set queue depth (nvme0n4) 00:15:59.642 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:59.642 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:59.642 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:59.642 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:59.642 fio-3.35 00:15:59.642 Starting 4 threads 00:16:01.018 00:16:01.018 job0: (groupid=0, jobs=1): err= 0: pid=3528602: Wed Nov 20 12:43:33 2024 00:16:01.018 read: IOPS=636, BW=2546KiB/s (2607kB/s)(2640KiB/1037msec) 00:16:01.018 slat (nsec): min=4593, max=57865, avg=23192.79, stdev=11361.00 00:16:01.018 clat (usec): min=212, max=41988, avg=1160.29, stdev=5684.41 00:16:01.018 lat (usec): min=232, max=42001, avg=1183.48, stdev=5683.74 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 231], 5.00th=[ 247], 10.00th=[ 258], 20.00th=[ 285], 00:16:01.018 | 30.00th=[ 318], 40.00th=[ 343], 50.00th=[ 359], 60.00th=[ 375], 00:16:01.018 | 70.00th=[ 400], 80.00th=[ 416], 90.00th=[ 457], 95.00th=[ 474], 00:16:01.018 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:01.018 | 99.99th=[42206] 00:16:01.018 write: IOPS=987, BW=3950KiB/s (4045kB/s)(4096KiB/1037msec); 0 zone resets 00:16:01.018 slat (nsec): min=7102, max=61290, avg=16566.82, stdev=7431.41 00:16:01.018 clat (usec): min=136, max=473, avg=223.95, stdev=52.12 00:16:01.018 lat (usec): min=149, max=497, avg=240.52, stdev=54.50 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 153], 5.00th=[ 163], 10.00th=[ 172], 20.00th=[ 184], 00:16:01.018 | 30.00th=[ 194], 40.00th=[ 204], 50.00th=[ 212], 60.00th=[ 223], 00:16:01.018 | 70.00th=[ 235], 80.00th=[ 258], 90.00th=[ 285], 95.00th=[ 347], 00:16:01.018 | 99.00th=[ 396], 99.50th=[ 412], 99.90th=[ 437], 99.95th=[ 474], 00:16:01.018 | 99.99th=[ 474] 00:16:01.018 bw ( KiB/s): min= 8192, max= 8192, per=45.28%, avg=8192.00, stdev= 0.00, samples=1 00:16:01.018 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:01.018 lat (usec) : 250=49.94%, 500=48.63%, 750=0.59%, 1000=0.06% 00:16:01.018 lat (msec) : 50=0.77% 00:16:01.018 cpu : usr=1.45%, sys=3.38%, ctx=1685, majf=0, minf=1 00:16:01.018 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:01.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.018 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.018 issued rwts: total=660,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:01.018 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:01.018 job1: (groupid=0, jobs=1): err= 0: pid=3528603: Wed Nov 20 12:43:33 2024 00:16:01.018 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:01.018 slat (nsec): min=3927, max=58530, avg=12180.78, stdev=10359.10 00:16:01.018 clat (usec): min=183, max=796, avg=260.92, stdev=78.33 00:16:01.018 lat (usec): min=188, max=830, avg=273.10, stdev=85.92 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 206], 00:16:01.018 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 225], 60.00th=[ 237], 00:16:01.018 | 70.00th=[ 269], 80.00th=[ 322], 90.00th=[ 388], 95.00th=[ 424], 00:16:01.018 | 99.00th=[ 498], 99.50th=[ 519], 99.90th=[ 644], 99.95th=[ 734], 00:16:01.018 | 99.99th=[ 799] 00:16:01.018 write: IOPS=2136, BW=8547KiB/s (8753kB/s)(8556KiB/1001msec); 0 zone resets 00:16:01.018 slat (nsec): min=5277, max=62125, avg=11399.86, stdev=6880.34 00:16:01.018 clat (usec): min=127, max=519, avg=187.79, stdev=50.87 00:16:01.018 lat (usec): min=133, max=547, avg=199.18, stdev=54.81 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 133], 5.00th=[ 137], 10.00th=[ 141], 20.00th=[ 145], 00:16:01.018 | 30.00th=[ 149], 40.00th=[ 157], 50.00th=[ 172], 60.00th=[ 192], 00:16:01.018 | 70.00th=[ 210], 80.00th=[ 227], 90.00th=[ 260], 95.00th=[ 285], 00:16:01.018 | 99.00th=[ 343], 99.50th=[ 371], 99.90th=[ 400], 99.95th=[ 449], 00:16:01.018 | 99.99th=[ 519] 00:16:01.018 bw ( KiB/s): min= 8192, max= 8192, per=45.28%, avg=8192.00, stdev= 0.00, samples=1 00:16:01.018 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:01.018 lat (usec) : 250=77.81%, 500=21.71%, 750=0.45%, 1000=0.02% 00:16:01.018 cpu : usr=3.30%, sys=4.60%, ctx=4187, majf=0, minf=1 00:16:01.018 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:01.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.018 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.018 issued rwts: total=2048,2139,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:01.018 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:01.018 job2: (groupid=0, jobs=1): err= 0: pid=3528604: Wed Nov 20 12:43:33 2024 00:16:01.018 read: IOPS=525, BW=2104KiB/s (2154kB/s)(2148KiB/1021msec) 00:16:01.018 slat (nsec): min=6703, max=58644, avg=23215.57, stdev=10573.95 00:16:01.018 clat (usec): min=208, max=41013, avg=1385.81, stdev=6394.20 00:16:01.018 lat (usec): min=222, max=41049, avg=1409.02, stdev=6393.44 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 217], 5.00th=[ 227], 10.00th=[ 237], 20.00th=[ 258], 00:16:01.018 | 30.00th=[ 281], 40.00th=[ 310], 50.00th=[ 347], 60.00th=[ 367], 00:16:01.018 | 70.00th=[ 392], 80.00th=[ 424], 90.00th=[ 465], 95.00th=[ 506], 00:16:01.018 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:01.018 | 99.99th=[41157] 00:16:01.018 write: IOPS=1002, BW=4012KiB/s (4108kB/s)(4096KiB/1021msec); 0 zone resets 00:16:01.018 slat (nsec): min=7944, max=65342, avg=16972.86, stdev=6857.25 00:16:01.018 clat (usec): min=151, max=451, avg=232.50, stdev=42.02 00:16:01.018 lat (usec): min=166, max=490, avg=249.48, stdev=43.15 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 163], 5.00th=[ 174], 10.00th=[ 186], 20.00th=[ 202], 00:16:01.018 | 30.00th=[ 210], 40.00th=[ 221], 50.00th=[ 229], 60.00th=[ 235], 00:16:01.018 | 70.00th=[ 243], 80.00th=[ 255], 90.00th=[ 285], 95.00th=[ 314], 00:16:01.018 | 99.00th=[ 375], 99.50th=[ 392], 99.90th=[ 429], 99.95th=[ 453], 00:16:01.018 | 99.99th=[ 453] 00:16:01.018 bw ( KiB/s): min= 8192, max= 8192, per=45.28%, avg=8192.00, stdev= 0.00, samples=1 00:16:01.018 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:01.018 lat (usec) : 250=57.34%, 500=40.87%, 750=0.70%, 1000=0.19% 00:16:01.018 lat (msec) : 50=0.90% 00:16:01.018 cpu : usr=1.18%, sys=3.33%, ctx=1564, majf=0, minf=1 00:16:01.018 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:01.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.018 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.018 issued rwts: total=537,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:01.018 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:01.018 job3: (groupid=0, jobs=1): err= 0: pid=3528605: Wed Nov 20 12:43:33 2024 00:16:01.018 read: IOPS=490, BW=1963KiB/s (2011kB/s)(2040KiB/1039msec) 00:16:01.018 slat (nsec): min=4333, max=33947, avg=6396.52, stdev=4405.40 00:16:01.018 clat (usec): min=188, max=41162, avg=1816.89, stdev=7920.32 00:16:01.018 lat (usec): min=193, max=41178, avg=1823.28, stdev=7923.59 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 194], 5.00th=[ 198], 10.00th=[ 200], 20.00th=[ 202], 00:16:01.018 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 219], 00:16:01.018 | 70.00th=[ 223], 80.00th=[ 231], 90.00th=[ 249], 95.00th=[ 334], 00:16:01.018 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:01.018 | 99.99th=[41157] 00:16:01.018 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:16:01.018 slat (nsec): min=7053, max=55007, avg=15278.57, stdev=4667.86 00:16:01.018 clat (usec): min=150, max=331, avg=190.56, stdev=23.67 00:16:01.018 lat (usec): min=165, max=376, avg=205.84, stdev=24.52 00:16:01.018 clat percentiles (usec): 00:16:01.018 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 174], 00:16:01.018 | 30.00th=[ 178], 40.00th=[ 182], 50.00th=[ 186], 60.00th=[ 190], 00:16:01.019 | 70.00th=[ 196], 80.00th=[ 202], 90.00th=[ 217], 95.00th=[ 241], 00:16:01.019 | 99.00th=[ 269], 99.50th=[ 285], 99.90th=[ 330], 99.95th=[ 330], 00:16:01.019 | 99.99th=[ 330] 00:16:01.019 bw ( KiB/s): min= 4096, max= 4096, per=22.64%, avg=4096.00, stdev= 0.00, samples=1 00:16:01.019 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:01.019 lat (usec) : 250=93.64%, 500=4.40% 00:16:01.019 lat (msec) : 50=1.96% 00:16:01.019 cpu : usr=0.58%, sys=1.06%, ctx=1022, majf=0, minf=1 00:16:01.019 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:01.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.019 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:01.019 issued rwts: total=510,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:01.019 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:01.019 00:16:01.019 Run status group 0 (all jobs): 00:16:01.019 READ: bw=14.1MiB/s (14.8MB/s), 1963KiB/s-8184KiB/s (2011kB/s-8380kB/s), io=14.7MiB (15.4MB), run=1001-1039msec 00:16:01.019 WRITE: bw=17.7MiB/s (18.5MB/s), 1971KiB/s-8547KiB/s (2018kB/s-8753kB/s), io=18.4MiB (19.2MB), run=1001-1039msec 00:16:01.019 00:16:01.019 Disk stats (read/write): 00:16:01.019 nvme0n1: ios=698/1024, merge=0/0, ticks=868/219, in_queue=1087, util=96.79% 00:16:01.019 nvme0n2: ios=1585/2033, merge=0/0, ticks=398/365, in_queue=763, util=87.93% 00:16:01.019 nvme0n3: ios=589/1024, merge=0/0, ticks=1229/236, in_queue=1465, util=93.96% 00:16:01.019 nvme0n4: ios=562/512, merge=0/0, ticks=1249/93, in_queue=1342, util=99.69% 00:16:01.019 12:43:33 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:01.019 [global] 00:16:01.019 thread=1 00:16:01.019 invalidate=1 00:16:01.019 rw=write 00:16:01.019 time_based=1 00:16:01.019 runtime=1 00:16:01.019 ioengine=libaio 00:16:01.019 direct=1 00:16:01.019 bs=4096 00:16:01.019 iodepth=128 00:16:01.019 norandommap=0 00:16:01.019 numjobs=1 00:16:01.019 00:16:01.019 verify_dump=1 00:16:01.019 verify_backlog=512 00:16:01.019 verify_state_save=0 00:16:01.019 do_verify=1 00:16:01.019 verify=crc32c-intel 00:16:01.019 [job0] 00:16:01.019 filename=/dev/nvme0n1 00:16:01.019 [job1] 00:16:01.019 filename=/dev/nvme0n2 00:16:01.019 [job2] 00:16:01.019 filename=/dev/nvme0n3 00:16:01.019 [job3] 00:16:01.019 filename=/dev/nvme0n4 00:16:01.019 Could not set queue depth (nvme0n1) 00:16:01.019 Could not set queue depth (nvme0n2) 00:16:01.019 Could not set queue depth (nvme0n3) 00:16:01.019 Could not set queue depth (nvme0n4) 00:16:01.278 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:01.278 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:01.278 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:01.278 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:01.278 fio-3.35 00:16:01.278 Starting 4 threads 00:16:02.655 00:16:02.655 job0: (groupid=0, jobs=1): err= 0: pid=3528833: Wed Nov 20 12:43:35 2024 00:16:02.655 read: IOPS=3477, BW=13.6MiB/s (14.2MB/s)(13.7MiB/1007msec) 00:16:02.655 slat (usec): min=2, max=18271, avg=135.75, stdev=969.06 00:16:02.655 clat (usec): min=482, max=58371, avg=16119.75, stdev=8263.15 00:16:02.655 lat (usec): min=5598, max=58379, avg=16255.50, stdev=8343.42 00:16:02.655 clat percentiles (usec): 00:16:02.655 | 1.00th=[ 6259], 5.00th=[ 8979], 10.00th=[ 9372], 20.00th=[10814], 00:16:02.655 | 30.00th=[11731], 40.00th=[12911], 50.00th=[14091], 60.00th=[15008], 00:16:02.655 | 70.00th=[15401], 80.00th=[18220], 90.00th=[28705], 95.00th=[34866], 00:16:02.655 | 99.00th=[45351], 99.50th=[52167], 99.90th=[58459], 99.95th=[58459], 00:16:02.655 | 99.99th=[58459] 00:16:02.655 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:16:02.655 slat (usec): min=4, max=21547, avg=139.58, stdev=834.95 00:16:02.655 clat (usec): min=2621, max=58363, avg=19055.30, stdev=11667.77 00:16:02.655 lat (usec): min=2627, max=58393, avg=19194.88, stdev=11749.65 00:16:02.655 clat percentiles (usec): 00:16:02.655 | 1.00th=[ 3949], 5.00th=[ 7570], 10.00th=[ 9110], 20.00th=[10290], 00:16:02.655 | 30.00th=[10945], 40.00th=[12256], 50.00th=[13698], 60.00th=[16909], 00:16:02.655 | 70.00th=[23200], 80.00th=[27919], 90.00th=[39060], 95.00th=[43779], 00:16:02.655 | 99.00th=[53740], 99.50th=[54264], 99.90th=[56361], 99.95th=[58459], 00:16:02.655 | 99.99th=[58459] 00:16:02.655 bw ( KiB/s): min=11088, max=17584, per=20.73%, avg=14336.00, stdev=4593.37, samples=2 00:16:02.655 iops : min= 2772, max= 4396, avg=3584.00, stdev=1148.34, samples=2 00:16:02.655 lat (usec) : 500=0.01% 00:16:02.655 lat (msec) : 4=0.51%, 10=12.96%, 20=60.61%, 50=24.72%, 100=1.19% 00:16:02.655 cpu : usr=3.68%, sys=5.96%, ctx=284, majf=0, minf=1 00:16:02.655 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:02.655 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:02.655 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:02.655 issued rwts: total=3502,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:02.655 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:02.655 job1: (groupid=0, jobs=1): err= 0: pid=3528834: Wed Nov 20 12:43:35 2024 00:16:02.655 read: IOPS=5401, BW=21.1MiB/s (22.1MB/s)(21.2MiB/1004msec) 00:16:02.655 slat (usec): min=2, max=13020, avg=81.48, stdev=493.26 00:16:02.655 clat (usec): min=3234, max=21700, avg=10389.00, stdev=2055.31 00:16:02.655 lat (usec): min=3247, max=21705, avg=10470.49, stdev=2081.91 00:16:02.655 clat percentiles (usec): 00:16:02.655 | 1.00th=[ 5800], 5.00th=[ 7635], 10.00th=[ 8455], 20.00th=[ 9503], 00:16:02.655 | 30.00th=[ 9765], 40.00th=[10028], 50.00th=[10159], 60.00th=[10421], 00:16:02.655 | 70.00th=[10814], 80.00th=[11207], 90.00th=[12387], 95.00th=[13566], 00:16:02.655 | 99.00th=[18744], 99.50th=[20841], 99.90th=[21627], 99.95th=[21627], 00:16:02.655 | 99.99th=[21627] 00:16:02.655 write: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec); 0 zone resets 00:16:02.655 slat (usec): min=4, max=61637, avg=91.26, stdev=945.32 00:16:02.655 clat (usec): min=5522, max=68570, avg=10791.55, stdev=1504.97 00:16:02.655 lat (usec): min=5530, max=84790, avg=10882.81, stdev=1793.38 00:16:02.655 clat percentiles (usec): 00:16:02.656 | 1.00th=[ 6390], 5.00th=[ 7898], 10.00th=[ 9634], 20.00th=[10421], 00:16:02.656 | 30.00th=[10552], 40.00th=[10683], 50.00th=[10945], 60.00th=[11076], 00:16:02.656 | 70.00th=[11076], 80.00th=[11207], 90.00th=[11863], 95.00th=[12780], 00:16:02.656 | 99.00th=[14615], 99.50th=[15008], 99.90th=[15270], 99.95th=[15795], 00:16:02.656 | 99.99th=[68682] 00:16:02.656 bw ( KiB/s): min=20480, max=24576, per=32.58%, avg=22528.00, stdev=2896.31, samples=2 00:16:02.656 iops : min= 5120, max= 6144, avg=5632.00, stdev=724.08, samples=2 00:16:02.656 lat (msec) : 4=0.30%, 10=25.70%, 20=73.59%, 50=0.41%, 100=0.01% 00:16:02.656 cpu : usr=6.68%, sys=8.08%, ctx=549, majf=0, minf=1 00:16:02.656 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:02.656 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:02.656 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:02.656 issued rwts: total=5423,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:02.656 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:02.656 job2: (groupid=0, jobs=1): err= 0: pid=3528835: Wed Nov 20 12:43:35 2024 00:16:02.656 read: IOPS=5051, BW=19.7MiB/s (20.7MB/s)(19.8MiB/1002msec) 00:16:02.656 slat (usec): min=3, max=6932, avg=97.18, stdev=598.54 00:16:02.656 clat (usec): min=943, max=19618, avg=12236.93, stdev=1832.90 00:16:02.656 lat (usec): min=3407, max=19659, avg=12334.11, stdev=1877.61 00:16:02.656 clat percentiles (usec): 00:16:02.656 | 1.00th=[ 6783], 5.00th=[ 9110], 10.00th=[10421], 20.00th=[11338], 00:16:02.656 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12125], 60.00th=[12387], 00:16:02.656 | 70.00th=[13042], 80.00th=[13566], 90.00th=[14222], 95.00th=[15270], 00:16:02.656 | 99.00th=[16909], 99.50th=[17695], 99.90th=[18220], 99.95th=[19006], 00:16:02.656 | 99.99th=[19530] 00:16:02.656 write: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec); 0 zone resets 00:16:02.656 slat (usec): min=4, max=24288, avg=90.69, stdev=581.81 00:16:02.656 clat (usec): min=4882, max=34282, avg=12676.94, stdev=3495.12 00:16:02.656 lat (usec): min=4909, max=34291, avg=12767.63, stdev=3516.58 00:16:02.656 clat percentiles (usec): 00:16:02.656 | 1.00th=[ 7439], 5.00th=[ 8094], 10.00th=[ 9634], 20.00th=[11863], 00:16:02.656 | 30.00th=[11994], 40.00th=[12256], 50.00th=[12387], 60.00th=[12649], 00:16:02.656 | 70.00th=[12911], 80.00th=[13173], 90.00th=[13698], 95.00th=[15664], 00:16:02.656 | 99.00th=[31851], 99.50th=[33162], 99.90th=[33817], 99.95th=[34341], 00:16:02.656 | 99.99th=[34341] 00:16:02.656 bw ( KiB/s): min=20480, max=20480, per=29.62%, avg=20480.00, stdev= 0.00, samples=2 00:16:02.656 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:16:02.656 lat (usec) : 1000=0.01% 00:16:02.656 lat (msec) : 4=0.08%, 10=10.08%, 20=88.59%, 50=1.25% 00:16:02.656 cpu : usr=5.69%, sys=9.29%, ctx=450, majf=0, minf=2 00:16:02.656 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:02.656 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:02.656 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:02.656 issued rwts: total=5062,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:02.656 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:02.656 job3: (groupid=0, jobs=1): err= 0: pid=3528836: Wed Nov 20 12:43:35 2024 00:16:02.656 read: IOPS=2837, BW=11.1MiB/s (11.6MB/s)(11.2MiB/1006msec) 00:16:02.656 slat (usec): min=3, max=17207, avg=154.57, stdev=996.04 00:16:02.656 clat (usec): min=3088, max=62905, avg=19834.50, stdev=10486.16 00:16:02.656 lat (usec): min=6420, max=62912, avg=19989.06, stdev=10579.67 00:16:02.656 clat percentiles (usec): 00:16:02.656 | 1.00th=[ 6718], 5.00th=[12780], 10.00th=[13698], 20.00th=[14353], 00:16:02.656 | 30.00th=[14746], 40.00th=[15008], 50.00th=[15270], 60.00th=[16319], 00:16:02.656 | 70.00th=[17695], 80.00th=[21627], 90.00th=[35914], 95.00th=[45351], 00:16:02.656 | 99.00th=[57934], 99.50th=[62653], 99.90th=[62653], 99.95th=[62653], 00:16:02.656 | 99.99th=[62653] 00:16:02.656 write: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec); 0 zone resets 00:16:02.656 slat (usec): min=4, max=24983, avg=174.75, stdev=1122.26 00:16:02.656 clat (usec): min=8883, max=58746, avg=22411.39, stdev=11371.71 00:16:02.656 lat (usec): min=8895, max=58770, avg=22586.14, stdev=11466.89 00:16:02.656 clat percentiles (usec): 00:16:02.656 | 1.00th=[10290], 5.00th=[12125], 10.00th=[13304], 20.00th=[13698], 00:16:02.656 | 30.00th=[14091], 40.00th=[14746], 50.00th=[19792], 60.00th=[21890], 00:16:02.656 | 70.00th=[23462], 80.00th=[29230], 90.00th=[40633], 95.00th=[49546], 00:16:02.656 | 99.00th=[58459], 99.50th=[58459], 99.90th=[58983], 99.95th=[58983], 00:16:02.656 | 99.99th=[58983] 00:16:02.656 bw ( KiB/s): min=12288, max=12288, per=17.77%, avg=12288.00, stdev= 0.00, samples=2 00:16:02.656 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:16:02.656 lat (msec) : 4=0.02%, 10=0.88%, 20=63.62%, 50=31.36%, 100=4.12% 00:16:02.656 cpu : usr=2.89%, sys=4.78%, ctx=265, majf=0, minf=1 00:16:02.656 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:16:02.656 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:02.656 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:02.656 issued rwts: total=2855,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:02.656 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:02.656 00:16:02.656 Run status group 0 (all jobs): 00:16:02.656 READ: bw=65.3MiB/s (68.5MB/s), 11.1MiB/s-21.1MiB/s (11.6MB/s-22.1MB/s), io=65.8MiB (69.0MB), run=1002-1007msec 00:16:02.656 WRITE: bw=67.5MiB/s (70.8MB/s), 11.9MiB/s-21.9MiB/s (12.5MB/s-23.0MB/s), io=68.0MiB (71.3MB), run=1002-1007msec 00:16:02.656 00:16:02.656 Disk stats (read/write): 00:16:02.656 nvme0n1: ios=3124/3359, merge=0/0, ticks=42149/57525, in_queue=99674, util=91.48% 00:16:02.656 nvme0n2: ios=4547/4608, merge=0/0, ticks=23665/22792, in_queue=46457, util=95.73% 00:16:02.656 nvme0n3: ios=4120/4465, merge=0/0, ticks=24847/26101, in_queue=50948, util=97.80% 00:16:02.656 nvme0n4: ios=2171/2560, merge=0/0, ticks=24935/31018, in_queue=55953, util=100.00% 00:16:02.656 12:43:35 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:02.656 [global] 00:16:02.656 thread=1 00:16:02.656 invalidate=1 00:16:02.656 rw=randwrite 00:16:02.656 time_based=1 00:16:02.656 runtime=1 00:16:02.656 ioengine=libaio 00:16:02.656 direct=1 00:16:02.656 bs=4096 00:16:02.656 iodepth=128 00:16:02.656 norandommap=0 00:16:02.656 numjobs=1 00:16:02.656 00:16:02.656 verify_dump=1 00:16:02.656 verify_backlog=512 00:16:02.656 verify_state_save=0 00:16:02.656 do_verify=1 00:16:02.656 verify=crc32c-intel 00:16:02.656 [job0] 00:16:02.656 filename=/dev/nvme0n1 00:16:02.656 [job1] 00:16:02.656 filename=/dev/nvme0n2 00:16:02.656 [job2] 00:16:02.656 filename=/dev/nvme0n3 00:16:02.656 [job3] 00:16:02.656 filename=/dev/nvme0n4 00:16:02.656 Could not set queue depth (nvme0n1) 00:16:02.656 Could not set queue depth (nvme0n2) 00:16:02.656 Could not set queue depth (nvme0n3) 00:16:02.656 Could not set queue depth (nvme0n4) 00:16:02.656 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:02.656 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:02.656 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:02.656 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:02.656 fio-3.35 00:16:02.656 Starting 4 threads 00:16:04.034 00:16:04.034 job0: (groupid=0, jobs=1): err= 0: pid=3529160: Wed Nov 20 12:43:36 2024 00:16:04.034 read: IOPS=5460, BW=21.3MiB/s (22.4MB/s)(21.4MiB/1004msec) 00:16:04.034 slat (usec): min=2, max=10601, avg=93.90, stdev=656.97 00:16:04.034 clat (usec): min=1719, max=21951, avg=11768.86, stdev=2843.58 00:16:04.034 lat (usec): min=4389, max=21966, avg=11862.76, stdev=2888.70 00:16:04.034 clat percentiles (usec): 00:16:04.034 | 1.00th=[ 5014], 5.00th=[ 8848], 10.00th=[10028], 20.00th=[10290], 00:16:04.034 | 30.00th=[10552], 40.00th=[10683], 50.00th=[10945], 60.00th=[11076], 00:16:04.034 | 70.00th=[11469], 80.00th=[13042], 90.00th=[16450], 95.00th=[18220], 00:16:04.034 | 99.00th=[20579], 99.50th=[21103], 99.90th=[21627], 99.95th=[21890], 00:16:04.034 | 99.99th=[21890] 00:16:04.034 write: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec); 0 zone resets 00:16:04.034 slat (usec): min=3, max=9650, avg=77.83, stdev=465.27 00:16:04.034 clat (usec): min=1176, max=21934, avg=11160.58, stdev=2199.11 00:16:04.034 lat (usec): min=1213, max=21940, avg=11238.41, stdev=2245.87 00:16:04.034 clat percentiles (usec): 00:16:04.034 | 1.00th=[ 3785], 5.00th=[ 6259], 10.00th=[ 7963], 20.00th=[10290], 00:16:04.034 | 30.00th=[11076], 40.00th=[11600], 50.00th=[11863], 60.00th=[11994], 00:16:04.034 | 70.00th=[12125], 80.00th=[12256], 90.00th=[12518], 95.00th=[13042], 00:16:04.034 | 99.00th=[15926], 99.50th=[16057], 99.90th=[21103], 99.95th=[21627], 00:16:04.034 | 99.99th=[21890] 00:16:04.034 bw ( KiB/s): min=21600, max=23456, per=33.41%, avg=22528.00, stdev=1312.39, samples=2 00:16:04.034 iops : min= 5400, max= 5864, avg=5632.00, stdev=328.10, samples=2 00:16:04.034 lat (msec) : 2=0.02%, 4=0.57%, 10=13.28%, 20=85.09%, 50=1.04% 00:16:04.034 cpu : usr=6.18%, sys=9.07%, ctx=566, majf=0, minf=1 00:16:04.034 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:04.034 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:04.034 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:04.034 issued rwts: total=5482,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:04.034 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:04.034 job1: (groupid=0, jobs=1): err= 0: pid=3529181: Wed Nov 20 12:43:36 2024 00:16:04.034 read: IOPS=3677, BW=14.4MiB/s (15.1MB/s)(14.4MiB/1004msec) 00:16:04.034 slat (usec): min=2, max=14012, avg=115.59, stdev=801.39 00:16:04.034 clat (usec): min=3412, max=45146, avg=13753.95, stdev=6099.71 00:16:04.034 lat (usec): min=3672, max=45155, avg=13869.54, stdev=6166.15 00:16:04.034 clat percentiles (usec): 00:16:04.034 | 1.00th=[ 5342], 5.00th=[ 6849], 10.00th=[ 8848], 20.00th=[10552], 00:16:04.034 | 30.00th=[10814], 40.00th=[11469], 50.00th=[12125], 60.00th=[12518], 00:16:04.034 | 70.00th=[13960], 80.00th=[17171], 90.00th=[21103], 95.00th=[27132], 00:16:04.034 | 99.00th=[38011], 99.50th=[43254], 99.90th=[45351], 99.95th=[45351], 00:16:04.034 | 99.99th=[45351] 00:16:04.034 write: IOPS=4079, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1004msec); 0 zone resets 00:16:04.034 slat (usec): min=3, max=38268, avg=122.26, stdev=910.67 00:16:04.034 clat (usec): min=263, max=49717, avg=18715.03, stdev=11240.79 00:16:04.034 lat (usec): min=604, max=49735, avg=18837.29, stdev=11317.37 00:16:04.034 clat percentiles (usec): 00:16:04.034 | 1.00th=[ 1029], 5.00th=[ 2311], 10.00th=[ 4424], 20.00th=[11076], 00:16:04.034 | 30.00th=[11731], 40.00th=[12256], 50.00th=[17433], 60.00th=[21103], 00:16:04.034 | 70.00th=[23725], 80.00th=[27919], 90.00th=[36439], 95.00th=[40633], 00:16:04.034 | 99.00th=[45351], 99.50th=[45876], 99.90th=[45876], 99.95th=[45876], 00:16:04.034 | 99.99th=[49546] 00:16:04.034 bw ( KiB/s): min=15808, max=16720, per=24.12%, avg=16264.00, stdev=644.88, samples=2 00:16:04.034 iops : min= 3952, max= 4180, avg=4066.00, stdev=161.22, samples=2 00:16:04.034 lat (usec) : 500=0.03%, 750=0.05%, 1000=0.33% 00:16:04.034 lat (msec) : 2=1.67%, 4=2.86%, 10=10.76%, 20=56.83%, 50=27.47% 00:16:04.034 cpu : usr=2.99%, sys=4.59%, ctx=376, majf=0, minf=1 00:16:04.034 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:04.034 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:04.034 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:04.034 issued rwts: total=3692,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:04.034 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:04.034 job2: (groupid=0, jobs=1): err= 0: pid=3529200: Wed Nov 20 12:43:36 2024 00:16:04.034 read: IOPS=4278, BW=16.7MiB/s (17.5MB/s)(17.5MiB/1046msec) 00:16:04.034 slat (usec): min=2, max=6372, avg=101.96, stdev=582.59 00:16:04.034 clat (usec): min=6412, max=53514, avg=13904.89, stdev=6846.44 00:16:04.034 lat (usec): min=6423, max=59139, avg=14006.84, stdev=6867.21 00:16:04.034 clat percentiles (usec): 00:16:04.034 | 1.00th=[ 8225], 5.00th=[ 9503], 10.00th=[10683], 20.00th=[11469], 00:16:04.034 | 30.00th=[11600], 40.00th=[11863], 50.00th=[12125], 60.00th=[12518], 00:16:04.034 | 70.00th=[13304], 80.00th=[14877], 90.00th=[16319], 95.00th=[20579], 00:16:04.034 | 99.00th=[53216], 99.50th=[53216], 99.90th=[53216], 99.95th=[53740], 00:16:04.034 | 99.99th=[53740] 00:16:04.034 write: IOPS=4405, BW=17.2MiB/s (18.0MB/s)(18.0MiB/1046msec); 0 zone resets 00:16:04.034 slat (usec): min=3, max=7910, avg=110.13, stdev=517.47 00:16:04.034 clat (usec): min=5896, max=51733, avg=15244.88, stdev=6506.55 00:16:04.034 lat (usec): min=5902, max=51754, avg=15355.01, stdev=6554.37 00:16:04.034 clat percentiles (usec): 00:16:04.034 | 1.00th=[ 7701], 5.00th=[ 9503], 10.00th=[11600], 20.00th=[11994], 00:16:04.034 | 30.00th=[12387], 40.00th=[12649], 50.00th=[13042], 60.00th=[13173], 00:16:04.034 | 70.00th=[13698], 80.00th=[17957], 90.00th=[23462], 95.00th=[24773], 00:16:04.034 | 99.00th=[46924], 99.50th=[49546], 99.90th=[51643], 99.95th=[51643], 00:16:04.034 | 99.99th=[51643] 00:16:04.034 bw ( KiB/s): min=16384, max=20480, per=27.34%, avg=18432.00, stdev=2896.31, samples=2 00:16:04.034 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:16:04.034 lat (msec) : 10=6.46%, 20=81.47%, 50=11.22%, 100=0.85% 00:16:04.034 cpu : usr=4.69%, sys=8.13%, ctx=530, majf=0, minf=1 00:16:04.034 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:04.034 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:04.034 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:04.034 issued rwts: total=4475,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:04.034 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:04.034 job3: (groupid=0, jobs=1): err= 0: pid=3529201: Wed Nov 20 12:43:36 2024 00:16:04.034 read: IOPS=3050, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1007msec) 00:16:04.034 slat (usec): min=3, max=17361, avg=125.53, stdev=822.91 00:16:04.034 clat (usec): min=7090, max=49801, avg=15818.46, stdev=6480.99 00:16:04.034 lat (usec): min=7106, max=49827, avg=15943.99, stdev=6555.76 00:16:04.035 clat percentiles (usec): 00:16:04.035 | 1.00th=[ 8160], 5.00th=[10814], 10.00th=[11207], 20.00th=[11600], 00:16:04.035 | 30.00th=[11863], 40.00th=[12780], 50.00th=[14746], 60.00th=[15795], 00:16:04.035 | 70.00th=[16188], 80.00th=[16909], 90.00th=[20841], 95.00th=[34341], 00:16:04.035 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[45876], 00:16:04.035 | 99.99th=[49546] 00:16:04.035 write: IOPS=3272, BW=12.8MiB/s (13.4MB/s)(12.9MiB/1007msec); 0 zone resets 00:16:04.035 slat (usec): min=4, max=29924, avg=176.43, stdev=1159.43 00:16:04.035 clat (usec): min=5782, max=89872, avg=23700.84, stdev=16334.92 00:16:04.035 lat (usec): min=7474, max=89881, avg=23877.27, stdev=16438.30 00:16:04.035 clat percentiles (usec): 00:16:04.035 | 1.00th=[ 8291], 5.00th=[11731], 10.00th=[12125], 20.00th=[12256], 00:16:04.035 | 30.00th=[12649], 40.00th=[14746], 50.00th=[15795], 60.00th=[22938], 00:16:04.035 | 70.00th=[26084], 80.00th=[31589], 90.00th=[50594], 95.00th=[61080], 00:16:04.035 | 99.00th=[85459], 99.50th=[88605], 99.90th=[89654], 99.95th=[89654], 00:16:04.035 | 99.99th=[89654] 00:16:04.035 bw ( KiB/s): min= 8960, max=16384, per=18.79%, avg=12672.00, stdev=5249.56, samples=2 00:16:04.035 iops : min= 2240, max= 4096, avg=3168.00, stdev=1312.39, samples=2 00:16:04.035 lat (msec) : 10=2.26%, 20=71.04%, 50=20.86%, 100=5.84% 00:16:04.035 cpu : usr=3.58%, sys=7.55%, ctx=268, majf=0, minf=1 00:16:04.035 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:04.035 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:04.035 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:04.035 issued rwts: total=3072,3295,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:04.035 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:04.035 00:16:04.035 Run status group 0 (all jobs): 00:16:04.035 READ: bw=62.4MiB/s (65.5MB/s), 11.9MiB/s-21.3MiB/s (12.5MB/s-22.4MB/s), io=65.3MiB (68.5MB), run=1004-1046msec 00:16:04.035 WRITE: bw=65.8MiB/s (69.0MB/s), 12.8MiB/s-21.9MiB/s (13.4MB/s-23.0MB/s), io=68.9MiB (72.2MB), run=1004-1046msec 00:16:04.035 00:16:04.035 Disk stats (read/write): 00:16:04.035 nvme0n1: ios=4658/4759, merge=0/0, ticks=51013/51144, in_queue=102157, util=86.07% 00:16:04.035 nvme0n2: ios=3117/3466, merge=0/0, ticks=35694/55602, in_queue=91296, util=98.98% 00:16:04.035 nvme0n3: ios=3640/3771, merge=0/0, ticks=22773/28725, in_queue=51498, util=90.44% 00:16:04.035 nvme0n4: ios=2618/2975, merge=0/0, ticks=17845/33645, in_queue=51490, util=97.46% 00:16:04.035 12:43:36 -- target/fio.sh@55 -- # sync 00:16:04.035 12:43:36 -- target/fio.sh@59 -- # fio_pid=3529342 00:16:04.035 12:43:36 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:04.035 12:43:36 -- target/fio.sh@61 -- # sleep 3 00:16:04.035 [global] 00:16:04.035 thread=1 00:16:04.035 invalidate=1 00:16:04.035 rw=read 00:16:04.035 time_based=1 00:16:04.035 runtime=10 00:16:04.035 ioengine=libaio 00:16:04.035 direct=1 00:16:04.035 bs=4096 00:16:04.035 iodepth=1 00:16:04.035 norandommap=1 00:16:04.035 numjobs=1 00:16:04.035 00:16:04.035 [job0] 00:16:04.035 filename=/dev/nvme0n1 00:16:04.035 [job1] 00:16:04.035 filename=/dev/nvme0n2 00:16:04.035 [job2] 00:16:04.035 filename=/dev/nvme0n3 00:16:04.035 [job3] 00:16:04.035 filename=/dev/nvme0n4 00:16:04.035 Could not set queue depth (nvme0n1) 00:16:04.035 Could not set queue depth (nvme0n2) 00:16:04.035 Could not set queue depth (nvme0n3) 00:16:04.035 Could not set queue depth (nvme0n4) 00:16:04.294 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:04.294 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:04.294 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:04.294 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:04.294 fio-3.35 00:16:04.294 Starting 4 threads 00:16:07.588 12:43:39 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:07.588 12:43:40 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:07.588 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=39059456, buflen=4096 00:16:07.588 fio: pid=3529433, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:07.588 12:43:40 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:07.588 12:43:40 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:07.588 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=42999808, buflen=4096 00:16:07.588 fio: pid=3529432, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:07.846 12:43:40 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:07.846 12:43:40 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:07.846 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=41304064, buflen=4096 00:16:07.847 fio: pid=3529430, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:08.105 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=53649408, buflen=4096 00:16:08.105 fio: pid=3529431, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:08.105 12:43:41 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:08.105 12:43:41 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:08.105 00:16:08.105 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3529430: Wed Nov 20 12:43:41 2024 00:16:08.105 read: IOPS=2915, BW=11.4MiB/s (11.9MB/s)(39.4MiB/3459msec) 00:16:08.105 slat (usec): min=4, max=13147, avg=13.05, stdev=143.46 00:16:08.105 clat (usec): min=190, max=50126, avg=324.92, stdev=1518.58 00:16:08.105 lat (usec): min=195, max=63274, avg=337.96, stdev=1582.52 00:16:08.105 clat percentiles (usec): 00:16:08.105 | 1.00th=[ 204], 5.00th=[ 215], 10.00th=[ 221], 20.00th=[ 229], 00:16:08.105 | 30.00th=[ 237], 40.00th=[ 243], 50.00th=[ 258], 60.00th=[ 273], 00:16:08.105 | 70.00th=[ 285], 80.00th=[ 306], 90.00th=[ 326], 95.00th=[ 351], 00:16:08.105 | 99.00th=[ 478], 99.50th=[ 519], 99.90th=[41157], 99.95th=[41157], 00:16:08.105 | 99.99th=[41157] 00:16:08.105 bw ( KiB/s): min= 8992, max=15640, per=28.84%, avg=13430.67, stdev=2535.45, samples=6 00:16:08.105 iops : min= 2248, max= 3910, avg=3357.67, stdev=633.86, samples=6 00:16:08.105 lat (usec) : 250=45.89%, 500=53.35%, 750=0.54%, 1000=0.02% 00:16:08.105 lat (msec) : 2=0.06%, 50=0.13%, 100=0.01% 00:16:08.105 cpu : usr=1.88%, sys=3.93%, ctx=10089, majf=0, minf=1 00:16:08.105 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:08.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.105 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.105 issued rwts: total=10085,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.105 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:08.105 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3529431: Wed Nov 20 12:43:41 2024 00:16:08.105 read: IOPS=3528, BW=13.8MiB/s (14.5MB/s)(51.2MiB/3712msec) 00:16:08.105 slat (usec): min=4, max=8802, avg=14.23, stdev=162.60 00:16:08.105 clat (usec): min=186, max=13303, avg=264.81, stdev=129.37 00:16:08.105 lat (usec): min=192, max=13311, avg=279.03, stdev=208.19 00:16:08.105 clat percentiles (usec): 00:16:08.105 | 1.00th=[ 200], 5.00th=[ 210], 10.00th=[ 217], 20.00th=[ 227], 00:16:08.105 | 30.00th=[ 235], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 255], 00:16:08.105 | 70.00th=[ 269], 80.00th=[ 285], 90.00th=[ 334], 95.00th=[ 392], 00:16:08.105 | 99.00th=[ 482], 99.50th=[ 510], 99.90th=[ 660], 99.95th=[ 824], 00:16:08.105 | 99.99th=[ 1729] 00:16:08.105 bw ( KiB/s): min=12440, max=15664, per=30.61%, avg=14254.86, stdev=960.66, samples=7 00:16:08.105 iops : min= 3110, max= 3916, avg=3563.71, stdev=240.17, samples=7 00:16:08.105 lat (usec) : 250=53.36%, 500=45.91%, 750=0.63%, 1000=0.05% 00:16:08.105 lat (msec) : 2=0.02%, 20=0.01% 00:16:08.105 cpu : usr=1.86%, sys=5.15%, ctx=13108, majf=0, minf=2 00:16:08.105 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:08.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.105 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.105 issued rwts: total=13099,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.105 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:08.106 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3529432: Wed Nov 20 12:43:41 2024 00:16:08.106 read: IOPS=3296, BW=12.9MiB/s (13.5MB/s)(41.0MiB/3185msec) 00:16:08.106 slat (usec): min=4, max=7656, avg=12.48, stdev=101.36 00:16:08.106 clat (usec): min=215, max=41882, avg=285.37, stdev=576.38 00:16:08.106 lat (usec): min=222, max=41900, avg=297.85, stdev=585.37 00:16:08.106 clat percentiles (usec): 00:16:08.106 | 1.00th=[ 229], 5.00th=[ 237], 10.00th=[ 241], 20.00th=[ 249], 00:16:08.106 | 30.00th=[ 255], 40.00th=[ 262], 50.00th=[ 269], 60.00th=[ 277], 00:16:08.106 | 70.00th=[ 285], 80.00th=[ 293], 90.00th=[ 310], 95.00th=[ 355], 00:16:08.106 | 99.00th=[ 445], 99.50th=[ 490], 99.90th=[ 627], 99.95th=[ 816], 00:16:08.106 | 99.99th=[40633] 00:16:08.106 bw ( KiB/s): min=11376, max=15280, per=28.47%, avg=13256.00, stdev=1458.00, samples=6 00:16:08.106 iops : min= 2844, max= 3820, avg=3314.00, stdev=364.50, samples=6 00:16:08.106 lat (usec) : 250=22.55%, 500=77.05%, 750=0.34%, 1000=0.01% 00:16:08.106 lat (msec) : 2=0.02%, 20=0.01%, 50=0.02% 00:16:08.106 cpu : usr=2.17%, sys=5.84%, ctx=10501, majf=0, minf=2 00:16:08.106 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:08.106 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.106 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.106 issued rwts: total=10499,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.106 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:08.106 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3529433: Wed Nov 20 12:43:41 2024 00:16:08.106 read: IOPS=3271, BW=12.8MiB/s (13.4MB/s)(37.2MiB/2915msec) 00:16:08.106 slat (nsec): min=5048, max=68374, avg=12311.24, stdev=5740.97 00:16:08.106 clat (usec): min=207, max=1408, avg=287.36, stdev=47.43 00:16:08.106 lat (usec): min=215, max=1416, avg=299.67, stdev=49.83 00:16:08.106 clat percentiles (usec): 00:16:08.106 | 1.00th=[ 223], 5.00th=[ 235], 10.00th=[ 241], 20.00th=[ 251], 00:16:08.106 | 30.00th=[ 262], 40.00th=[ 273], 50.00th=[ 281], 60.00th=[ 289], 00:16:08.106 | 70.00th=[ 302], 80.00th=[ 314], 90.00th=[ 334], 95.00th=[ 367], 00:16:08.106 | 99.00th=[ 461], 99.50th=[ 494], 99.90th=[ 553], 99.95th=[ 750], 00:16:08.106 | 99.99th=[ 1401] 00:16:08.106 bw ( KiB/s): min=11768, max=15568, per=28.71%, avg=13369.60, stdev=1428.48, samples=5 00:16:08.106 iops : min= 2942, max= 3892, avg=3342.40, stdev=357.12, samples=5 00:16:08.106 lat (usec) : 250=18.78%, 500=80.78%, 750=0.38%, 1000=0.02% 00:16:08.106 lat (msec) : 2=0.03% 00:16:08.106 cpu : usr=2.75%, sys=5.77%, ctx=9539, majf=0, minf=1 00:16:08.106 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:08.106 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.106 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.106 issued rwts: total=9537,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.106 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:08.106 00:16:08.106 Run status group 0 (all jobs): 00:16:08.106 READ: bw=45.5MiB/s (47.7MB/s), 11.4MiB/s-13.8MiB/s (11.9MB/s-14.5MB/s), io=169MiB (177MB), run=2915-3712msec 00:16:08.106 00:16:08.106 Disk stats (read/write): 00:16:08.106 nvme0n1: ios=10081/0, merge=0/0, ticks=3072/0, in_queue=3072, util=95.36% 00:16:08.106 nvme0n2: ios=12863/0, merge=0/0, ticks=4329/0, in_queue=4329, util=99.14% 00:16:08.106 nvme0n3: ios=10282/0, merge=0/0, ticks=2848/0, in_queue=2848, util=96.38% 00:16:08.106 nvme0n4: ios=9464/0, merge=0/0, ticks=2809/0, in_queue=2809, util=99.80% 00:16:08.364 12:43:41 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:08.364 12:43:41 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:08.623 12:43:41 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:08.623 12:43:41 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:08.881 12:43:41 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:08.881 12:43:41 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:09.140 12:43:42 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:09.140 12:43:42 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:09.397 12:43:42 -- target/fio.sh@69 -- # fio_status=0 00:16:09.397 12:43:42 -- target/fio.sh@70 -- # wait 3529342 00:16:09.397 12:43:42 -- target/fio.sh@70 -- # fio_status=4 00:16:09.397 12:43:42 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:09.655 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:09.655 12:43:42 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:09.655 12:43:42 -- common/autotest_common.sh@1208 -- # local i=0 00:16:09.655 12:43:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:09.655 12:43:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:09.655 12:43:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:09.655 12:43:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:09.655 12:43:42 -- common/autotest_common.sh@1220 -- # return 0 00:16:09.655 12:43:42 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:09.655 12:43:42 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:09.655 nvmf hotplug test: fio failed as expected 00:16:09.655 12:43:42 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:09.916 12:43:42 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:09.916 12:43:42 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:09.916 12:43:42 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:09.916 12:43:42 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:09.916 12:43:42 -- target/fio.sh@91 -- # nvmftestfini 00:16:09.916 12:43:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:09.916 12:43:42 -- nvmf/common.sh@116 -- # sync 00:16:09.916 12:43:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:09.916 12:43:42 -- nvmf/common.sh@119 -- # set +e 00:16:09.916 12:43:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:09.916 12:43:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:09.916 rmmod nvme_tcp 00:16:09.916 rmmod nvme_fabrics 00:16:09.916 rmmod nvme_keyring 00:16:09.916 12:43:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:09.916 12:43:42 -- nvmf/common.sh@123 -- # set -e 00:16:09.916 12:43:42 -- nvmf/common.sh@124 -- # return 0 00:16:09.916 12:43:42 -- nvmf/common.sh@477 -- # '[' -n 3527129 ']' 00:16:09.916 12:43:42 -- nvmf/common.sh@478 -- # killprocess 3527129 00:16:09.916 12:43:42 -- common/autotest_common.sh@936 -- # '[' -z 3527129 ']' 00:16:09.916 12:43:42 -- common/autotest_common.sh@940 -- # kill -0 3527129 00:16:09.916 12:43:42 -- common/autotest_common.sh@941 -- # uname 00:16:09.916 12:43:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:09.916 12:43:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3527129 00:16:09.916 12:43:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:09.916 12:43:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:09.916 12:43:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3527129' 00:16:09.916 killing process with pid 3527129 00:16:09.916 12:43:42 -- common/autotest_common.sh@955 -- # kill 3527129 00:16:09.916 12:43:42 -- common/autotest_common.sh@960 -- # wait 3527129 00:16:10.176 12:43:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:10.176 12:43:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:10.176 12:43:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:10.176 12:43:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:10.176 12:43:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:10.176 12:43:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:10.176 12:43:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:10.176 12:43:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:12.712 12:43:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:12.712 00:16:12.712 real 0m24.301s 00:16:12.712 user 1m23.001s 00:16:12.712 sys 0m8.695s 00:16:12.712 12:43:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:12.712 12:43:45 -- common/autotest_common.sh@10 -- # set +x 00:16:12.712 ************************************ 00:16:12.712 END TEST nvmf_fio_target 00:16:12.712 ************************************ 00:16:12.712 12:43:45 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:12.712 12:43:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:12.712 12:43:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:12.712 12:43:45 -- common/autotest_common.sh@10 -- # set +x 00:16:12.712 ************************************ 00:16:12.712 START TEST nvmf_bdevio 00:16:12.712 ************************************ 00:16:12.712 12:43:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:12.712 * Looking for test storage... 00:16:12.712 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:12.712 12:43:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:12.712 12:43:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:12.712 12:43:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:12.712 12:43:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:12.712 12:43:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:12.712 12:43:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:12.712 12:43:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:12.712 12:43:45 -- scripts/common.sh@335 -- # IFS=.-: 00:16:12.712 12:43:45 -- scripts/common.sh@335 -- # read -ra ver1 00:16:12.712 12:43:45 -- scripts/common.sh@336 -- # IFS=.-: 00:16:12.712 12:43:45 -- scripts/common.sh@336 -- # read -ra ver2 00:16:12.712 12:43:45 -- scripts/common.sh@337 -- # local 'op=<' 00:16:12.712 12:43:45 -- scripts/common.sh@339 -- # ver1_l=2 00:16:12.712 12:43:45 -- scripts/common.sh@340 -- # ver2_l=1 00:16:12.712 12:43:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:12.712 12:43:45 -- scripts/common.sh@343 -- # case "$op" in 00:16:12.712 12:43:45 -- scripts/common.sh@344 -- # : 1 00:16:12.712 12:43:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:12.712 12:43:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:12.712 12:43:45 -- scripts/common.sh@364 -- # decimal 1 00:16:12.712 12:43:45 -- scripts/common.sh@352 -- # local d=1 00:16:12.712 12:43:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:12.712 12:43:45 -- scripts/common.sh@354 -- # echo 1 00:16:12.712 12:43:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:12.712 12:43:45 -- scripts/common.sh@365 -- # decimal 2 00:16:12.712 12:43:45 -- scripts/common.sh@352 -- # local d=2 00:16:12.712 12:43:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:12.712 12:43:45 -- scripts/common.sh@354 -- # echo 2 00:16:12.712 12:43:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:12.712 12:43:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:12.712 12:43:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:12.712 12:43:45 -- scripts/common.sh@367 -- # return 0 00:16:12.712 12:43:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:12.712 12:43:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:12.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.712 --rc genhtml_branch_coverage=1 00:16:12.712 --rc genhtml_function_coverage=1 00:16:12.712 --rc genhtml_legend=1 00:16:12.712 --rc geninfo_all_blocks=1 00:16:12.712 --rc geninfo_unexecuted_blocks=1 00:16:12.712 00:16:12.712 ' 00:16:12.712 12:43:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:12.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.712 --rc genhtml_branch_coverage=1 00:16:12.712 --rc genhtml_function_coverage=1 00:16:12.712 --rc genhtml_legend=1 00:16:12.712 --rc geninfo_all_blocks=1 00:16:12.712 --rc geninfo_unexecuted_blocks=1 00:16:12.712 00:16:12.712 ' 00:16:12.712 12:43:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:12.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.712 --rc genhtml_branch_coverage=1 00:16:12.712 --rc genhtml_function_coverage=1 00:16:12.712 --rc genhtml_legend=1 00:16:12.712 --rc geninfo_all_blocks=1 00:16:12.712 --rc geninfo_unexecuted_blocks=1 00:16:12.712 00:16:12.712 ' 00:16:12.712 12:43:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:12.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.713 --rc genhtml_branch_coverage=1 00:16:12.713 --rc genhtml_function_coverage=1 00:16:12.713 --rc genhtml_legend=1 00:16:12.713 --rc geninfo_all_blocks=1 00:16:12.713 --rc geninfo_unexecuted_blocks=1 00:16:12.713 00:16:12.713 ' 00:16:12.713 12:43:45 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:12.713 12:43:45 -- nvmf/common.sh@7 -- # uname -s 00:16:12.713 12:43:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:12.713 12:43:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:12.713 12:43:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:12.713 12:43:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:12.713 12:43:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:12.713 12:43:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:12.713 12:43:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:12.713 12:43:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:12.713 12:43:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:12.713 12:43:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:12.713 12:43:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:12.713 12:43:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:12.713 12:43:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:12.713 12:43:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:12.713 12:43:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:12.713 12:43:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:12.713 12:43:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:12.713 12:43:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:12.713 12:43:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:12.713 12:43:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.713 12:43:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.713 12:43:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.713 12:43:45 -- paths/export.sh@5 -- # export PATH 00:16:12.713 12:43:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.713 12:43:45 -- nvmf/common.sh@46 -- # : 0 00:16:12.713 12:43:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:12.713 12:43:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:12.713 12:43:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:12.713 12:43:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:12.713 12:43:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:12.713 12:43:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:12.713 12:43:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:12.713 12:43:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:12.713 12:43:45 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:12.713 12:43:45 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:12.713 12:43:45 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:12.713 12:43:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:12.713 12:43:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:12.713 12:43:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:12.713 12:43:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:12.713 12:43:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:12.713 12:43:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:12.713 12:43:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:12.713 12:43:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:12.713 12:43:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:12.713 12:43:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:12.713 12:43:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:12.713 12:43:45 -- common/autotest_common.sh@10 -- # set +x 00:16:14.614 12:43:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:14.614 12:43:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:14.614 12:43:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:14.614 12:43:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:14.614 12:43:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:14.614 12:43:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:14.614 12:43:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:14.614 12:43:47 -- nvmf/common.sh@294 -- # net_devs=() 00:16:14.614 12:43:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:14.614 12:43:47 -- nvmf/common.sh@295 -- # e810=() 00:16:14.614 12:43:47 -- nvmf/common.sh@295 -- # local -ga e810 00:16:14.614 12:43:47 -- nvmf/common.sh@296 -- # x722=() 00:16:14.614 12:43:47 -- nvmf/common.sh@296 -- # local -ga x722 00:16:14.614 12:43:47 -- nvmf/common.sh@297 -- # mlx=() 00:16:14.614 12:43:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:14.614 12:43:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:14.614 12:43:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:14.614 12:43:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:14.614 12:43:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:14.614 12:43:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:14.614 12:43:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:14.614 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:14.614 12:43:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:14.614 12:43:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:14.614 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:14.614 12:43:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:14.614 12:43:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:14.614 12:43:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:14.614 12:43:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:14.614 12:43:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:14.614 12:43:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:14.614 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:14.614 12:43:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:14.614 12:43:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:14.614 12:43:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:14.614 12:43:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:14.614 12:43:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:14.614 12:43:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:14.614 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:14.614 12:43:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:14.614 12:43:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:14.614 12:43:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:14.614 12:43:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:14.614 12:43:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:14.614 12:43:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:14.614 12:43:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:14.614 12:43:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:14.614 12:43:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:14.614 12:43:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:14.614 12:43:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:14.614 12:43:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:14.614 12:43:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:14.614 12:43:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:14.614 12:43:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:14.614 12:43:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:14.614 12:43:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:14.614 12:43:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:14.614 12:43:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:14.614 12:43:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:14.614 12:43:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:14.614 12:43:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:14.614 12:43:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:14.614 12:43:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:14.614 12:43:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:14.614 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:14.614 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:16:14.614 00:16:14.614 --- 10.0.0.2 ping statistics --- 00:16:14.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:14.614 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:16:14.614 12:43:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:14.614 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:14.615 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:16:14.615 00:16:14.615 --- 10.0.0.1 ping statistics --- 00:16:14.615 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:14.615 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:16:14.615 12:43:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:14.615 12:43:47 -- nvmf/common.sh@410 -- # return 0 00:16:14.615 12:43:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:14.615 12:43:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:14.615 12:43:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:14.615 12:43:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:14.615 12:43:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:14.615 12:43:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:14.615 12:43:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:14.615 12:43:47 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:14.615 12:43:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:14.615 12:43:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:14.615 12:43:47 -- common/autotest_common.sh@10 -- # set +x 00:16:14.615 12:43:47 -- nvmf/common.sh@469 -- # nvmfpid=3532109 00:16:14.615 12:43:47 -- nvmf/common.sh@470 -- # waitforlisten 3532109 00:16:14.615 12:43:47 -- common/autotest_common.sh@829 -- # '[' -z 3532109 ']' 00:16:14.615 12:43:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:14.615 12:43:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:14.615 12:43:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:14.615 12:43:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:14.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:14.615 12:43:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:14.615 12:43:47 -- common/autotest_common.sh@10 -- # set +x 00:16:14.615 [2024-11-20 12:43:47.633614] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:14.615 [2024-11-20 12:43:47.633693] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:14.615 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.615 [2024-11-20 12:43:47.702291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:14.873 [2024-11-20 12:43:47.821614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:14.873 [2024-11-20 12:43:47.821779] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:14.873 [2024-11-20 12:43:47.821798] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:14.873 [2024-11-20 12:43:47.821812] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:14.873 [2024-11-20 12:43:47.821904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:14.873 [2024-11-20 12:43:47.822157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:14.873 [2024-11-20 12:43:47.822179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:14.873 [2024-11-20 12:43:47.822183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:15.807 12:43:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:15.807 12:43:48 -- common/autotest_common.sh@862 -- # return 0 00:16:15.807 12:43:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:15.807 12:43:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:15.807 12:43:48 -- common/autotest_common.sh@10 -- # set +x 00:16:15.807 12:43:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:15.807 12:43:48 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:15.807 12:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.808 12:43:48 -- common/autotest_common.sh@10 -- # set +x 00:16:15.808 [2024-11-20 12:43:48.618582] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:15.808 12:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.808 12:43:48 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:15.808 12:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.808 12:43:48 -- common/autotest_common.sh@10 -- # set +x 00:16:15.808 Malloc0 00:16:15.808 12:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.808 12:43:48 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:15.808 12:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.808 12:43:48 -- common/autotest_common.sh@10 -- # set +x 00:16:15.808 12:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.808 12:43:48 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:15.808 12:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.808 12:43:48 -- common/autotest_common.sh@10 -- # set +x 00:16:15.808 12:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.808 12:43:48 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:15.808 12:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.808 12:43:48 -- common/autotest_common.sh@10 -- # set +x 00:16:15.808 [2024-11-20 12:43:48.669976] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:15.808 12:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.808 12:43:48 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:15.808 12:43:48 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:15.808 12:43:48 -- nvmf/common.sh@520 -- # config=() 00:16:15.808 12:43:48 -- nvmf/common.sh@520 -- # local subsystem config 00:16:15.808 12:43:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:15.808 12:43:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:15.808 { 00:16:15.808 "params": { 00:16:15.808 "name": "Nvme$subsystem", 00:16:15.808 "trtype": "$TEST_TRANSPORT", 00:16:15.808 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:15.808 "adrfam": "ipv4", 00:16:15.808 "trsvcid": "$NVMF_PORT", 00:16:15.808 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:15.808 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:15.808 "hdgst": ${hdgst:-false}, 00:16:15.808 "ddgst": ${ddgst:-false} 00:16:15.808 }, 00:16:15.808 "method": "bdev_nvme_attach_controller" 00:16:15.808 } 00:16:15.808 EOF 00:16:15.808 )") 00:16:15.808 12:43:48 -- nvmf/common.sh@542 -- # cat 00:16:15.808 12:43:48 -- nvmf/common.sh@544 -- # jq . 00:16:15.808 12:43:48 -- nvmf/common.sh@545 -- # IFS=, 00:16:15.808 12:43:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:15.808 "params": { 00:16:15.808 "name": "Nvme1", 00:16:15.808 "trtype": "tcp", 00:16:15.808 "traddr": "10.0.0.2", 00:16:15.808 "adrfam": "ipv4", 00:16:15.808 "trsvcid": "4420", 00:16:15.808 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:15.808 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:15.808 "hdgst": false, 00:16:15.808 "ddgst": false 00:16:15.808 }, 00:16:15.808 "method": "bdev_nvme_attach_controller" 00:16:15.808 }' 00:16:15.808 [2024-11-20 12:43:48.708548] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:15.808 [2024-11-20 12:43:48.708619] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3532269 ] 00:16:15.808 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.808 [2024-11-20 12:43:48.769077] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:15.808 [2024-11-20 12:43:48.880306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:15.808 [2024-11-20 12:43:48.880358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:15.808 [2024-11-20 12:43:48.880361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:16.373 [2024-11-20 12:43:49.262056] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:16.373 [2024-11-20 12:43:49.262112] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:16.373 I/O targets: 00:16:16.373 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:16.373 00:16:16.373 00:16:16.373 CUnit - A unit testing framework for C - Version 2.1-3 00:16:16.373 http://cunit.sourceforge.net/ 00:16:16.373 00:16:16.373 00:16:16.373 Suite: bdevio tests on: Nvme1n1 00:16:16.373 Test: blockdev write read block ...passed 00:16:16.373 Test: blockdev write zeroes read block ...passed 00:16:16.373 Test: blockdev write zeroes read no split ...passed 00:16:16.373 Test: blockdev write zeroes read split ...passed 00:16:16.373 Test: blockdev write zeroes read split partial ...passed 00:16:16.373 Test: blockdev reset ...[2024-11-20 12:43:49.461916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:16.373 [2024-11-20 12:43:49.462021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fc0f20 (9): Bad file descriptor 00:16:16.631 [2024-11-20 12:43:49.482433] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:16.631 passed 00:16:16.631 Test: blockdev write read 8 blocks ...passed 00:16:16.631 Test: blockdev write read size > 128k ...passed 00:16:16.631 Test: blockdev write read invalid size ...passed 00:16:16.631 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:16.631 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:16.631 Test: blockdev write read max offset ...passed 00:16:16.631 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:16.631 Test: blockdev writev readv 8 blocks ...passed 00:16:16.631 Test: blockdev writev readv 30 x 1block ...passed 00:16:16.631 Test: blockdev writev readv block ...passed 00:16:16.631 Test: blockdev writev readv size > 128k ...passed 00:16:16.631 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:16.631 Test: blockdev comparev and writev ...[2024-11-20 12:43:49.654243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.654280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.654304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.654321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.654636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.654661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.654682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.654699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.654989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.655013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.655034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.655050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.655364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.655388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:16.631 [2024-11-20 12:43:49.655409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:16.631 [2024-11-20 12:43:49.655425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:16.631 passed 00:16:16.889 Test: blockdev nvme passthru rw ...passed 00:16:16.889 Test: blockdev nvme passthru vendor specific ...[2024-11-20 12:43:49.738341] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:16.889 [2024-11-20 12:43:49.738370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:16.889 [2024-11-20 12:43:49.738520] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:16.889 [2024-11-20 12:43:49.738542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:16.890 [2024-11-20 12:43:49.738690] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:16.890 [2024-11-20 12:43:49.738711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:16.890 [2024-11-20 12:43:49.738854] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:16.890 [2024-11-20 12:43:49.738875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:16.890 passed 00:16:16.890 Test: blockdev nvme admin passthru ...passed 00:16:16.890 Test: blockdev copy ...passed 00:16:16.890 00:16:16.890 Run Summary: Type Total Ran Passed Failed Inactive 00:16:16.890 suites 1 1 n/a 0 0 00:16:16.890 tests 23 23 23 0 0 00:16:16.890 asserts 152 152 152 0 n/a 00:16:16.890 00:16:16.890 Elapsed time = 1.063 seconds 00:16:17.147 12:43:50 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:17.147 12:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.147 12:43:50 -- common/autotest_common.sh@10 -- # set +x 00:16:17.147 12:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.147 12:43:50 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:17.147 12:43:50 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:17.147 12:43:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:17.147 12:43:50 -- nvmf/common.sh@116 -- # sync 00:16:17.147 12:43:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:17.147 12:43:50 -- nvmf/common.sh@119 -- # set +e 00:16:17.147 12:43:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:17.148 12:43:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:17.148 rmmod nvme_tcp 00:16:17.148 rmmod nvme_fabrics 00:16:17.148 rmmod nvme_keyring 00:16:17.148 12:43:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:17.148 12:43:50 -- nvmf/common.sh@123 -- # set -e 00:16:17.148 12:43:50 -- nvmf/common.sh@124 -- # return 0 00:16:17.148 12:43:50 -- nvmf/common.sh@477 -- # '[' -n 3532109 ']' 00:16:17.148 12:43:50 -- nvmf/common.sh@478 -- # killprocess 3532109 00:16:17.148 12:43:50 -- common/autotest_common.sh@936 -- # '[' -z 3532109 ']' 00:16:17.148 12:43:50 -- common/autotest_common.sh@940 -- # kill -0 3532109 00:16:17.148 12:43:50 -- common/autotest_common.sh@941 -- # uname 00:16:17.148 12:43:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:17.148 12:43:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3532109 00:16:17.148 12:43:50 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:17.148 12:43:50 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:17.148 12:43:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3532109' 00:16:17.148 killing process with pid 3532109 00:16:17.148 12:43:50 -- common/autotest_common.sh@955 -- # kill 3532109 00:16:17.148 12:43:50 -- common/autotest_common.sh@960 -- # wait 3532109 00:16:17.406 12:43:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:17.406 12:43:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:17.406 12:43:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:17.406 12:43:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:17.406 12:43:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:17.406 12:43:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:17.406 12:43:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:17.406 12:43:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:19.945 12:43:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:19.945 00:16:19.945 real 0m7.212s 00:16:19.945 user 0m13.838s 00:16:19.945 sys 0m2.064s 00:16:19.945 12:43:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:19.945 12:43:52 -- common/autotest_common.sh@10 -- # set +x 00:16:19.945 ************************************ 00:16:19.945 END TEST nvmf_bdevio 00:16:19.945 ************************************ 00:16:19.945 12:43:52 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:19.945 12:43:52 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:19.945 12:43:52 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:19.945 12:43:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:19.945 12:43:52 -- common/autotest_common.sh@10 -- # set +x 00:16:19.945 ************************************ 00:16:19.945 START TEST nvmf_bdevio_no_huge 00:16:19.945 ************************************ 00:16:19.945 12:43:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:19.945 * Looking for test storage... 00:16:19.945 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:19.945 12:43:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:19.945 12:43:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:19.945 12:43:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:19.945 12:43:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:19.945 12:43:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:19.945 12:43:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:19.945 12:43:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:19.945 12:43:52 -- scripts/common.sh@335 -- # IFS=.-: 00:16:19.945 12:43:52 -- scripts/common.sh@335 -- # read -ra ver1 00:16:19.945 12:43:52 -- scripts/common.sh@336 -- # IFS=.-: 00:16:19.945 12:43:52 -- scripts/common.sh@336 -- # read -ra ver2 00:16:19.945 12:43:52 -- scripts/common.sh@337 -- # local 'op=<' 00:16:19.945 12:43:52 -- scripts/common.sh@339 -- # ver1_l=2 00:16:19.945 12:43:52 -- scripts/common.sh@340 -- # ver2_l=1 00:16:19.945 12:43:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:19.945 12:43:52 -- scripts/common.sh@343 -- # case "$op" in 00:16:19.945 12:43:52 -- scripts/common.sh@344 -- # : 1 00:16:19.945 12:43:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:19.945 12:43:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:19.945 12:43:52 -- scripts/common.sh@364 -- # decimal 1 00:16:19.945 12:43:52 -- scripts/common.sh@352 -- # local d=1 00:16:19.945 12:43:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:19.945 12:43:52 -- scripts/common.sh@354 -- # echo 1 00:16:19.945 12:43:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:19.945 12:43:52 -- scripts/common.sh@365 -- # decimal 2 00:16:19.945 12:43:52 -- scripts/common.sh@352 -- # local d=2 00:16:19.945 12:43:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:19.945 12:43:52 -- scripts/common.sh@354 -- # echo 2 00:16:19.945 12:43:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:19.945 12:43:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:19.945 12:43:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:19.945 12:43:52 -- scripts/common.sh@367 -- # return 0 00:16:19.945 12:43:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:19.945 12:43:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:19.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:19.945 --rc genhtml_branch_coverage=1 00:16:19.945 --rc genhtml_function_coverage=1 00:16:19.945 --rc genhtml_legend=1 00:16:19.945 --rc geninfo_all_blocks=1 00:16:19.945 --rc geninfo_unexecuted_blocks=1 00:16:19.945 00:16:19.945 ' 00:16:19.945 12:43:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:19.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:19.945 --rc genhtml_branch_coverage=1 00:16:19.945 --rc genhtml_function_coverage=1 00:16:19.945 --rc genhtml_legend=1 00:16:19.945 --rc geninfo_all_blocks=1 00:16:19.945 --rc geninfo_unexecuted_blocks=1 00:16:19.945 00:16:19.945 ' 00:16:19.945 12:43:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:19.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:19.945 --rc genhtml_branch_coverage=1 00:16:19.945 --rc genhtml_function_coverage=1 00:16:19.945 --rc genhtml_legend=1 00:16:19.945 --rc geninfo_all_blocks=1 00:16:19.945 --rc geninfo_unexecuted_blocks=1 00:16:19.945 00:16:19.945 ' 00:16:19.945 12:43:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:19.945 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:19.945 --rc genhtml_branch_coverage=1 00:16:19.945 --rc genhtml_function_coverage=1 00:16:19.945 --rc genhtml_legend=1 00:16:19.945 --rc geninfo_all_blocks=1 00:16:19.945 --rc geninfo_unexecuted_blocks=1 00:16:19.945 00:16:19.945 ' 00:16:19.945 12:43:52 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:19.945 12:43:52 -- nvmf/common.sh@7 -- # uname -s 00:16:19.945 12:43:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:19.945 12:43:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:19.945 12:43:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:19.945 12:43:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:19.945 12:43:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:19.945 12:43:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:19.945 12:43:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:19.945 12:43:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:19.945 12:43:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:19.945 12:43:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:19.945 12:43:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:19.945 12:43:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:19.945 12:43:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:19.945 12:43:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:19.945 12:43:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:19.945 12:43:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:19.945 12:43:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:19.945 12:43:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:19.945 12:43:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:19.945 12:43:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:19.946 12:43:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:19.946 12:43:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:19.946 12:43:52 -- paths/export.sh@5 -- # export PATH 00:16:19.946 12:43:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:19.946 12:43:52 -- nvmf/common.sh@46 -- # : 0 00:16:19.946 12:43:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:19.946 12:43:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:19.946 12:43:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:19.946 12:43:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:19.946 12:43:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:19.946 12:43:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:19.946 12:43:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:19.946 12:43:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:19.946 12:43:52 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:19.946 12:43:52 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:19.946 12:43:52 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:19.946 12:43:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:19.946 12:43:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:19.946 12:43:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:19.946 12:43:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:19.946 12:43:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:19.946 12:43:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:19.946 12:43:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:19.946 12:43:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:19.946 12:43:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:19.946 12:43:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:19.946 12:43:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:19.946 12:43:52 -- common/autotest_common.sh@10 -- # set +x 00:16:21.849 12:43:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:21.849 12:43:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:21.849 12:43:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:21.849 12:43:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:21.849 12:43:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:21.849 12:43:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:21.849 12:43:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:21.849 12:43:54 -- nvmf/common.sh@294 -- # net_devs=() 00:16:21.849 12:43:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:21.849 12:43:54 -- nvmf/common.sh@295 -- # e810=() 00:16:21.849 12:43:54 -- nvmf/common.sh@295 -- # local -ga e810 00:16:21.849 12:43:54 -- nvmf/common.sh@296 -- # x722=() 00:16:21.849 12:43:54 -- nvmf/common.sh@296 -- # local -ga x722 00:16:21.849 12:43:54 -- nvmf/common.sh@297 -- # mlx=() 00:16:21.849 12:43:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:21.849 12:43:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:21.849 12:43:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:21.849 12:43:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:21.849 12:43:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:21.849 12:43:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:21.849 12:43:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:21.849 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:21.849 12:43:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:21.849 12:43:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:21.849 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:21.849 12:43:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:21.849 12:43:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:21.849 12:43:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:21.849 12:43:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:21.849 12:43:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:21.849 12:43:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:21.849 12:43:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:21.849 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:21.849 12:43:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:21.849 12:43:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:21.849 12:43:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:21.849 12:43:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:21.850 12:43:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:21.850 12:43:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:21.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:21.850 12:43:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:21.850 12:43:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:21.850 12:43:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:21.850 12:43:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:21.850 12:43:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:21.850 12:43:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:21.850 12:43:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:21.850 12:43:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:21.850 12:43:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:21.850 12:43:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:21.850 12:43:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:21.850 12:43:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:21.850 12:43:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:21.850 12:43:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:21.850 12:43:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:21.850 12:43:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:21.850 12:43:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:21.850 12:43:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:21.850 12:43:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:21.850 12:43:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:21.850 12:43:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:21.850 12:43:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:21.850 12:43:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:21.850 12:43:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:21.850 12:43:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:21.850 12:43:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:21.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:21.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:16:21.850 00:16:21.850 --- 10.0.0.2 ping statistics --- 00:16:21.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:21.850 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:16:21.850 12:43:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:21.850 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:21.850 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:16:21.850 00:16:21.850 --- 10.0.0.1 ping statistics --- 00:16:21.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:21.850 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:16:21.850 12:43:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:21.850 12:43:54 -- nvmf/common.sh@410 -- # return 0 00:16:21.850 12:43:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:21.850 12:43:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:21.850 12:43:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:21.850 12:43:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:21.850 12:43:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:21.850 12:43:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:21.850 12:43:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:21.850 12:43:54 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:21.850 12:43:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:21.850 12:43:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:21.850 12:43:54 -- common/autotest_common.sh@10 -- # set +x 00:16:21.850 12:43:54 -- nvmf/common.sh@469 -- # nvmfpid=3534436 00:16:21.850 12:43:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:21.850 12:43:54 -- nvmf/common.sh@470 -- # waitforlisten 3534436 00:16:21.850 12:43:54 -- common/autotest_common.sh@829 -- # '[' -z 3534436 ']' 00:16:21.850 12:43:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:21.850 12:43:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:21.850 12:43:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:21.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:21.850 12:43:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:21.850 12:43:54 -- common/autotest_common.sh@10 -- # set +x 00:16:21.850 [2024-11-20 12:43:54.916081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:21.850 [2024-11-20 12:43:54.916172] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:22.109 [2024-11-20 12:43:54.989020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:22.109 [2024-11-20 12:43:55.113505] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:22.109 [2024-11-20 12:43:55.113682] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:22.109 [2024-11-20 12:43:55.113702] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:22.109 [2024-11-20 12:43:55.113717] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:22.109 [2024-11-20 12:43:55.113811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:22.109 [2024-11-20 12:43:55.113841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:22.109 [2024-11-20 12:43:55.113867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:22.109 [2024-11-20 12:43:55.113870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:23.044 12:43:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:23.044 12:43:55 -- common/autotest_common.sh@862 -- # return 0 00:16:23.044 12:43:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:23.044 12:43:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:23.044 12:43:55 -- common/autotest_common.sh@10 -- # set +x 00:16:23.044 12:43:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:23.044 12:43:55 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:23.044 12:43:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.044 12:43:55 -- common/autotest_common.sh@10 -- # set +x 00:16:23.044 [2024-11-20 12:43:55.990035] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:23.044 12:43:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.044 12:43:55 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:23.044 12:43:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.044 12:43:55 -- common/autotest_common.sh@10 -- # set +x 00:16:23.044 Malloc0 00:16:23.044 12:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.044 12:43:56 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:23.044 12:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.044 12:43:56 -- common/autotest_common.sh@10 -- # set +x 00:16:23.044 12:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.044 12:43:56 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:23.044 12:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.044 12:43:56 -- common/autotest_common.sh@10 -- # set +x 00:16:23.044 12:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.044 12:43:56 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:23.044 12:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.044 12:43:56 -- common/autotest_common.sh@10 -- # set +x 00:16:23.044 [2024-11-20 12:43:56.028439] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:23.044 12:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.044 12:43:56 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:23.044 12:43:56 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:23.044 12:43:56 -- nvmf/common.sh@520 -- # config=() 00:16:23.044 12:43:56 -- nvmf/common.sh@520 -- # local subsystem config 00:16:23.044 12:43:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:23.044 12:43:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:23.044 { 00:16:23.044 "params": { 00:16:23.044 "name": "Nvme$subsystem", 00:16:23.044 "trtype": "$TEST_TRANSPORT", 00:16:23.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:23.044 "adrfam": "ipv4", 00:16:23.044 "trsvcid": "$NVMF_PORT", 00:16:23.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:23.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:23.044 "hdgst": ${hdgst:-false}, 00:16:23.044 "ddgst": ${ddgst:-false} 00:16:23.044 }, 00:16:23.044 "method": "bdev_nvme_attach_controller" 00:16:23.044 } 00:16:23.044 EOF 00:16:23.044 )") 00:16:23.044 12:43:56 -- nvmf/common.sh@542 -- # cat 00:16:23.044 12:43:56 -- nvmf/common.sh@544 -- # jq . 00:16:23.044 12:43:56 -- nvmf/common.sh@545 -- # IFS=, 00:16:23.044 12:43:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:23.044 "params": { 00:16:23.044 "name": "Nvme1", 00:16:23.044 "trtype": "tcp", 00:16:23.044 "traddr": "10.0.0.2", 00:16:23.044 "adrfam": "ipv4", 00:16:23.044 "trsvcid": "4420", 00:16:23.044 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:23.044 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:23.044 "hdgst": false, 00:16:23.044 "ddgst": false 00:16:23.044 }, 00:16:23.044 "method": "bdev_nvme_attach_controller" 00:16:23.044 }' 00:16:23.044 [2024-11-20 12:43:56.067246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:23.044 [2024-11-20 12:43:56.067326] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3534644 ] 00:16:23.044 [2024-11-20 12:43:56.129705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:23.303 [2024-11-20 12:43:56.241568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:23.303 [2024-11-20 12:43:56.241617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:23.303 [2024-11-20 12:43:56.241620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:23.560 [2024-11-20 12:43:56.513721] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:23.560 [2024-11-20 12:43:56.513772] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:23.560 I/O targets: 00:16:23.560 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:23.560 00:16:23.560 00:16:23.560 CUnit - A unit testing framework for C - Version 2.1-3 00:16:23.560 http://cunit.sourceforge.net/ 00:16:23.560 00:16:23.560 00:16:23.560 Suite: bdevio tests on: Nvme1n1 00:16:23.560 Test: blockdev write read block ...passed 00:16:23.560 Test: blockdev write zeroes read block ...passed 00:16:23.560 Test: blockdev write zeroes read no split ...passed 00:16:23.560 Test: blockdev write zeroes read split ...passed 00:16:23.818 Test: blockdev write zeroes read split partial ...passed 00:16:23.818 Test: blockdev reset ...[2024-11-20 12:43:56.675524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:23.818 [2024-11-20 12:43:56.675628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22e87d0 (9): Bad file descriptor 00:16:23.818 [2024-11-20 12:43:56.812906] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:23.818 passed 00:16:23.818 Test: blockdev write read 8 blocks ...passed 00:16:23.818 Test: blockdev write read size > 128k ...passed 00:16:23.818 Test: blockdev write read invalid size ...passed 00:16:23.818 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:23.818 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:23.818 Test: blockdev write read max offset ...passed 00:16:24.077 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:24.077 Test: blockdev writev readv 8 blocks ...passed 00:16:24.077 Test: blockdev writev readv 30 x 1block ...passed 00:16:24.077 Test: blockdev writev readv block ...passed 00:16:24.077 Test: blockdev writev readv size > 128k ...passed 00:16:24.077 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:24.077 Test: blockdev comparev and writev ...[2024-11-20 12:43:56.985530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.985568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.985593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.985611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.985965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.985990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.986012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.986029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.986385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.986410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.986432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.986448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.986803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.986827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:56.986848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:24.077 [2024-11-20 12:43:56.986864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:24.077 passed 00:16:24.077 Test: blockdev nvme passthru rw ...passed 00:16:24.077 Test: blockdev nvme passthru vendor specific ...[2024-11-20 12:43:57.070364] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:24.077 [2024-11-20 12:43:57.070392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:57.070552] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:24.077 [2024-11-20 12:43:57.070574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:57.070742] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:24.077 [2024-11-20 12:43:57.070763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:24.077 [2024-11-20 12:43:57.070917] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:24.077 [2024-11-20 12:43:57.070940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:24.077 passed 00:16:24.077 Test: blockdev nvme admin passthru ...passed 00:16:24.077 Test: blockdev copy ...passed 00:16:24.077 00:16:24.077 Run Summary: Type Total Ran Passed Failed Inactive 00:16:24.077 suites 1 1 n/a 0 0 00:16:24.077 tests 23 23 23 0 0 00:16:24.077 asserts 152 152 152 0 n/a 00:16:24.077 00:16:24.077 Elapsed time = 1.227 seconds 00:16:24.644 12:43:57 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:24.644 12:43:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.644 12:43:57 -- common/autotest_common.sh@10 -- # set +x 00:16:24.644 12:43:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.644 12:43:57 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:24.644 12:43:57 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:24.644 12:43:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:24.644 12:43:57 -- nvmf/common.sh@116 -- # sync 00:16:24.644 12:43:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:24.644 12:43:57 -- nvmf/common.sh@119 -- # set +e 00:16:24.644 12:43:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:24.644 12:43:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:24.644 rmmod nvme_tcp 00:16:24.644 rmmod nvme_fabrics 00:16:24.644 rmmod nvme_keyring 00:16:24.644 12:43:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:24.644 12:43:57 -- nvmf/common.sh@123 -- # set -e 00:16:24.644 12:43:57 -- nvmf/common.sh@124 -- # return 0 00:16:24.644 12:43:57 -- nvmf/common.sh@477 -- # '[' -n 3534436 ']' 00:16:24.644 12:43:57 -- nvmf/common.sh@478 -- # killprocess 3534436 00:16:24.644 12:43:57 -- common/autotest_common.sh@936 -- # '[' -z 3534436 ']' 00:16:24.644 12:43:57 -- common/autotest_common.sh@940 -- # kill -0 3534436 00:16:24.644 12:43:57 -- common/autotest_common.sh@941 -- # uname 00:16:24.644 12:43:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:24.644 12:43:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3534436 00:16:24.644 12:43:57 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:24.644 12:43:57 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:24.644 12:43:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3534436' 00:16:24.645 killing process with pid 3534436 00:16:24.645 12:43:57 -- common/autotest_common.sh@955 -- # kill 3534436 00:16:24.645 12:43:57 -- common/autotest_common.sh@960 -- # wait 3534436 00:16:25.212 12:43:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:25.212 12:43:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:25.212 12:43:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:25.212 12:43:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:25.212 12:43:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:25.212 12:43:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.212 12:43:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.212 12:43:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:27.189 12:44:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:27.189 00:16:27.189 real 0m7.605s 00:16:27.189 user 0m14.850s 00:16:27.189 sys 0m2.579s 00:16:27.189 12:44:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:27.189 12:44:00 -- common/autotest_common.sh@10 -- # set +x 00:16:27.189 ************************************ 00:16:27.189 END TEST nvmf_bdevio_no_huge 00:16:27.190 ************************************ 00:16:27.190 12:44:00 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:27.190 12:44:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:27.190 12:44:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:27.190 12:44:00 -- common/autotest_common.sh@10 -- # set +x 00:16:27.190 ************************************ 00:16:27.190 START TEST nvmf_tls 00:16:27.190 ************************************ 00:16:27.190 12:44:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:27.190 * Looking for test storage... 00:16:27.190 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:27.190 12:44:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:27.190 12:44:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:27.190 12:44:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:27.498 12:44:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:27.498 12:44:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:27.498 12:44:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:27.498 12:44:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:27.498 12:44:00 -- scripts/common.sh@335 -- # IFS=.-: 00:16:27.498 12:44:00 -- scripts/common.sh@335 -- # read -ra ver1 00:16:27.498 12:44:00 -- scripts/common.sh@336 -- # IFS=.-: 00:16:27.498 12:44:00 -- scripts/common.sh@336 -- # read -ra ver2 00:16:27.498 12:44:00 -- scripts/common.sh@337 -- # local 'op=<' 00:16:27.498 12:44:00 -- scripts/common.sh@339 -- # ver1_l=2 00:16:27.498 12:44:00 -- scripts/common.sh@340 -- # ver2_l=1 00:16:27.498 12:44:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:27.498 12:44:00 -- scripts/common.sh@343 -- # case "$op" in 00:16:27.498 12:44:00 -- scripts/common.sh@344 -- # : 1 00:16:27.498 12:44:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:27.498 12:44:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:27.498 12:44:00 -- scripts/common.sh@364 -- # decimal 1 00:16:27.498 12:44:00 -- scripts/common.sh@352 -- # local d=1 00:16:27.498 12:44:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:27.498 12:44:00 -- scripts/common.sh@354 -- # echo 1 00:16:27.498 12:44:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:27.498 12:44:00 -- scripts/common.sh@365 -- # decimal 2 00:16:27.498 12:44:00 -- scripts/common.sh@352 -- # local d=2 00:16:27.498 12:44:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:27.498 12:44:00 -- scripts/common.sh@354 -- # echo 2 00:16:27.498 12:44:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:27.498 12:44:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:27.498 12:44:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:27.498 12:44:00 -- scripts/common.sh@367 -- # return 0 00:16:27.498 12:44:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:27.498 12:44:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:27.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.498 --rc genhtml_branch_coverage=1 00:16:27.498 --rc genhtml_function_coverage=1 00:16:27.498 --rc genhtml_legend=1 00:16:27.498 --rc geninfo_all_blocks=1 00:16:27.498 --rc geninfo_unexecuted_blocks=1 00:16:27.498 00:16:27.498 ' 00:16:27.498 12:44:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:27.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.498 --rc genhtml_branch_coverage=1 00:16:27.498 --rc genhtml_function_coverage=1 00:16:27.498 --rc genhtml_legend=1 00:16:27.498 --rc geninfo_all_blocks=1 00:16:27.498 --rc geninfo_unexecuted_blocks=1 00:16:27.498 00:16:27.498 ' 00:16:27.498 12:44:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:27.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.498 --rc genhtml_branch_coverage=1 00:16:27.498 --rc genhtml_function_coverage=1 00:16:27.498 --rc genhtml_legend=1 00:16:27.498 --rc geninfo_all_blocks=1 00:16:27.498 --rc geninfo_unexecuted_blocks=1 00:16:27.498 00:16:27.498 ' 00:16:27.498 12:44:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:27.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.498 --rc genhtml_branch_coverage=1 00:16:27.498 --rc genhtml_function_coverage=1 00:16:27.498 --rc genhtml_legend=1 00:16:27.498 --rc geninfo_all_blocks=1 00:16:27.498 --rc geninfo_unexecuted_blocks=1 00:16:27.498 00:16:27.498 ' 00:16:27.498 12:44:00 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:27.498 12:44:00 -- nvmf/common.sh@7 -- # uname -s 00:16:27.498 12:44:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:27.498 12:44:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:27.498 12:44:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:27.498 12:44:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:27.498 12:44:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:27.498 12:44:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:27.498 12:44:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:27.498 12:44:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:27.498 12:44:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:27.498 12:44:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:27.498 12:44:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:27.498 12:44:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:27.498 12:44:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:27.499 12:44:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:27.499 12:44:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:27.499 12:44:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:27.499 12:44:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:27.499 12:44:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:27.499 12:44:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:27.499 12:44:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.499 12:44:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.499 12:44:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.499 12:44:00 -- paths/export.sh@5 -- # export PATH 00:16:27.499 12:44:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.499 12:44:00 -- nvmf/common.sh@46 -- # : 0 00:16:27.499 12:44:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:27.499 12:44:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:27.499 12:44:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:27.499 12:44:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:27.499 12:44:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:27.499 12:44:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:27.499 12:44:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:27.499 12:44:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:27.499 12:44:00 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:27.499 12:44:00 -- target/tls.sh@71 -- # nvmftestinit 00:16:27.499 12:44:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:27.499 12:44:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:27.499 12:44:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:27.499 12:44:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:27.499 12:44:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:27.499 12:44:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:27.499 12:44:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:27.499 12:44:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:27.499 12:44:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:27.499 12:44:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:27.499 12:44:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:27.499 12:44:00 -- common/autotest_common.sh@10 -- # set +x 00:16:29.403 12:44:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:29.403 12:44:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:29.403 12:44:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:29.403 12:44:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:29.403 12:44:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:29.403 12:44:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:29.403 12:44:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:29.403 12:44:02 -- nvmf/common.sh@294 -- # net_devs=() 00:16:29.403 12:44:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:29.403 12:44:02 -- nvmf/common.sh@295 -- # e810=() 00:16:29.403 12:44:02 -- nvmf/common.sh@295 -- # local -ga e810 00:16:29.403 12:44:02 -- nvmf/common.sh@296 -- # x722=() 00:16:29.403 12:44:02 -- nvmf/common.sh@296 -- # local -ga x722 00:16:29.403 12:44:02 -- nvmf/common.sh@297 -- # mlx=() 00:16:29.403 12:44:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:29.403 12:44:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:29.403 12:44:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:29.403 12:44:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:29.403 12:44:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:29.403 12:44:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.403 12:44:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:29.403 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:29.403 12:44:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.403 12:44:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:29.403 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:29.403 12:44:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:29.403 12:44:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:29.403 12:44:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.403 12:44:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.403 12:44:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.403 12:44:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.404 12:44:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:29.404 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:29.404 12:44:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.404 12:44:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.404 12:44:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.404 12:44:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.404 12:44:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.404 12:44:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:29.404 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:29.404 12:44:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.404 12:44:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:29.404 12:44:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:29.404 12:44:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:29.404 12:44:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:29.404 12:44:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:29.404 12:44:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:29.404 12:44:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:29.404 12:44:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:29.404 12:44:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:29.404 12:44:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:29.404 12:44:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:29.404 12:44:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:29.404 12:44:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:29.404 12:44:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:29.404 12:44:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:29.404 12:44:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:29.404 12:44:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:29.404 12:44:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:29.404 12:44:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:29.404 12:44:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:29.404 12:44:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:29.404 12:44:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:29.404 12:44:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:29.404 12:44:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:29.404 12:44:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:29.404 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:29.404 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:16:29.404 00:16:29.404 --- 10.0.0.2 ping statistics --- 00:16:29.404 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.404 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:16:29.404 12:44:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:29.404 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:29.404 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:16:29.404 00:16:29.404 --- 10.0.0.1 ping statistics --- 00:16:29.404 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.404 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:16:29.404 12:44:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:29.404 12:44:02 -- nvmf/common.sh@410 -- # return 0 00:16:29.404 12:44:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:29.404 12:44:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:29.404 12:44:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:29.404 12:44:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:29.404 12:44:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:29.404 12:44:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:29.404 12:44:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:29.663 12:44:02 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:29.663 12:44:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:29.663 12:44:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:29.663 12:44:02 -- common/autotest_common.sh@10 -- # set +x 00:16:29.663 12:44:02 -- nvmf/common.sh@469 -- # nvmfpid=3536743 00:16:29.663 12:44:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:29.663 12:44:02 -- nvmf/common.sh@470 -- # waitforlisten 3536743 00:16:29.663 12:44:02 -- common/autotest_common.sh@829 -- # '[' -z 3536743 ']' 00:16:29.663 12:44:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.663 12:44:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:29.663 12:44:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.663 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.663 12:44:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:29.663 12:44:02 -- common/autotest_common.sh@10 -- # set +x 00:16:29.663 [2024-11-20 12:44:02.561252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:29.663 [2024-11-20 12:44:02.561338] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.663 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.663 [2024-11-20 12:44:02.632026] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:29.663 [2024-11-20 12:44:02.749883] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.663 [2024-11-20 12:44:02.750048] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.663 [2024-11-20 12:44:02.750078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.663 [2024-11-20 12:44:02.750096] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.663 [2024-11-20 12:44:02.750154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:29.921 12:44:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:29.921 12:44:02 -- common/autotest_common.sh@862 -- # return 0 00:16:29.921 12:44:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:29.921 12:44:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:29.921 12:44:02 -- common/autotest_common.sh@10 -- # set +x 00:16:29.921 12:44:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:29.921 12:44:02 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:29.921 12:44:02 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:30.179 true 00:16:30.179 12:44:03 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:30.179 12:44:03 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:30.437 12:44:03 -- target/tls.sh@82 -- # version=0 00:16:30.437 12:44:03 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:30.437 12:44:03 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:30.695 12:44:03 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:30.696 12:44:03 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:30.953 12:44:03 -- target/tls.sh@90 -- # version=13 00:16:30.953 12:44:03 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:30.954 12:44:03 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:31.211 12:44:04 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:31.211 12:44:04 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:31.211 12:44:04 -- target/tls.sh@98 -- # version=7 00:16:31.211 12:44:04 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:31.469 12:44:04 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:31.469 12:44:04 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:31.469 12:44:04 -- target/tls.sh@105 -- # ktls=false 00:16:31.469 12:44:04 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:31.469 12:44:04 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:31.727 12:44:04 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:31.727 12:44:04 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:31.985 12:44:05 -- target/tls.sh@113 -- # ktls=true 00:16:31.985 12:44:05 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:31.985 12:44:05 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:32.243 12:44:05 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:32.243 12:44:05 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:32.501 12:44:05 -- target/tls.sh@121 -- # ktls=false 00:16:32.501 12:44:05 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:32.501 12:44:05 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:32.501 12:44:05 -- target/tls.sh@49 -- # local key hash crc 00:16:32.501 12:44:05 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:32.501 12:44:05 -- target/tls.sh@51 -- # hash=01 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # gzip -1 -c 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # tail -c8 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # head -c 4 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # crc='p$H�' 00:16:32.501 12:44:05 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:32.501 12:44:05 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:32.501 12:44:05 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:32.501 12:44:05 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:32.501 12:44:05 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:32.501 12:44:05 -- target/tls.sh@49 -- # local key hash crc 00:16:32.501 12:44:05 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:32.501 12:44:05 -- target/tls.sh@51 -- # hash=01 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # gzip -1 -c 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # tail -c8 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # head -c 4 00:16:32.501 12:44:05 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:32.501 12:44:05 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:32.501 12:44:05 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:32.501 12:44:05 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:32.501 12:44:05 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:32.501 12:44:05 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:32.501 12:44:05 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:32.501 12:44:05 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:32.501 12:44:05 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:32.501 12:44:05 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:32.759 12:44:05 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:32.759 12:44:05 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:32.759 12:44:05 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:33.325 12:44:06 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:33.325 12:44:06 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:33.325 12:44:06 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:33.325 [2024-11-20 12:44:06.423777] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:33.582 12:44:06 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:33.840 12:44:06 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:34.098 [2024-11-20 12:44:06.961257] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:34.098 [2024-11-20 12:44:06.961534] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:34.098 12:44:06 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:34.356 malloc0 00:16:34.356 12:44:07 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:34.613 12:44:07 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:34.871 12:44:07 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:34.871 EAL: No free 2048 kB hugepages reported on node 1 00:16:47.069 Initializing NVMe Controllers 00:16:47.069 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:47.069 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:47.069 Initialization complete. Launching workers. 00:16:47.069 ======================================================== 00:16:47.069 Latency(us) 00:16:47.069 Device Information : IOPS MiB/s Average min max 00:16:47.069 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7749.46 30.27 8261.22 1381.90 9261.77 00:16:47.069 ======================================================== 00:16:47.069 Total : 7749.46 30.27 8261.22 1381.90 9261.77 00:16:47.069 00:16:47.069 12:44:18 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:47.069 12:44:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:47.069 12:44:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:47.069 12:44:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:47.069 12:44:18 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:16:47.069 12:44:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:47.069 12:44:18 -- target/tls.sh@28 -- # bdevperf_pid=3538705 00:16:47.069 12:44:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:47.069 12:44:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:47.069 12:44:18 -- target/tls.sh@31 -- # waitforlisten 3538705 /var/tmp/bdevperf.sock 00:16:47.069 12:44:18 -- common/autotest_common.sh@829 -- # '[' -z 3538705 ']' 00:16:47.069 12:44:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:47.069 12:44:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:47.069 12:44:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:47.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:47.069 12:44:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:47.069 12:44:18 -- common/autotest_common.sh@10 -- # set +x 00:16:47.069 [2024-11-20 12:44:18.042490] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:47.069 [2024-11-20 12:44:18.042578] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3538705 ] 00:16:47.069 EAL: No free 2048 kB hugepages reported on node 1 00:16:47.069 [2024-11-20 12:44:18.099545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:47.069 [2024-11-20 12:44:18.202343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:47.069 12:44:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:47.069 12:44:19 -- common/autotest_common.sh@862 -- # return 0 00:16:47.069 12:44:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:47.069 [2024-11-20 12:44:19.293884] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:47.069 TLSTESTn1 00:16:47.069 12:44:19 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:47.069 Running I/O for 10 seconds... 00:16:57.036 00:16:57.036 Latency(us) 00:16:57.036 [2024-11-20T11:44:30.144Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:57.036 [2024-11-20T11:44:30.144Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:57.036 Verification LBA range: start 0x0 length 0x2000 00:16:57.036 TLSTESTn1 : 10.02 4572.41 17.86 0.00 0.00 27944.41 4514.70 42525.58 00:16:57.036 [2024-11-20T11:44:30.144Z] =================================================================================================================== 00:16:57.036 [2024-11-20T11:44:30.144Z] Total : 4572.41 17.86 0.00 0.00 27944.41 4514.70 42525.58 00:16:57.036 0 00:16:57.036 12:44:29 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:57.036 12:44:29 -- target/tls.sh@45 -- # killprocess 3538705 00:16:57.036 12:44:29 -- common/autotest_common.sh@936 -- # '[' -z 3538705 ']' 00:16:57.036 12:44:29 -- common/autotest_common.sh@940 -- # kill -0 3538705 00:16:57.036 12:44:29 -- common/autotest_common.sh@941 -- # uname 00:16:57.036 12:44:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:57.036 12:44:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3538705 00:16:57.036 12:44:29 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:16:57.036 12:44:29 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:16:57.036 12:44:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3538705' 00:16:57.036 killing process with pid 3538705 00:16:57.036 12:44:29 -- common/autotest_common.sh@955 -- # kill 3538705 00:16:57.036 Received shutdown signal, test time was about 10.000000 seconds 00:16:57.036 00:16:57.036 Latency(us) 00:16:57.036 [2024-11-20T11:44:30.144Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:57.036 [2024-11-20T11:44:30.144Z] =================================================================================================================== 00:16:57.036 [2024-11-20T11:44:30.144Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:57.036 12:44:29 -- common/autotest_common.sh@960 -- # wait 3538705 00:16:57.036 12:44:29 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:57.036 12:44:29 -- common/autotest_common.sh@650 -- # local es=0 00:16:57.036 12:44:29 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:57.036 12:44:29 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:57.036 12:44:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:57.036 12:44:29 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:57.036 12:44:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:57.036 12:44:29 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:57.036 12:44:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:57.036 12:44:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:57.036 12:44:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:57.036 12:44:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:16:57.036 12:44:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:57.036 12:44:29 -- target/tls.sh@28 -- # bdevperf_pid=3540078 00:16:57.036 12:44:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:57.036 12:44:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:57.036 12:44:29 -- target/tls.sh@31 -- # waitforlisten 3540078 /var/tmp/bdevperf.sock 00:16:57.036 12:44:29 -- common/autotest_common.sh@829 -- # '[' -z 3540078 ']' 00:16:57.036 12:44:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:57.036 12:44:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:57.036 12:44:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:57.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:57.036 12:44:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:57.036 12:44:29 -- common/autotest_common.sh@10 -- # set +x 00:16:57.036 [2024-11-20 12:44:29.883341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:57.036 [2024-11-20 12:44:29.883453] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3540078 ] 00:16:57.036 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.036 [2024-11-20 12:44:29.955882] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:57.036 [2024-11-20 12:44:30.101948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:57.294 12:44:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:57.294 12:44:30 -- common/autotest_common.sh@862 -- # return 0 00:16:57.294 12:44:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:57.553 [2024-11-20 12:44:30.467853] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:57.553 [2024-11-20 12:44:30.472944] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:57.553 [2024-11-20 12:44:30.473508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c461f0 (107): Transport endpoint is not connected 00:16:57.553 [2024-11-20 12:44:30.474496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c461f0 (9): Bad file descriptor 00:16:57.553 [2024-11-20 12:44:30.475495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:57.553 [2024-11-20 12:44:30.475514] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:16:57.553 [2024-11-20 12:44:30.475528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:57.553 request: 00:16:57.553 { 00:16:57.553 "name": "TLSTEST", 00:16:57.553 "trtype": "tcp", 00:16:57.553 "traddr": "10.0.0.2", 00:16:57.553 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:57.553 "adrfam": "ipv4", 00:16:57.553 "trsvcid": "4420", 00:16:57.553 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.553 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:16:57.553 "method": "bdev_nvme_attach_controller", 00:16:57.553 "req_id": 1 00:16:57.553 } 00:16:57.553 Got JSON-RPC error response 00:16:57.553 response: 00:16:57.553 { 00:16:57.553 "code": -32602, 00:16:57.553 "message": "Invalid parameters" 00:16:57.553 } 00:16:57.553 12:44:30 -- target/tls.sh@36 -- # killprocess 3540078 00:16:57.553 12:44:30 -- common/autotest_common.sh@936 -- # '[' -z 3540078 ']' 00:16:57.553 12:44:30 -- common/autotest_common.sh@940 -- # kill -0 3540078 00:16:57.553 12:44:30 -- common/autotest_common.sh@941 -- # uname 00:16:57.553 12:44:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:57.553 12:44:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3540078 00:16:57.553 12:44:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:16:57.553 12:44:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:16:57.553 12:44:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3540078' 00:16:57.553 killing process with pid 3540078 00:16:57.553 12:44:30 -- common/autotest_common.sh@955 -- # kill 3540078 00:16:57.553 Received shutdown signal, test time was about 10.000000 seconds 00:16:57.553 00:16:57.553 Latency(us) 00:16:57.553 [2024-11-20T11:44:30.661Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:57.553 [2024-11-20T11:44:30.661Z] =================================================================================================================== 00:16:57.553 [2024-11-20T11:44:30.661Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:57.553 12:44:30 -- common/autotest_common.sh@960 -- # wait 3540078 00:16:57.812 12:44:30 -- target/tls.sh@37 -- # return 1 00:16:57.812 12:44:30 -- common/autotest_common.sh@653 -- # es=1 00:16:57.812 12:44:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:57.812 12:44:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:57.812 12:44:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:57.812 12:44:30 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:57.812 12:44:30 -- common/autotest_common.sh@650 -- # local es=0 00:16:57.812 12:44:30 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:57.812 12:44:30 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:57.812 12:44:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:57.812 12:44:30 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:57.812 12:44:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:57.812 12:44:30 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:57.812 12:44:30 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:57.812 12:44:30 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:57.812 12:44:30 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:16:57.812 12:44:30 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:16:57.812 12:44:30 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:57.812 12:44:30 -- target/tls.sh@28 -- # bdevperf_pid=3540218 00:16:57.812 12:44:30 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:57.812 12:44:30 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:57.812 12:44:30 -- target/tls.sh@31 -- # waitforlisten 3540218 /var/tmp/bdevperf.sock 00:16:57.812 12:44:30 -- common/autotest_common.sh@829 -- # '[' -z 3540218 ']' 00:16:57.812 12:44:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:57.812 12:44:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:57.812 12:44:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:57.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:57.812 12:44:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:57.812 12:44:30 -- common/autotest_common.sh@10 -- # set +x 00:16:57.812 [2024-11-20 12:44:30.831434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:57.812 [2024-11-20 12:44:30.831509] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3540218 ] 00:16:57.812 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.812 [2024-11-20 12:44:30.890598] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:58.071 [2024-11-20 12:44:31.002960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:59.005 12:44:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:59.005 12:44:31 -- common/autotest_common.sh@862 -- # return 0 00:16:59.005 12:44:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:59.005 [2024-11-20 12:44:32.040762] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:59.005 [2024-11-20 12:44:32.045899] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:59.005 [2024-11-20 12:44:32.045946] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:59.005 [2024-11-20 12:44:32.045988] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:59.005 [2024-11-20 12:44:32.046469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1de91f0 (107): Transport endpoint is not connected 00:16:59.005 [2024-11-20 12:44:32.047459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1de91f0 (9): Bad file descriptor 00:16:59.005 [2024-11-20 12:44:32.048458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:59.005 [2024-11-20 12:44:32.048482] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:16:59.005 [2024-11-20 12:44:32.048497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:59.005 request: 00:16:59.005 { 00:16:59.005 "name": "TLSTEST", 00:16:59.005 "trtype": "tcp", 00:16:59.005 "traddr": "10.0.0.2", 00:16:59.005 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:16:59.005 "adrfam": "ipv4", 00:16:59.005 "trsvcid": "4420", 00:16:59.005 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:59.005 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:16:59.005 "method": "bdev_nvme_attach_controller", 00:16:59.005 "req_id": 1 00:16:59.005 } 00:16:59.005 Got JSON-RPC error response 00:16:59.005 response: 00:16:59.005 { 00:16:59.005 "code": -32602, 00:16:59.005 "message": "Invalid parameters" 00:16:59.005 } 00:16:59.005 12:44:32 -- target/tls.sh@36 -- # killprocess 3540218 00:16:59.005 12:44:32 -- common/autotest_common.sh@936 -- # '[' -z 3540218 ']' 00:16:59.005 12:44:32 -- common/autotest_common.sh@940 -- # kill -0 3540218 00:16:59.005 12:44:32 -- common/autotest_common.sh@941 -- # uname 00:16:59.005 12:44:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:59.005 12:44:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3540218 00:16:59.005 12:44:32 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:16:59.005 12:44:32 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:16:59.005 12:44:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3540218' 00:16:59.005 killing process with pid 3540218 00:16:59.005 12:44:32 -- common/autotest_common.sh@955 -- # kill 3540218 00:16:59.005 Received shutdown signal, test time was about 10.000000 seconds 00:16:59.005 00:16:59.005 Latency(us) 00:16:59.005 [2024-11-20T11:44:32.113Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:59.005 [2024-11-20T11:44:32.113Z] =================================================================================================================== 00:16:59.005 [2024-11-20T11:44:32.113Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:59.005 12:44:32 -- common/autotest_common.sh@960 -- # wait 3540218 00:16:59.264 12:44:32 -- target/tls.sh@37 -- # return 1 00:16:59.264 12:44:32 -- common/autotest_common.sh@653 -- # es=1 00:16:59.264 12:44:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:59.264 12:44:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:59.264 12:44:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:59.264 12:44:32 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:59.264 12:44:32 -- common/autotest_common.sh@650 -- # local es=0 00:16:59.264 12:44:32 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:59.264 12:44:32 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:59.264 12:44:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:59.264 12:44:32 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:59.264 12:44:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:59.264 12:44:32 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:59.264 12:44:32 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:59.264 12:44:32 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:16:59.264 12:44:32 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:59.264 12:44:32 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:16:59.264 12:44:32 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:59.264 12:44:32 -- target/tls.sh@28 -- # bdevperf_pid=3540492 00:16:59.264 12:44:32 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:59.264 12:44:32 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:59.264 12:44:32 -- target/tls.sh@31 -- # waitforlisten 3540492 /var/tmp/bdevperf.sock 00:16:59.264 12:44:32 -- common/autotest_common.sh@829 -- # '[' -z 3540492 ']' 00:16:59.264 12:44:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:59.264 12:44:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:59.264 12:44:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:59.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:59.264 12:44:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:59.264 12:44:32 -- common/autotest_common.sh@10 -- # set +x 00:16:59.523 [2024-11-20 12:44:32.398121] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:59.523 [2024-11-20 12:44:32.398210] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3540492 ] 00:16:59.523 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.523 [2024-11-20 12:44:32.455124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:59.523 [2024-11-20 12:44:32.554670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.455 12:44:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:00.455 12:44:33 -- common/autotest_common.sh@862 -- # return 0 00:17:00.456 12:44:33 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:00.714 [2024-11-20 12:44:33.587836] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:00.714 [2024-11-20 12:44:33.599831] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:00.714 [2024-11-20 12:44:33.599865] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:00.714 [2024-11-20 12:44:33.599904] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:00.714 [2024-11-20 12:44:33.600622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x194d1f0 (107): Transport endpoint is not connected 00:17:00.714 [2024-11-20 12:44:33.601611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x194d1f0 (9): Bad file descriptor 00:17:00.714 [2024-11-20 12:44:33.602611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:00.714 [2024-11-20 12:44:33.602631] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:00.714 [2024-11-20 12:44:33.602645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:00.714 request: 00:17:00.714 { 00:17:00.714 "name": "TLSTEST", 00:17:00.714 "trtype": "tcp", 00:17:00.714 "traddr": "10.0.0.2", 00:17:00.714 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:00.714 "adrfam": "ipv4", 00:17:00.714 "trsvcid": "4420", 00:17:00.714 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:00.714 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:00.714 "method": "bdev_nvme_attach_controller", 00:17:00.714 "req_id": 1 00:17:00.714 } 00:17:00.714 Got JSON-RPC error response 00:17:00.714 response: 00:17:00.714 { 00:17:00.714 "code": -32602, 00:17:00.714 "message": "Invalid parameters" 00:17:00.714 } 00:17:00.714 12:44:33 -- target/tls.sh@36 -- # killprocess 3540492 00:17:00.714 12:44:33 -- common/autotest_common.sh@936 -- # '[' -z 3540492 ']' 00:17:00.714 12:44:33 -- common/autotest_common.sh@940 -- # kill -0 3540492 00:17:00.714 12:44:33 -- common/autotest_common.sh@941 -- # uname 00:17:00.714 12:44:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:00.714 12:44:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3540492 00:17:00.714 12:44:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:00.714 12:44:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:00.714 12:44:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3540492' 00:17:00.714 killing process with pid 3540492 00:17:00.714 12:44:33 -- common/autotest_common.sh@955 -- # kill 3540492 00:17:00.714 Received shutdown signal, test time was about 10.000000 seconds 00:17:00.714 00:17:00.714 Latency(us) 00:17:00.714 [2024-11-20T11:44:33.822Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:00.714 [2024-11-20T11:44:33.822Z] =================================================================================================================== 00:17:00.714 [2024-11-20T11:44:33.822Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:00.714 12:44:33 -- common/autotest_common.sh@960 -- # wait 3540492 00:17:00.972 12:44:33 -- target/tls.sh@37 -- # return 1 00:17:00.972 12:44:33 -- common/autotest_common.sh@653 -- # es=1 00:17:00.972 12:44:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:00.972 12:44:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:00.972 12:44:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:00.972 12:44:33 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:00.972 12:44:33 -- common/autotest_common.sh@650 -- # local es=0 00:17:00.972 12:44:33 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:00.972 12:44:33 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:00.972 12:44:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:00.972 12:44:33 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:00.972 12:44:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:00.972 12:44:33 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:00.972 12:44:33 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:00.972 12:44:33 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:00.972 12:44:33 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:00.972 12:44:33 -- target/tls.sh@23 -- # psk= 00:17:00.972 12:44:33 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:00.972 12:44:33 -- target/tls.sh@28 -- # bdevperf_pid=3540638 00:17:00.972 12:44:33 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:00.972 12:44:33 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:00.972 12:44:33 -- target/tls.sh@31 -- # waitforlisten 3540638 /var/tmp/bdevperf.sock 00:17:00.972 12:44:33 -- common/autotest_common.sh@829 -- # '[' -z 3540638 ']' 00:17:00.972 12:44:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:00.972 12:44:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:00.972 12:44:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:00.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:00.972 12:44:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:00.972 12:44:33 -- common/autotest_common.sh@10 -- # set +x 00:17:00.972 [2024-11-20 12:44:33.963607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.972 [2024-11-20 12:44:33.963710] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3540638 ] 00:17:00.972 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.972 [2024-11-20 12:44:34.020743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:01.230 [2024-11-20 12:44:34.123187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:02.164 12:44:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.164 12:44:34 -- common/autotest_common.sh@862 -- # return 0 00:17:02.164 12:44:34 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:02.164 [2024-11-20 12:44:35.164050] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:02.164 [2024-11-20 12:44:35.165502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x57e050 (9): Bad file descriptor 00:17:02.164 [2024-11-20 12:44:35.166498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:02.164 [2024-11-20 12:44:35.166520] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:02.164 [2024-11-20 12:44:35.166534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:02.164 request: 00:17:02.164 { 00:17:02.164 "name": "TLSTEST", 00:17:02.164 "trtype": "tcp", 00:17:02.164 "traddr": "10.0.0.2", 00:17:02.164 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:02.164 "adrfam": "ipv4", 00:17:02.164 "trsvcid": "4420", 00:17:02.164 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:02.164 "method": "bdev_nvme_attach_controller", 00:17:02.164 "req_id": 1 00:17:02.164 } 00:17:02.164 Got JSON-RPC error response 00:17:02.164 response: 00:17:02.164 { 00:17:02.164 "code": -32602, 00:17:02.164 "message": "Invalid parameters" 00:17:02.164 } 00:17:02.164 12:44:35 -- target/tls.sh@36 -- # killprocess 3540638 00:17:02.164 12:44:35 -- common/autotest_common.sh@936 -- # '[' -z 3540638 ']' 00:17:02.164 12:44:35 -- common/autotest_common.sh@940 -- # kill -0 3540638 00:17:02.164 12:44:35 -- common/autotest_common.sh@941 -- # uname 00:17:02.164 12:44:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.164 12:44:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3540638 00:17:02.164 12:44:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:02.164 12:44:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:02.164 12:44:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3540638' 00:17:02.164 killing process with pid 3540638 00:17:02.164 12:44:35 -- common/autotest_common.sh@955 -- # kill 3540638 00:17:02.164 Received shutdown signal, test time was about 10.000000 seconds 00:17:02.164 00:17:02.164 Latency(us) 00:17:02.164 [2024-11-20T11:44:35.272Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:02.164 [2024-11-20T11:44:35.272Z] =================================================================================================================== 00:17:02.164 [2024-11-20T11:44:35.272Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:02.164 12:44:35 -- common/autotest_common.sh@960 -- # wait 3540638 00:17:02.422 12:44:35 -- target/tls.sh@37 -- # return 1 00:17:02.422 12:44:35 -- common/autotest_common.sh@653 -- # es=1 00:17:02.423 12:44:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:02.423 12:44:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:02.423 12:44:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:02.423 12:44:35 -- target/tls.sh@167 -- # killprocess 3536743 00:17:02.423 12:44:35 -- common/autotest_common.sh@936 -- # '[' -z 3536743 ']' 00:17:02.423 12:44:35 -- common/autotest_common.sh@940 -- # kill -0 3536743 00:17:02.423 12:44:35 -- common/autotest_common.sh@941 -- # uname 00:17:02.423 12:44:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.423 12:44:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3536743 00:17:02.423 12:44:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:02.423 12:44:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:02.423 12:44:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3536743' 00:17:02.423 killing process with pid 3536743 00:17:02.423 12:44:35 -- common/autotest_common.sh@955 -- # kill 3536743 00:17:02.423 12:44:35 -- common/autotest_common.sh@960 -- # wait 3536743 00:17:02.989 12:44:35 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:02.989 12:44:35 -- target/tls.sh@49 -- # local key hash crc 00:17:02.989 12:44:35 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:02.989 12:44:35 -- target/tls.sh@51 -- # hash=02 00:17:02.989 12:44:35 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:02.989 12:44:35 -- target/tls.sh@52 -- # gzip -1 -c 00:17:02.989 12:44:35 -- target/tls.sh@52 -- # tail -c8 00:17:02.989 12:44:35 -- target/tls.sh@52 -- # head -c 4 00:17:02.989 12:44:35 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:02.989 12:44:35 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:02.989 12:44:35 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:02.989 12:44:35 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:02.989 12:44:35 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:02.989 12:44:35 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:02.989 12:44:35 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:02.989 12:44:35 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:02.989 12:44:35 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:02.989 12:44:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:02.989 12:44:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:02.989 12:44:35 -- common/autotest_common.sh@10 -- # set +x 00:17:02.989 12:44:35 -- nvmf/common.sh@469 -- # nvmfpid=3540931 00:17:02.989 12:44:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:02.989 12:44:35 -- nvmf/common.sh@470 -- # waitforlisten 3540931 00:17:02.989 12:44:35 -- common/autotest_common.sh@829 -- # '[' -z 3540931 ']' 00:17:02.989 12:44:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:02.989 12:44:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:02.989 12:44:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:02.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:02.989 12:44:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:02.989 12:44:35 -- common/autotest_common.sh@10 -- # set +x 00:17:02.989 [2024-11-20 12:44:35.876302] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.989 [2024-11-20 12:44:35.876402] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:02.989 EAL: No free 2048 kB hugepages reported on node 1 00:17:02.989 [2024-11-20 12:44:35.939694] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:02.989 [2024-11-20 12:44:36.044372] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:02.989 [2024-11-20 12:44:36.044515] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:02.989 [2024-11-20 12:44:36.044531] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:02.989 [2024-11-20 12:44:36.044543] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:02.989 [2024-11-20 12:44:36.044572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:03.923 12:44:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:03.923 12:44:36 -- common/autotest_common.sh@862 -- # return 0 00:17:03.923 12:44:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:03.923 12:44:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:03.923 12:44:36 -- common/autotest_common.sh@10 -- # set +x 00:17:03.923 12:44:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:03.923 12:44:36 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:03.923 12:44:36 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:03.923 12:44:36 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:04.183 [2024-11-20 12:44:37.151209] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.183 12:44:37 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:04.443 12:44:37 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:04.701 [2024-11-20 12:44:37.752861] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:04.701 [2024-11-20 12:44:37.753153] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:04.701 12:44:37 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:04.960 malloc0 00:17:04.960 12:44:38 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:05.218 12:44:38 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:05.476 12:44:38 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:05.476 12:44:38 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:05.476 12:44:38 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:05.476 12:44:38 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:05.476 12:44:38 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:05.476 12:44:38 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:05.476 12:44:38 -- target/tls.sh@28 -- # bdevperf_pid=3541236 00:17:05.476 12:44:38 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:05.476 12:44:38 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:05.476 12:44:38 -- target/tls.sh@31 -- # waitforlisten 3541236 /var/tmp/bdevperf.sock 00:17:05.476 12:44:38 -- common/autotest_common.sh@829 -- # '[' -z 3541236 ']' 00:17:05.476 12:44:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:05.476 12:44:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:05.476 12:44:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:05.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:05.476 12:44:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:05.476 12:44:38 -- common/autotest_common.sh@10 -- # set +x 00:17:05.476 [2024-11-20 12:44:38.561615] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:05.476 [2024-11-20 12:44:38.561699] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3541236 ] 00:17:05.735 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.735 [2024-11-20 12:44:38.618950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:05.735 [2024-11-20 12:44:38.722159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:06.666 12:44:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:06.666 12:44:39 -- common/autotest_common.sh@862 -- # return 0 00:17:06.666 12:44:39 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:06.924 [2024-11-20 12:44:39.800864] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:06.924 TLSTESTn1 00:17:06.924 12:44:39 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:06.924 Running I/O for 10 seconds... 00:17:19.118 00:17:19.118 Latency(us) 00:17:19.118 [2024-11-20T11:44:52.226Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.118 [2024-11-20T11:44:52.226Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:19.118 Verification LBA range: start 0x0 length 0x2000 00:17:19.118 TLSTESTn1 : 10.02 3879.62 15.15 0.00 0.00 32941.68 6189.51 77672.30 00:17:19.118 [2024-11-20T11:44:52.226Z] =================================================================================================================== 00:17:19.118 [2024-11-20T11:44:52.226Z] Total : 3879.62 15.15 0.00 0.00 32941.68 6189.51 77672.30 00:17:19.118 0 00:17:19.118 12:44:50 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:19.118 12:44:50 -- target/tls.sh@45 -- # killprocess 3541236 00:17:19.118 12:44:50 -- common/autotest_common.sh@936 -- # '[' -z 3541236 ']' 00:17:19.118 12:44:50 -- common/autotest_common.sh@940 -- # kill -0 3541236 00:17:19.118 12:44:50 -- common/autotest_common.sh@941 -- # uname 00:17:19.118 12:44:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.118 12:44:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3541236 00:17:19.118 12:44:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:19.118 12:44:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:19.118 12:44:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3541236' 00:17:19.118 killing process with pid 3541236 00:17:19.118 12:44:50 -- common/autotest_common.sh@955 -- # kill 3541236 00:17:19.118 Received shutdown signal, test time was about 10.000000 seconds 00:17:19.118 00:17:19.118 Latency(us) 00:17:19.118 [2024-11-20T11:44:52.226Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.118 [2024-11-20T11:44:52.226Z] =================================================================================================================== 00:17:19.118 [2024-11-20T11:44:52.226Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:19.118 12:44:50 -- common/autotest_common.sh@960 -- # wait 3541236 00:17:19.118 12:44:50 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.118 12:44:50 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.118 12:44:50 -- common/autotest_common.sh@650 -- # local es=0 00:17:19.118 12:44:50 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.118 12:44:50 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:19.118 12:44:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:19.118 12:44:50 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:19.118 12:44:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:19.118 12:44:50 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.118 12:44:50 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:19.118 12:44:50 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:19.118 12:44:50 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:19.118 12:44:50 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:19.118 12:44:50 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:19.118 12:44:50 -- target/tls.sh@28 -- # bdevperf_pid=3542637 00:17:19.118 12:44:50 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:19.118 12:44:50 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:19.118 12:44:50 -- target/tls.sh@31 -- # waitforlisten 3542637 /var/tmp/bdevperf.sock 00:17:19.118 12:44:50 -- common/autotest_common.sh@829 -- # '[' -z 3542637 ']' 00:17:19.118 12:44:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:19.118 12:44:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:19.118 12:44:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:19.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:19.118 12:44:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:19.118 12:44:50 -- common/autotest_common.sh@10 -- # set +x 00:17:19.118 [2024-11-20 12:44:50.392523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:19.118 [2024-11-20 12:44:50.392621] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3542637 ] 00:17:19.118 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.118 [2024-11-20 12:44:50.455196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.118 [2024-11-20 12:44:50.562644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.118 12:44:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:19.118 12:44:51 -- common/autotest_common.sh@862 -- # return 0 00:17:19.118 12:44:51 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.118 [2024-11-20 12:44:51.649818] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:19.118 [2024-11-20 12:44:51.649893] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:19.118 request: 00:17:19.118 { 00:17:19.118 "name": "TLSTEST", 00:17:19.118 "trtype": "tcp", 00:17:19.118 "traddr": "10.0.0.2", 00:17:19.118 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.118 "adrfam": "ipv4", 00:17:19.118 "trsvcid": "4420", 00:17:19.118 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.118 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:19.118 "method": "bdev_nvme_attach_controller", 00:17:19.118 "req_id": 1 00:17:19.118 } 00:17:19.118 Got JSON-RPC error response 00:17:19.118 response: 00:17:19.118 { 00:17:19.118 "code": -22, 00:17:19.118 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:19.118 } 00:17:19.118 12:44:51 -- target/tls.sh@36 -- # killprocess 3542637 00:17:19.118 12:44:51 -- common/autotest_common.sh@936 -- # '[' -z 3542637 ']' 00:17:19.118 12:44:51 -- common/autotest_common.sh@940 -- # kill -0 3542637 00:17:19.118 12:44:51 -- common/autotest_common.sh@941 -- # uname 00:17:19.118 12:44:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.118 12:44:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3542637 00:17:19.118 12:44:51 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:19.118 12:44:51 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:19.118 12:44:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3542637' 00:17:19.118 killing process with pid 3542637 00:17:19.118 12:44:51 -- common/autotest_common.sh@955 -- # kill 3542637 00:17:19.118 Received shutdown signal, test time was about 10.000000 seconds 00:17:19.118 00:17:19.118 Latency(us) 00:17:19.118 [2024-11-20T11:44:52.226Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.118 [2024-11-20T11:44:52.226Z] =================================================================================================================== 00:17:19.118 [2024-11-20T11:44:52.226Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:19.119 12:44:51 -- common/autotest_common.sh@960 -- # wait 3542637 00:17:19.119 12:44:51 -- target/tls.sh@37 -- # return 1 00:17:19.119 12:44:51 -- common/autotest_common.sh@653 -- # es=1 00:17:19.119 12:44:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:19.119 12:44:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:19.119 12:44:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:19.119 12:44:51 -- target/tls.sh@183 -- # killprocess 3540931 00:17:19.119 12:44:51 -- common/autotest_common.sh@936 -- # '[' -z 3540931 ']' 00:17:19.119 12:44:51 -- common/autotest_common.sh@940 -- # kill -0 3540931 00:17:19.119 12:44:51 -- common/autotest_common.sh@941 -- # uname 00:17:19.119 12:44:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.119 12:44:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3540931 00:17:19.119 12:44:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:19.119 12:44:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:19.119 12:44:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3540931' 00:17:19.119 killing process with pid 3540931 00:17:19.119 12:44:52 -- common/autotest_common.sh@955 -- # kill 3540931 00:17:19.119 12:44:52 -- common/autotest_common.sh@960 -- # wait 3540931 00:17:19.377 12:44:52 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:19.377 12:44:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:19.377 12:44:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:19.377 12:44:52 -- common/autotest_common.sh@10 -- # set +x 00:17:19.377 12:44:52 -- nvmf/common.sh@469 -- # nvmfpid=3542891 00:17:19.377 12:44:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:19.377 12:44:52 -- nvmf/common.sh@470 -- # waitforlisten 3542891 00:17:19.377 12:44:52 -- common/autotest_common.sh@829 -- # '[' -z 3542891 ']' 00:17:19.377 12:44:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:19.377 12:44:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:19.377 12:44:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:19.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:19.377 12:44:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:19.377 12:44:52 -- common/autotest_common.sh@10 -- # set +x 00:17:19.377 [2024-11-20 12:44:52.366959] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:19.377 [2024-11-20 12:44:52.367052] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:19.377 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.377 [2024-11-20 12:44:52.434368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.636 [2024-11-20 12:44:52.546896] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:19.636 [2024-11-20 12:44:52.547086] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:19.636 [2024-11-20 12:44:52.547108] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:19.636 [2024-11-20 12:44:52.547123] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:19.636 [2024-11-20 12:44:52.547155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:20.594 12:44:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:20.594 12:44:53 -- common/autotest_common.sh@862 -- # return 0 00:17:20.594 12:44:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:20.594 12:44:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:20.594 12:44:53 -- common/autotest_common.sh@10 -- # set +x 00:17:20.594 12:44:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:20.594 12:44:53 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.594 12:44:53 -- common/autotest_common.sh@650 -- # local es=0 00:17:20.594 12:44:53 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.594 12:44:53 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:20.594 12:44:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:20.594 12:44:53 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:20.594 12:44:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:20.594 12:44:53 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.594 12:44:53 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.594 12:44:53 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:20.594 [2024-11-20 12:44:53.569952] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:20.594 12:44:53 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:20.927 12:44:53 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:21.202 [2024-11-20 12:44:54.091384] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:21.202 [2024-11-20 12:44:54.091660] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:21.202 12:44:54 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:21.460 malloc0 00:17:21.460 12:44:54 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:21.718 12:44:54 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:21.976 [2024-11-20 12:44:54.869806] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:21.976 [2024-11-20 12:44:54.869848] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:21.976 [2024-11-20 12:44:54.869877] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:21.977 request: 00:17:21.977 { 00:17:21.977 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:21.977 "host": "nqn.2016-06.io.spdk:host1", 00:17:21.977 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:21.977 "method": "nvmf_subsystem_add_host", 00:17:21.977 "req_id": 1 00:17:21.977 } 00:17:21.977 Got JSON-RPC error response 00:17:21.977 response: 00:17:21.977 { 00:17:21.977 "code": -32603, 00:17:21.977 "message": "Internal error" 00:17:21.977 } 00:17:21.977 12:44:54 -- common/autotest_common.sh@653 -- # es=1 00:17:21.977 12:44:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:21.977 12:44:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:21.977 12:44:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:21.977 12:44:54 -- target/tls.sh@189 -- # killprocess 3542891 00:17:21.977 12:44:54 -- common/autotest_common.sh@936 -- # '[' -z 3542891 ']' 00:17:21.977 12:44:54 -- common/autotest_common.sh@940 -- # kill -0 3542891 00:17:21.977 12:44:54 -- common/autotest_common.sh@941 -- # uname 00:17:21.977 12:44:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:21.977 12:44:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3542891 00:17:21.977 12:44:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:21.977 12:44:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:21.977 12:44:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3542891' 00:17:21.977 killing process with pid 3542891 00:17:21.977 12:44:54 -- common/autotest_common.sh@955 -- # kill 3542891 00:17:21.977 12:44:54 -- common/autotest_common.sh@960 -- # wait 3542891 00:17:22.235 12:44:55 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:22.235 12:44:55 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:22.235 12:44:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:22.235 12:44:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:22.235 12:44:55 -- common/autotest_common.sh@10 -- # set +x 00:17:22.235 12:44:55 -- nvmf/common.sh@469 -- # nvmfpid=3543326 00:17:22.235 12:44:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:22.235 12:44:55 -- nvmf/common.sh@470 -- # waitforlisten 3543326 00:17:22.235 12:44:55 -- common/autotest_common.sh@829 -- # '[' -z 3543326 ']' 00:17:22.235 12:44:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:22.235 12:44:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.235 12:44:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:22.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:22.235 12:44:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.235 12:44:55 -- common/autotest_common.sh@10 -- # set +x 00:17:22.235 [2024-11-20 12:44:55.278678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.235 [2024-11-20 12:44:55.278772] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:22.235 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.493 [2024-11-20 12:44:55.347705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.493 [2024-11-20 12:44:55.459496] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:22.493 [2024-11-20 12:44:55.459675] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:22.493 [2024-11-20 12:44:55.459696] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:22.493 [2024-11-20 12:44:55.459712] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:22.493 [2024-11-20 12:44:55.459745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:23.427 12:44:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:23.427 12:44:56 -- common/autotest_common.sh@862 -- # return 0 00:17:23.427 12:44:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:23.427 12:44:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:23.427 12:44:56 -- common/autotest_common.sh@10 -- # set +x 00:17:23.427 12:44:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:23.427 12:44:56 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:23.427 12:44:56 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:23.427 12:44:56 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:23.427 [2024-11-20 12:44:56.481613] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:23.427 12:44:56 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:23.685 12:44:56 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:23.943 [2024-11-20 12:44:56.970923] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:23.943 [2024-11-20 12:44:56.971191] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:23.943 12:44:56 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:24.201 malloc0 00:17:24.201 12:44:57 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:24.459 12:44:57 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:24.717 12:44:57 -- target/tls.sh@197 -- # bdevperf_pid=3543630 00:17:24.717 12:44:57 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:24.717 12:44:57 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:24.717 12:44:57 -- target/tls.sh@200 -- # waitforlisten 3543630 /var/tmp/bdevperf.sock 00:17:24.717 12:44:57 -- common/autotest_common.sh@829 -- # '[' -z 3543630 ']' 00:17:24.717 12:44:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:24.717 12:44:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:24.717 12:44:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:24.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:24.717 12:44:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:24.717 12:44:57 -- common/autotest_common.sh@10 -- # set +x 00:17:24.717 [2024-11-20 12:44:57.799877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:24.717 [2024-11-20 12:44:57.799963] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3543630 ] 00:17:24.975 EAL: No free 2048 kB hugepages reported on node 1 00:17:24.975 [2024-11-20 12:44:57.858581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:24.975 [2024-11-20 12:44:57.964653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:25.907 12:44:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:25.908 12:44:58 -- common/autotest_common.sh@862 -- # return 0 00:17:25.908 12:44:58 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:26.166 [2024-11-20 12:44:59.033108] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:26.166 TLSTESTn1 00:17:26.166 12:44:59 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:26.424 12:44:59 -- target/tls.sh@205 -- # tgtconf='{ 00:17:26.424 "subsystems": [ 00:17:26.424 { 00:17:26.424 "subsystem": "iobuf", 00:17:26.424 "config": [ 00:17:26.424 { 00:17:26.424 "method": "iobuf_set_options", 00:17:26.424 "params": { 00:17:26.424 "small_pool_count": 8192, 00:17:26.424 "large_pool_count": 1024, 00:17:26.424 "small_bufsize": 8192, 00:17:26.424 "large_bufsize": 135168 00:17:26.424 } 00:17:26.424 } 00:17:26.424 ] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "sock", 00:17:26.424 "config": [ 00:17:26.424 { 00:17:26.424 "method": "sock_impl_set_options", 00:17:26.424 "params": { 00:17:26.424 "impl_name": "posix", 00:17:26.424 "recv_buf_size": 2097152, 00:17:26.424 "send_buf_size": 2097152, 00:17:26.424 "enable_recv_pipe": true, 00:17:26.424 "enable_quickack": false, 00:17:26.424 "enable_placement_id": 0, 00:17:26.424 "enable_zerocopy_send_server": true, 00:17:26.424 "enable_zerocopy_send_client": false, 00:17:26.424 "zerocopy_threshold": 0, 00:17:26.424 "tls_version": 0, 00:17:26.424 "enable_ktls": false 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "sock_impl_set_options", 00:17:26.424 "params": { 00:17:26.424 "impl_name": "ssl", 00:17:26.424 "recv_buf_size": 4096, 00:17:26.424 "send_buf_size": 4096, 00:17:26.424 "enable_recv_pipe": true, 00:17:26.424 "enable_quickack": false, 00:17:26.424 "enable_placement_id": 0, 00:17:26.424 "enable_zerocopy_send_server": true, 00:17:26.424 "enable_zerocopy_send_client": false, 00:17:26.424 "zerocopy_threshold": 0, 00:17:26.424 "tls_version": 0, 00:17:26.424 "enable_ktls": false 00:17:26.424 } 00:17:26.424 } 00:17:26.424 ] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "vmd", 00:17:26.424 "config": [] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "accel", 00:17:26.424 "config": [ 00:17:26.424 { 00:17:26.424 "method": "accel_set_options", 00:17:26.424 "params": { 00:17:26.424 "small_cache_size": 128, 00:17:26.424 "large_cache_size": 16, 00:17:26.424 "task_count": 2048, 00:17:26.424 "sequence_count": 2048, 00:17:26.424 "buf_count": 2048 00:17:26.424 } 00:17:26.424 } 00:17:26.424 ] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "bdev", 00:17:26.424 "config": [ 00:17:26.424 { 00:17:26.424 "method": "bdev_set_options", 00:17:26.424 "params": { 00:17:26.424 "bdev_io_pool_size": 65535, 00:17:26.424 "bdev_io_cache_size": 256, 00:17:26.424 "bdev_auto_examine": true, 00:17:26.424 "iobuf_small_cache_size": 128, 00:17:26.424 "iobuf_large_cache_size": 16 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "bdev_raid_set_options", 00:17:26.424 "params": { 00:17:26.424 "process_window_size_kb": 1024 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "bdev_iscsi_set_options", 00:17:26.424 "params": { 00:17:26.424 "timeout_sec": 30 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "bdev_nvme_set_options", 00:17:26.424 "params": { 00:17:26.424 "action_on_timeout": "none", 00:17:26.424 "timeout_us": 0, 00:17:26.424 "timeout_admin_us": 0, 00:17:26.424 "keep_alive_timeout_ms": 10000, 00:17:26.424 "transport_retry_count": 4, 00:17:26.424 "arbitration_burst": 0, 00:17:26.424 "low_priority_weight": 0, 00:17:26.424 "medium_priority_weight": 0, 00:17:26.424 "high_priority_weight": 0, 00:17:26.424 "nvme_adminq_poll_period_us": 10000, 00:17:26.424 "nvme_ioq_poll_period_us": 0, 00:17:26.424 "io_queue_requests": 0, 00:17:26.424 "delay_cmd_submit": true, 00:17:26.424 "bdev_retry_count": 3, 00:17:26.424 "transport_ack_timeout": 0, 00:17:26.424 "ctrlr_loss_timeout_sec": 0, 00:17:26.424 "reconnect_delay_sec": 0, 00:17:26.424 "fast_io_fail_timeout_sec": 0, 00:17:26.424 "generate_uuids": false, 00:17:26.424 "transport_tos": 0, 00:17:26.424 "io_path_stat": false, 00:17:26.424 "allow_accel_sequence": false 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "bdev_nvme_set_hotplug", 00:17:26.424 "params": { 00:17:26.424 "period_us": 100000, 00:17:26.424 "enable": false 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "bdev_malloc_create", 00:17:26.424 "params": { 00:17:26.424 "name": "malloc0", 00:17:26.424 "num_blocks": 8192, 00:17:26.424 "block_size": 4096, 00:17:26.424 "physical_block_size": 4096, 00:17:26.424 "uuid": "2cd851e8-4cc2-41ad-838b-c877c57bc55f", 00:17:26.424 "optimal_io_boundary": 0 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "bdev_wait_for_examine" 00:17:26.424 } 00:17:26.424 ] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "nbd", 00:17:26.424 "config": [] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "scheduler", 00:17:26.424 "config": [ 00:17:26.424 { 00:17:26.424 "method": "framework_set_scheduler", 00:17:26.424 "params": { 00:17:26.424 "name": "static" 00:17:26.424 } 00:17:26.424 } 00:17:26.424 ] 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "subsystem": "nvmf", 00:17:26.424 "config": [ 00:17:26.424 { 00:17:26.424 "method": "nvmf_set_config", 00:17:26.424 "params": { 00:17:26.424 "discovery_filter": "match_any", 00:17:26.424 "admin_cmd_passthru": { 00:17:26.424 "identify_ctrlr": false 00:17:26.424 } 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_set_max_subsystems", 00:17:26.424 "params": { 00:17:26.424 "max_subsystems": 1024 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_set_crdt", 00:17:26.424 "params": { 00:17:26.424 "crdt1": 0, 00:17:26.424 "crdt2": 0, 00:17:26.424 "crdt3": 0 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_create_transport", 00:17:26.424 "params": { 00:17:26.424 "trtype": "TCP", 00:17:26.424 "max_queue_depth": 128, 00:17:26.424 "max_io_qpairs_per_ctrlr": 127, 00:17:26.424 "in_capsule_data_size": 4096, 00:17:26.424 "max_io_size": 131072, 00:17:26.424 "io_unit_size": 131072, 00:17:26.424 "max_aq_depth": 128, 00:17:26.424 "num_shared_buffers": 511, 00:17:26.424 "buf_cache_size": 4294967295, 00:17:26.424 "dif_insert_or_strip": false, 00:17:26.424 "zcopy": false, 00:17:26.424 "c2h_success": false, 00:17:26.424 "sock_priority": 0, 00:17:26.424 "abort_timeout_sec": 1 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_create_subsystem", 00:17:26.424 "params": { 00:17:26.424 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:26.424 "allow_any_host": false, 00:17:26.424 "serial_number": "SPDK00000000000001", 00:17:26.424 "model_number": "SPDK bdev Controller", 00:17:26.424 "max_namespaces": 10, 00:17:26.424 "min_cntlid": 1, 00:17:26.424 "max_cntlid": 65519, 00:17:26.424 "ana_reporting": false 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_subsystem_add_host", 00:17:26.424 "params": { 00:17:26.424 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:26.424 "host": "nqn.2016-06.io.spdk:host1", 00:17:26.424 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_subsystem_add_ns", 00:17:26.424 "params": { 00:17:26.424 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:26.424 "namespace": { 00:17:26.424 "nsid": 1, 00:17:26.424 "bdev_name": "malloc0", 00:17:26.424 "nguid": "2CD851E84CC241AD838BC877C57BC55F", 00:17:26.424 "uuid": "2cd851e8-4cc2-41ad-838b-c877c57bc55f" 00:17:26.424 } 00:17:26.424 } 00:17:26.424 }, 00:17:26.424 { 00:17:26.424 "method": "nvmf_subsystem_add_listener", 00:17:26.424 "params": { 00:17:26.424 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:26.424 "listen_address": { 00:17:26.424 "trtype": "TCP", 00:17:26.424 "adrfam": "IPv4", 00:17:26.424 "traddr": "10.0.0.2", 00:17:26.424 "trsvcid": "4420" 00:17:26.424 }, 00:17:26.424 "secure_channel": true 00:17:26.424 } 00:17:26.424 } 00:17:26.424 ] 00:17:26.424 } 00:17:26.425 ] 00:17:26.425 }' 00:17:26.425 12:44:59 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:26.684 12:44:59 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:26.684 "subsystems": [ 00:17:26.684 { 00:17:26.684 "subsystem": "iobuf", 00:17:26.684 "config": [ 00:17:26.684 { 00:17:26.684 "method": "iobuf_set_options", 00:17:26.684 "params": { 00:17:26.684 "small_pool_count": 8192, 00:17:26.684 "large_pool_count": 1024, 00:17:26.684 "small_bufsize": 8192, 00:17:26.684 "large_bufsize": 135168 00:17:26.684 } 00:17:26.684 } 00:17:26.684 ] 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "subsystem": "sock", 00:17:26.684 "config": [ 00:17:26.684 { 00:17:26.684 "method": "sock_impl_set_options", 00:17:26.684 "params": { 00:17:26.684 "impl_name": "posix", 00:17:26.684 "recv_buf_size": 2097152, 00:17:26.684 "send_buf_size": 2097152, 00:17:26.684 "enable_recv_pipe": true, 00:17:26.684 "enable_quickack": false, 00:17:26.684 "enable_placement_id": 0, 00:17:26.684 "enable_zerocopy_send_server": true, 00:17:26.684 "enable_zerocopy_send_client": false, 00:17:26.684 "zerocopy_threshold": 0, 00:17:26.684 "tls_version": 0, 00:17:26.684 "enable_ktls": false 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "sock_impl_set_options", 00:17:26.684 "params": { 00:17:26.684 "impl_name": "ssl", 00:17:26.684 "recv_buf_size": 4096, 00:17:26.684 "send_buf_size": 4096, 00:17:26.684 "enable_recv_pipe": true, 00:17:26.684 "enable_quickack": false, 00:17:26.684 "enable_placement_id": 0, 00:17:26.684 "enable_zerocopy_send_server": true, 00:17:26.684 "enable_zerocopy_send_client": false, 00:17:26.684 "zerocopy_threshold": 0, 00:17:26.684 "tls_version": 0, 00:17:26.684 "enable_ktls": false 00:17:26.684 } 00:17:26.684 } 00:17:26.684 ] 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "subsystem": "vmd", 00:17:26.684 "config": [] 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "subsystem": "accel", 00:17:26.684 "config": [ 00:17:26.684 { 00:17:26.684 "method": "accel_set_options", 00:17:26.684 "params": { 00:17:26.684 "small_cache_size": 128, 00:17:26.684 "large_cache_size": 16, 00:17:26.684 "task_count": 2048, 00:17:26.684 "sequence_count": 2048, 00:17:26.684 "buf_count": 2048 00:17:26.684 } 00:17:26.684 } 00:17:26.684 ] 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "subsystem": "bdev", 00:17:26.684 "config": [ 00:17:26.684 { 00:17:26.684 "method": "bdev_set_options", 00:17:26.684 "params": { 00:17:26.684 "bdev_io_pool_size": 65535, 00:17:26.684 "bdev_io_cache_size": 256, 00:17:26.684 "bdev_auto_examine": true, 00:17:26.684 "iobuf_small_cache_size": 128, 00:17:26.684 "iobuf_large_cache_size": 16 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "bdev_raid_set_options", 00:17:26.684 "params": { 00:17:26.684 "process_window_size_kb": 1024 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "bdev_iscsi_set_options", 00:17:26.684 "params": { 00:17:26.684 "timeout_sec": 30 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "bdev_nvme_set_options", 00:17:26.684 "params": { 00:17:26.684 "action_on_timeout": "none", 00:17:26.684 "timeout_us": 0, 00:17:26.684 "timeout_admin_us": 0, 00:17:26.684 "keep_alive_timeout_ms": 10000, 00:17:26.684 "transport_retry_count": 4, 00:17:26.684 "arbitration_burst": 0, 00:17:26.684 "low_priority_weight": 0, 00:17:26.684 "medium_priority_weight": 0, 00:17:26.684 "high_priority_weight": 0, 00:17:26.684 "nvme_adminq_poll_period_us": 10000, 00:17:26.684 "nvme_ioq_poll_period_us": 0, 00:17:26.684 "io_queue_requests": 512, 00:17:26.684 "delay_cmd_submit": true, 00:17:26.684 "bdev_retry_count": 3, 00:17:26.684 "transport_ack_timeout": 0, 00:17:26.684 "ctrlr_loss_timeout_sec": 0, 00:17:26.684 "reconnect_delay_sec": 0, 00:17:26.684 "fast_io_fail_timeout_sec": 0, 00:17:26.684 "generate_uuids": false, 00:17:26.684 "transport_tos": 0, 00:17:26.684 "io_path_stat": false, 00:17:26.684 "allow_accel_sequence": false 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "bdev_nvme_attach_controller", 00:17:26.684 "params": { 00:17:26.684 "name": "TLSTEST", 00:17:26.684 "trtype": "TCP", 00:17:26.684 "adrfam": "IPv4", 00:17:26.684 "traddr": "10.0.0.2", 00:17:26.684 "trsvcid": "4420", 00:17:26.684 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:26.684 "prchk_reftag": false, 00:17:26.684 "prchk_guard": false, 00:17:26.684 "ctrlr_loss_timeout_sec": 0, 00:17:26.684 "reconnect_delay_sec": 0, 00:17:26.684 "fast_io_fail_timeout_sec": 0, 00:17:26.684 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:26.684 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:26.684 "hdgst": false, 00:17:26.684 "ddgst": false 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "bdev_nvme_set_hotplug", 00:17:26.684 "params": { 00:17:26.684 "period_us": 100000, 00:17:26.684 "enable": false 00:17:26.684 } 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "method": "bdev_wait_for_examine" 00:17:26.684 } 00:17:26.684 ] 00:17:26.684 }, 00:17:26.684 { 00:17:26.684 "subsystem": "nbd", 00:17:26.684 "config": [] 00:17:26.684 } 00:17:26.684 ] 00:17:26.684 }' 00:17:26.684 12:44:59 -- target/tls.sh@208 -- # killprocess 3543630 00:17:26.684 12:44:59 -- common/autotest_common.sh@936 -- # '[' -z 3543630 ']' 00:17:26.684 12:44:59 -- common/autotest_common.sh@940 -- # kill -0 3543630 00:17:26.684 12:44:59 -- common/autotest_common.sh@941 -- # uname 00:17:26.684 12:44:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:26.684 12:44:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3543630 00:17:26.943 12:44:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:26.943 12:44:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:26.943 12:44:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3543630' 00:17:26.943 killing process with pid 3543630 00:17:26.943 12:44:59 -- common/autotest_common.sh@955 -- # kill 3543630 00:17:26.943 Received shutdown signal, test time was about 10.000000 seconds 00:17:26.943 00:17:26.943 Latency(us) 00:17:26.943 [2024-11-20T11:45:00.051Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:26.943 [2024-11-20T11:45:00.051Z] =================================================================================================================== 00:17:26.943 [2024-11-20T11:45:00.051Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:26.943 12:44:59 -- common/autotest_common.sh@960 -- # wait 3543630 00:17:27.200 12:45:00 -- target/tls.sh@209 -- # killprocess 3543326 00:17:27.200 12:45:00 -- common/autotest_common.sh@936 -- # '[' -z 3543326 ']' 00:17:27.200 12:45:00 -- common/autotest_common.sh@940 -- # kill -0 3543326 00:17:27.200 12:45:00 -- common/autotest_common.sh@941 -- # uname 00:17:27.200 12:45:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:27.200 12:45:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3543326 00:17:27.200 12:45:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:27.200 12:45:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:27.200 12:45:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3543326' 00:17:27.200 killing process with pid 3543326 00:17:27.200 12:45:00 -- common/autotest_common.sh@955 -- # kill 3543326 00:17:27.200 12:45:00 -- common/autotest_common.sh@960 -- # wait 3543326 00:17:27.458 12:45:00 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:27.458 12:45:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:27.458 12:45:00 -- target/tls.sh@212 -- # echo '{ 00:17:27.458 "subsystems": [ 00:17:27.458 { 00:17:27.458 "subsystem": "iobuf", 00:17:27.458 "config": [ 00:17:27.458 { 00:17:27.458 "method": "iobuf_set_options", 00:17:27.458 "params": { 00:17:27.458 "small_pool_count": 8192, 00:17:27.458 "large_pool_count": 1024, 00:17:27.458 "small_bufsize": 8192, 00:17:27.458 "large_bufsize": 135168 00:17:27.458 } 00:17:27.458 } 00:17:27.458 ] 00:17:27.458 }, 00:17:27.458 { 00:17:27.458 "subsystem": "sock", 00:17:27.458 "config": [ 00:17:27.458 { 00:17:27.458 "method": "sock_impl_set_options", 00:17:27.458 "params": { 00:17:27.458 "impl_name": "posix", 00:17:27.458 "recv_buf_size": 2097152, 00:17:27.458 "send_buf_size": 2097152, 00:17:27.458 "enable_recv_pipe": true, 00:17:27.458 "enable_quickack": false, 00:17:27.458 "enable_placement_id": 0, 00:17:27.459 "enable_zerocopy_send_server": true, 00:17:27.459 "enable_zerocopy_send_client": false, 00:17:27.459 "zerocopy_threshold": 0, 00:17:27.459 "tls_version": 0, 00:17:27.459 "enable_ktls": false 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "sock_impl_set_options", 00:17:27.459 "params": { 00:17:27.459 "impl_name": "ssl", 00:17:27.459 "recv_buf_size": 4096, 00:17:27.459 "send_buf_size": 4096, 00:17:27.459 "enable_recv_pipe": true, 00:17:27.459 "enable_quickack": false, 00:17:27.459 "enable_placement_id": 0, 00:17:27.459 "enable_zerocopy_send_server": true, 00:17:27.459 "enable_zerocopy_send_client": false, 00:17:27.459 "zerocopy_threshold": 0, 00:17:27.459 "tls_version": 0, 00:17:27.459 "enable_ktls": false 00:17:27.459 } 00:17:27.459 } 00:17:27.459 ] 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "subsystem": "vmd", 00:17:27.459 "config": [] 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "subsystem": "accel", 00:17:27.459 "config": [ 00:17:27.459 { 00:17:27.459 "method": "accel_set_options", 00:17:27.459 "params": { 00:17:27.459 "small_cache_size": 128, 00:17:27.459 "large_cache_size": 16, 00:17:27.459 "task_count": 2048, 00:17:27.459 "sequence_count": 2048, 00:17:27.459 "buf_count": 2048 00:17:27.459 } 00:17:27.459 } 00:17:27.459 ] 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "subsystem": "bdev", 00:17:27.459 "config": [ 00:17:27.459 { 00:17:27.459 "method": "bdev_set_options", 00:17:27.459 "params": { 00:17:27.459 "bdev_io_pool_size": 65535, 00:17:27.459 "bdev_io_cache_size": 256, 00:17:27.459 "bdev_auto_examine": true, 00:17:27.459 "iobuf_small_cache_size": 128, 00:17:27.459 "iobuf_large_cache_size": 16 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "bdev_raid_set_options", 00:17:27.459 "params": { 00:17:27.459 "process_window_size_kb": 1024 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "bdev_iscsi_set_options", 00:17:27.459 "params": { 00:17:27.459 "timeout_sec": 30 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "bdev_nvme_set_options", 00:17:27.459 "params": { 00:17:27.459 "action_on_timeout": "none", 00:17:27.459 "timeout_us": 0, 00:17:27.459 "timeout_admin_us": 0, 00:17:27.459 "keep_alive_timeout_ms": 10000, 00:17:27.459 "transport_retry_count": 4, 00:17:27.459 "arbitration_burst": 0, 00:17:27.459 "low_priority_weight": 0, 00:17:27.459 "medium_priority_weight": 0, 00:17:27.459 "high_priority_weight": 0, 00:17:27.459 "nvme_adminq_poll_period_us": 10000, 00:17:27.459 "nvme_ioq_poll_period_us": 0, 00:17:27.459 "io_queue_requests": 0, 00:17:27.459 "delay_cmd_submit": true, 00:17:27.459 "bdev_retry_count": 3, 00:17:27.459 "transport_ack_timeout": 0, 00:17:27.459 "ctrlr_loss_timeout_sec": 0, 00:17:27.459 "reconnect_delay_sec": 0, 00:17:27.459 "fast_io_fail_timeout_sec": 0, 00:17:27.459 "generate_uuids": false, 00:17:27.459 "transport_tos": 0, 00:17:27.459 "io_path_stat": false, 00:17:27.459 "allow_accel_sequence": false 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "bdev_nvme_set_hotplug", 00:17:27.459 "params": { 00:17:27.459 "period_us": 100000, 00:17:27.459 "enable": false 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "bdev_malloc_create", 00:17:27.459 "params": { 00:17:27.459 "name": "malloc0", 00:17:27.459 "num_blocks": 8192, 00:17:27.459 "block_size": 4096, 00:17:27.459 "physical_block_size": 4096, 00:17:27.459 "uuid": "2cd851e8-4cc2-41ad-838b-c877c57bc55f", 00:17:27.459 "optimal_io_boundary": 0 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "bdev_wait_for_examine" 00:17:27.459 } 00:17:27.459 ] 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "subsystem": "nbd", 00:17:27.459 "config": [] 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "subsystem": "scheduler", 00:17:27.459 "config": [ 00:17:27.459 { 00:17:27.459 "method": "framework_set_scheduler", 00:17:27.459 "params": { 00:17:27.459 "name": "static" 00:17:27.459 } 00:17:27.459 } 00:17:27.459 ] 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "subsystem": "nvmf", 00:17:27.459 "config": [ 00:17:27.459 { 00:17:27.459 "method": "nvmf_set_config", 00:17:27.459 "params": { 00:17:27.459 "discovery_filter": "match_any", 00:17:27.459 "admin_cmd_passthru": { 00:17:27.459 "identify_ctrlr": false 00:17:27.459 } 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "nvmf_set_max_subsystems", 00:17:27.459 "params": { 00:17:27.459 "max_subsystems": 1024 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "nvmf_set_crdt", 00:17:27.459 "params": { 00:17:27.459 "crdt1": 0, 00:17:27.459 "crdt2": 0, 00:17:27.459 "crdt3": 0 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "nvmf_create_transport", 00:17:27.459 "params": { 00:17:27.459 "trtype": "TCP", 00:17:27.459 "max_queue_depth": 128, 00:17:27.459 "max_io_qpairs_per_ctrlr": 127, 00:17:27.459 "in_capsule_data_size": 4096, 00:17:27.459 "max_io_size": 131072, 00:17:27.459 "io_unit_size": 131072, 00:17:27.459 "max_aq_depth": 128, 00:17:27.459 "num_shared_buffers": 511, 00:17:27.459 "buf_cache_size": 4294967295, 00:17:27.459 "dif_insert_or_strip": false, 00:17:27.459 "zcopy": false, 00:17:27.459 "c2h_success": false, 00:17:27.459 "sock_priority": 0, 00:17:27.459 "abort_timeout_sec": 1 00:17:27.459 } 00:17:27.459 }, 00:17:27.459 { 00:17:27.459 "method": "nvmf_create_subsystem", 00:17:27.459 "params": { 00:17:27.459 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:27.459 "allow_any_host": false, 00:17:27.459 "serial_number": "SPDK00000000000001", 00:17:27.460 "model_number": "SPDK bdev Controller", 00:17:27.460 "max_namespaces": 10, 00:17:27.460 "min_cntlid": 1, 00:17:27.460 "max_cntlid": 65519, 00:17:27.460 "ana_reporting": false 00:17:27.460 } 00:17:27.460 }, 00:17:27.460 { 00:17:27.460 "method": "nvmf_subsystem_add_host", 00:17:27.460 "params": { 00:17:27.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:27.460 "host": "nqn.2016-06.io.spdk:host1", 00:17:27.460 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:27.460 } 00:17:27.460 }, 00:17:27.460 { 00:17:27.460 "method": "nvmf_subsystem_add_ns", 00:17:27.460 "params": { 00:17:27.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:27.460 "namespace": { 00:17:27.460 "nsid": 1, 00:17:27.460 "bdev_name": "malloc0", 00:17:27.460 "nguid": "2CD851E84CC241AD838BC877C57BC55F", 00:17:27.460 "uuid": "2cd851e8-4cc2-41ad-838b-c877c57bc55f" 00:17:27.460 } 00:17:27.460 } 00:17:27.460 }, 00:17:27.460 { 00:17:27.460 "method": "nvmf_subsystem_add_listener", 00:17:27.460 "params": { 00:17:27.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:27.460 "listen_address": { 00:17:27.460 "trtype": "TCP", 00:17:27.460 "adrfam": "IPv4", 00:17:27.460 "traddr": "10.0.0.2", 00:17:27.460 "trsvcid": "4420" 00:17:27.460 }, 00:17:27.460 "secure_channel": true 00:17:27.460 } 00:17:27.460 } 00:17:27.460 ] 00:17:27.460 } 00:17:27.460 ] 00:17:27.460 }' 00:17:27.460 12:45:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:27.460 12:45:00 -- common/autotest_common.sh@10 -- # set +x 00:17:27.460 12:45:00 -- nvmf/common.sh@469 -- # nvmfpid=3543956 00:17:27.460 12:45:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:27.460 12:45:00 -- nvmf/common.sh@470 -- # waitforlisten 3543956 00:17:27.460 12:45:00 -- common/autotest_common.sh@829 -- # '[' -z 3543956 ']' 00:17:27.460 12:45:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:27.460 12:45:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:27.460 12:45:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:27.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:27.460 12:45:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:27.460 12:45:00 -- common/autotest_common.sh@10 -- # set +x 00:17:27.460 [2024-11-20 12:45:00.452794] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:27.460 [2024-11-20 12:45:00.452903] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:27.460 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.460 [2024-11-20 12:45:00.525764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.718 [2024-11-20 12:45:00.643584] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:27.718 [2024-11-20 12:45:00.643757] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:27.718 [2024-11-20 12:45:00.643777] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:27.718 [2024-11-20 12:45:00.643792] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:27.718 [2024-11-20 12:45:00.643823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:27.977 [2024-11-20 12:45:00.875723] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:27.977 [2024-11-20 12:45:00.907748] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:27.977 [2024-11-20 12:45:00.908018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:28.544 12:45:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:28.544 12:45:01 -- common/autotest_common.sh@862 -- # return 0 00:17:28.544 12:45:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:28.544 12:45:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:28.544 12:45:01 -- common/autotest_common.sh@10 -- # set +x 00:17:28.544 12:45:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:28.544 12:45:01 -- target/tls.sh@216 -- # bdevperf_pid=3544173 00:17:28.544 12:45:01 -- target/tls.sh@217 -- # waitforlisten 3544173 /var/tmp/bdevperf.sock 00:17:28.544 12:45:01 -- common/autotest_common.sh@829 -- # '[' -z 3544173 ']' 00:17:28.544 12:45:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:28.544 12:45:01 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:28.544 12:45:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:28.544 12:45:01 -- target/tls.sh@213 -- # echo '{ 00:17:28.544 "subsystems": [ 00:17:28.544 { 00:17:28.544 "subsystem": "iobuf", 00:17:28.544 "config": [ 00:17:28.544 { 00:17:28.544 "method": "iobuf_set_options", 00:17:28.544 "params": { 00:17:28.544 "small_pool_count": 8192, 00:17:28.544 "large_pool_count": 1024, 00:17:28.544 "small_bufsize": 8192, 00:17:28.544 "large_bufsize": 135168 00:17:28.544 } 00:17:28.544 } 00:17:28.544 ] 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "subsystem": "sock", 00:17:28.544 "config": [ 00:17:28.544 { 00:17:28.544 "method": "sock_impl_set_options", 00:17:28.544 "params": { 00:17:28.544 "impl_name": "posix", 00:17:28.544 "recv_buf_size": 2097152, 00:17:28.544 "send_buf_size": 2097152, 00:17:28.544 "enable_recv_pipe": true, 00:17:28.544 "enable_quickack": false, 00:17:28.544 "enable_placement_id": 0, 00:17:28.544 "enable_zerocopy_send_server": true, 00:17:28.544 "enable_zerocopy_send_client": false, 00:17:28.544 "zerocopy_threshold": 0, 00:17:28.544 "tls_version": 0, 00:17:28.544 "enable_ktls": false 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "sock_impl_set_options", 00:17:28.544 "params": { 00:17:28.544 "impl_name": "ssl", 00:17:28.544 "recv_buf_size": 4096, 00:17:28.544 "send_buf_size": 4096, 00:17:28.544 "enable_recv_pipe": true, 00:17:28.544 "enable_quickack": false, 00:17:28.544 "enable_placement_id": 0, 00:17:28.544 "enable_zerocopy_send_server": true, 00:17:28.544 "enable_zerocopy_send_client": false, 00:17:28.544 "zerocopy_threshold": 0, 00:17:28.544 "tls_version": 0, 00:17:28.544 "enable_ktls": false 00:17:28.544 } 00:17:28.544 } 00:17:28.544 ] 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "subsystem": "vmd", 00:17:28.544 "config": [] 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "subsystem": "accel", 00:17:28.544 "config": [ 00:17:28.544 { 00:17:28.544 "method": "accel_set_options", 00:17:28.544 "params": { 00:17:28.544 "small_cache_size": 128, 00:17:28.544 "large_cache_size": 16, 00:17:28.544 "task_count": 2048, 00:17:28.544 "sequence_count": 2048, 00:17:28.544 "buf_count": 2048 00:17:28.544 } 00:17:28.544 } 00:17:28.544 ] 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "subsystem": "bdev", 00:17:28.544 "config": [ 00:17:28.544 { 00:17:28.544 "method": "bdev_set_options", 00:17:28.544 "params": { 00:17:28.544 "bdev_io_pool_size": 65535, 00:17:28.544 "bdev_io_cache_size": 256, 00:17:28.544 "bdev_auto_examine": true, 00:17:28.544 "iobuf_small_cache_size": 128, 00:17:28.544 "iobuf_large_cache_size": 16 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "bdev_raid_set_options", 00:17:28.544 "params": { 00:17:28.544 "process_window_size_kb": 1024 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "bdev_iscsi_set_options", 00:17:28.544 "params": { 00:17:28.544 "timeout_sec": 30 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "bdev_nvme_set_options", 00:17:28.544 "params": { 00:17:28.544 "action_on_timeout": "none", 00:17:28.544 "timeout_us": 0, 00:17:28.544 "timeout_admin_us": 0, 00:17:28.544 "keep_alive_timeout_ms": 10000, 00:17:28.544 "transport_retry_count": 4, 00:17:28.544 "arbitration_burst": 0, 00:17:28.544 "low_priority_weight": 0, 00:17:28.544 "medium_priority_weight": 0, 00:17:28.544 "high_priority_weight": 0, 00:17:28.544 "nvme_adminq_poll_period_us": 10000, 00:17:28.544 "nvme_ioq_poll_period_us": 0, 00:17:28.544 "io_queue_requests": 512, 00:17:28.544 "delay_cmd_submit": true, 00:17:28.544 "bdev_retry_count": 3, 00:17:28.544 "transport_ack_timeout": 0, 00:17:28.544 "ctrlr_loss_timeout_sec": 0, 00:17:28.544 "reconnect_delay_sec": 0, 00:17:28.544 "fast_io_fail_timeout_sec": 0, 00:17:28.544 "generate_uuids": false, 00:17:28.544 "transport_tos": 0, 00:17:28.544 "io_path_stat": false, 00:17:28.544 "allow_accel_sequence": false 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "bdev_nvme_attach_controller", 00:17:28.544 "params": { 00:17:28.544 "name": "TLSTEST", 00:17:28.544 "trtype": "TCP", 00:17:28.544 "adrfam": "IPv4", 00:17:28.544 "traddr": "10.0.0.2", 00:17:28.544 "trsvcid": "4420", 00:17:28.544 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:28.544 "prchk_reftag": false, 00:17:28.544 "prchk_guard": false, 00:17:28.544 "ctrlr_loss_timeout_sec": 0, 00:17:28.544 "reconnect_delay_sec": 0, 00:17:28.544 "fast_io_fail_timeout_sec": 0, 00:17:28.544 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:28.544 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:28.544 "hdgst": false, 00:17:28.544 "ddgst": false 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "bdev_nvme_set_hotplug", 00:17:28.544 "params": { 00:17:28.544 "period_us": 100000, 00:17:28.544 "enable": false 00:17:28.544 } 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "method": "bdev_wait_for_examine" 00:17:28.544 } 00:17:28.544 ] 00:17:28.544 }, 00:17:28.544 { 00:17:28.544 "subsystem": "nbd", 00:17:28.544 "config": [] 00:17:28.544 } 00:17:28.544 ] 00:17:28.545 }' 00:17:28.545 12:45:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:28.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:28.545 12:45:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:28.545 12:45:01 -- common/autotest_common.sh@10 -- # set +x 00:17:28.545 [2024-11-20 12:45:01.490566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:28.545 [2024-11-20 12:45:01.490658] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3544173 ] 00:17:28.545 EAL: No free 2048 kB hugepages reported on node 1 00:17:28.545 [2024-11-20 12:45:01.551170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:28.803 [2024-11-20 12:45:01.667775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:28.803 [2024-11-20 12:45:01.827780] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:29.737 12:45:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:29.737 12:45:02 -- common/autotest_common.sh@862 -- # return 0 00:17:29.737 12:45:02 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:29.737 Running I/O for 10 seconds... 00:17:39.702 00:17:39.702 Latency(us) 00:17:39.702 [2024-11-20T11:45:12.810Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.702 [2024-11-20T11:45:12.810Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:39.702 Verification LBA range: start 0x0 length 0x2000 00:17:39.702 TLSTESTn1 : 10.02 3605.94 14.09 0.00 0.00 35435.35 5170.06 84662.80 00:17:39.702 [2024-11-20T11:45:12.810Z] =================================================================================================================== 00:17:39.702 [2024-11-20T11:45:12.810Z] Total : 3605.94 14.09 0.00 0.00 35435.35 5170.06 84662.80 00:17:39.702 0 00:17:39.702 12:45:12 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:39.702 12:45:12 -- target/tls.sh@223 -- # killprocess 3544173 00:17:39.702 12:45:12 -- common/autotest_common.sh@936 -- # '[' -z 3544173 ']' 00:17:39.702 12:45:12 -- common/autotest_common.sh@940 -- # kill -0 3544173 00:17:39.702 12:45:12 -- common/autotest_common.sh@941 -- # uname 00:17:39.702 12:45:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.702 12:45:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3544173 00:17:39.702 12:45:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:39.702 12:45:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:39.702 12:45:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3544173' 00:17:39.702 killing process with pid 3544173 00:17:39.702 12:45:12 -- common/autotest_common.sh@955 -- # kill 3544173 00:17:39.702 Received shutdown signal, test time was about 10.000000 seconds 00:17:39.702 00:17:39.702 Latency(us) 00:17:39.702 [2024-11-20T11:45:12.810Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.702 [2024-11-20T11:45:12.810Z] =================================================================================================================== 00:17:39.702 [2024-11-20T11:45:12.810Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:39.702 12:45:12 -- common/autotest_common.sh@960 -- # wait 3544173 00:17:39.960 12:45:13 -- target/tls.sh@224 -- # killprocess 3543956 00:17:39.960 12:45:13 -- common/autotest_common.sh@936 -- # '[' -z 3543956 ']' 00:17:39.960 12:45:13 -- common/autotest_common.sh@940 -- # kill -0 3543956 00:17:39.960 12:45:13 -- common/autotest_common.sh@941 -- # uname 00:17:39.960 12:45:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.960 12:45:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3543956 00:17:39.960 12:45:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:39.960 12:45:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:39.960 12:45:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3543956' 00:17:39.960 killing process with pid 3543956 00:17:39.960 12:45:13 -- common/autotest_common.sh@955 -- # kill 3543956 00:17:39.960 12:45:13 -- common/autotest_common.sh@960 -- # wait 3543956 00:17:40.526 12:45:13 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:17:40.526 12:45:13 -- target/tls.sh@227 -- # cleanup 00:17:40.526 12:45:13 -- target/tls.sh@15 -- # process_shm --id 0 00:17:40.526 12:45:13 -- common/autotest_common.sh@806 -- # type=--id 00:17:40.526 12:45:13 -- common/autotest_common.sh@807 -- # id=0 00:17:40.526 12:45:13 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:40.526 12:45:13 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:40.526 12:45:13 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:40.526 12:45:13 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:40.526 12:45:13 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:40.526 12:45:13 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:40.526 nvmf_trace.0 00:17:40.526 12:45:13 -- common/autotest_common.sh@821 -- # return 0 00:17:40.526 12:45:13 -- target/tls.sh@16 -- # killprocess 3544173 00:17:40.526 12:45:13 -- common/autotest_common.sh@936 -- # '[' -z 3544173 ']' 00:17:40.526 12:45:13 -- common/autotest_common.sh@940 -- # kill -0 3544173 00:17:40.526 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3544173) - No such process 00:17:40.526 12:45:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3544173 is not found' 00:17:40.526 Process with pid 3544173 is not found 00:17:40.526 12:45:13 -- target/tls.sh@17 -- # nvmftestfini 00:17:40.526 12:45:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:40.526 12:45:13 -- nvmf/common.sh@116 -- # sync 00:17:40.526 12:45:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:40.526 12:45:13 -- nvmf/common.sh@119 -- # set +e 00:17:40.526 12:45:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:40.526 12:45:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:40.526 rmmod nvme_tcp 00:17:40.526 rmmod nvme_fabrics 00:17:40.526 rmmod nvme_keyring 00:17:40.526 12:45:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:40.527 12:45:13 -- nvmf/common.sh@123 -- # set -e 00:17:40.527 12:45:13 -- nvmf/common.sh@124 -- # return 0 00:17:40.527 12:45:13 -- nvmf/common.sh@477 -- # '[' -n 3543956 ']' 00:17:40.527 12:45:13 -- nvmf/common.sh@478 -- # killprocess 3543956 00:17:40.527 12:45:13 -- common/autotest_common.sh@936 -- # '[' -z 3543956 ']' 00:17:40.527 12:45:13 -- common/autotest_common.sh@940 -- # kill -0 3543956 00:17:40.527 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3543956) - No such process 00:17:40.527 12:45:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3543956 is not found' 00:17:40.527 Process with pid 3543956 is not found 00:17:40.527 12:45:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:40.527 12:45:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:40.527 12:45:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:40.527 12:45:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:40.527 12:45:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:40.527 12:45:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:40.527 12:45:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:40.527 12:45:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.429 12:45:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:42.429 12:45:15 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.429 00:17:42.429 real 1m15.393s 00:17:42.429 user 1m54.963s 00:17:42.429 sys 0m25.987s 00:17:42.429 12:45:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:42.429 12:45:15 -- common/autotest_common.sh@10 -- # set +x 00:17:42.429 ************************************ 00:17:42.429 END TEST nvmf_tls 00:17:42.429 ************************************ 00:17:42.430 12:45:15 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:42.430 12:45:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:42.430 12:45:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:42.430 12:45:15 -- common/autotest_common.sh@10 -- # set +x 00:17:42.430 ************************************ 00:17:42.430 START TEST nvmf_fips 00:17:42.430 ************************************ 00:17:42.430 12:45:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:42.688 * Looking for test storage... 00:17:42.688 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:17:42.688 12:45:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:42.688 12:45:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:42.688 12:45:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:42.688 12:45:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:42.688 12:45:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:42.688 12:45:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:42.688 12:45:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:42.688 12:45:15 -- scripts/common.sh@335 -- # IFS=.-: 00:17:42.688 12:45:15 -- scripts/common.sh@335 -- # read -ra ver1 00:17:42.688 12:45:15 -- scripts/common.sh@336 -- # IFS=.-: 00:17:42.688 12:45:15 -- scripts/common.sh@336 -- # read -ra ver2 00:17:42.688 12:45:15 -- scripts/common.sh@337 -- # local 'op=<' 00:17:42.688 12:45:15 -- scripts/common.sh@339 -- # ver1_l=2 00:17:42.688 12:45:15 -- scripts/common.sh@340 -- # ver2_l=1 00:17:42.688 12:45:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:42.688 12:45:15 -- scripts/common.sh@343 -- # case "$op" in 00:17:42.688 12:45:15 -- scripts/common.sh@344 -- # : 1 00:17:42.688 12:45:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:42.688 12:45:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:42.688 12:45:15 -- scripts/common.sh@364 -- # decimal 1 00:17:42.688 12:45:15 -- scripts/common.sh@352 -- # local d=1 00:17:42.688 12:45:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:42.688 12:45:15 -- scripts/common.sh@354 -- # echo 1 00:17:42.688 12:45:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:42.688 12:45:15 -- scripts/common.sh@365 -- # decimal 2 00:17:42.688 12:45:15 -- scripts/common.sh@352 -- # local d=2 00:17:42.688 12:45:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:42.688 12:45:15 -- scripts/common.sh@354 -- # echo 2 00:17:42.688 12:45:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:42.688 12:45:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:42.688 12:45:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:42.688 12:45:15 -- scripts/common.sh@367 -- # return 0 00:17:42.688 12:45:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:42.688 12:45:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:42.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.688 --rc genhtml_branch_coverage=1 00:17:42.688 --rc genhtml_function_coverage=1 00:17:42.688 --rc genhtml_legend=1 00:17:42.688 --rc geninfo_all_blocks=1 00:17:42.688 --rc geninfo_unexecuted_blocks=1 00:17:42.688 00:17:42.688 ' 00:17:42.688 12:45:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:42.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.688 --rc genhtml_branch_coverage=1 00:17:42.688 --rc genhtml_function_coverage=1 00:17:42.688 --rc genhtml_legend=1 00:17:42.688 --rc geninfo_all_blocks=1 00:17:42.688 --rc geninfo_unexecuted_blocks=1 00:17:42.688 00:17:42.688 ' 00:17:42.688 12:45:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:42.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.688 --rc genhtml_branch_coverage=1 00:17:42.688 --rc genhtml_function_coverage=1 00:17:42.688 --rc genhtml_legend=1 00:17:42.688 --rc geninfo_all_blocks=1 00:17:42.688 --rc geninfo_unexecuted_blocks=1 00:17:42.688 00:17:42.688 ' 00:17:42.688 12:45:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:42.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.688 --rc genhtml_branch_coverage=1 00:17:42.688 --rc genhtml_function_coverage=1 00:17:42.688 --rc genhtml_legend=1 00:17:42.688 --rc geninfo_all_blocks=1 00:17:42.688 --rc geninfo_unexecuted_blocks=1 00:17:42.688 00:17:42.688 ' 00:17:42.688 12:45:15 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:42.688 12:45:15 -- nvmf/common.sh@7 -- # uname -s 00:17:42.688 12:45:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:42.688 12:45:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:42.688 12:45:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:42.688 12:45:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:42.688 12:45:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:42.688 12:45:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:42.688 12:45:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:42.688 12:45:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:42.688 12:45:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:42.688 12:45:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:42.688 12:45:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:42.688 12:45:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:42.688 12:45:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:42.688 12:45:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:42.688 12:45:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:42.688 12:45:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:42.688 12:45:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:42.688 12:45:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:42.688 12:45:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:42.688 12:45:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.688 12:45:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.688 12:45:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.688 12:45:15 -- paths/export.sh@5 -- # export PATH 00:17:42.688 12:45:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.688 12:45:15 -- nvmf/common.sh@46 -- # : 0 00:17:42.688 12:45:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:42.688 12:45:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:42.688 12:45:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:42.688 12:45:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:42.688 12:45:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:42.688 12:45:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:42.688 12:45:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:42.688 12:45:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:42.688 12:45:15 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:42.688 12:45:15 -- fips/fips.sh@89 -- # check_openssl_version 00:17:42.688 12:45:15 -- fips/fips.sh@83 -- # local target=3.0.0 00:17:42.688 12:45:15 -- fips/fips.sh@85 -- # openssl version 00:17:42.689 12:45:15 -- fips/fips.sh@85 -- # awk '{print $2}' 00:17:42.689 12:45:15 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:17:42.689 12:45:15 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:17:42.689 12:45:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:42.689 12:45:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:42.689 12:45:15 -- scripts/common.sh@335 -- # IFS=.-: 00:17:42.689 12:45:15 -- scripts/common.sh@335 -- # read -ra ver1 00:17:42.689 12:45:15 -- scripts/common.sh@336 -- # IFS=.-: 00:17:42.689 12:45:15 -- scripts/common.sh@336 -- # read -ra ver2 00:17:42.689 12:45:15 -- scripts/common.sh@337 -- # local 'op=>=' 00:17:42.689 12:45:15 -- scripts/common.sh@339 -- # ver1_l=3 00:17:42.689 12:45:15 -- scripts/common.sh@340 -- # ver2_l=3 00:17:42.689 12:45:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:42.689 12:45:15 -- scripts/common.sh@343 -- # case "$op" in 00:17:42.689 12:45:15 -- scripts/common.sh@347 -- # : 1 00:17:42.689 12:45:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:42.689 12:45:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:42.689 12:45:15 -- scripts/common.sh@364 -- # decimal 3 00:17:42.689 12:45:15 -- scripts/common.sh@352 -- # local d=3 00:17:42.689 12:45:15 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:42.689 12:45:15 -- scripts/common.sh@354 -- # echo 3 00:17:42.689 12:45:15 -- scripts/common.sh@364 -- # ver1[v]=3 00:17:42.689 12:45:15 -- scripts/common.sh@365 -- # decimal 3 00:17:42.689 12:45:15 -- scripts/common.sh@352 -- # local d=3 00:17:42.689 12:45:15 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:42.689 12:45:15 -- scripts/common.sh@354 -- # echo 3 00:17:42.689 12:45:15 -- scripts/common.sh@365 -- # ver2[v]=3 00:17:42.689 12:45:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:42.689 12:45:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:42.689 12:45:15 -- scripts/common.sh@363 -- # (( v++ )) 00:17:42.689 12:45:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:42.689 12:45:15 -- scripts/common.sh@364 -- # decimal 1 00:17:42.689 12:45:15 -- scripts/common.sh@352 -- # local d=1 00:17:42.689 12:45:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:42.689 12:45:15 -- scripts/common.sh@354 -- # echo 1 00:17:42.689 12:45:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:42.689 12:45:15 -- scripts/common.sh@365 -- # decimal 0 00:17:42.689 12:45:15 -- scripts/common.sh@352 -- # local d=0 00:17:42.689 12:45:15 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:42.689 12:45:15 -- scripts/common.sh@354 -- # echo 0 00:17:42.689 12:45:15 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:42.689 12:45:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:42.689 12:45:15 -- scripts/common.sh@366 -- # return 0 00:17:42.689 12:45:15 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:17:42.689 12:45:15 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:42.689 12:45:15 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:17:42.689 12:45:15 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:42.689 12:45:15 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:42.689 12:45:15 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:17:42.689 12:45:15 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:17:42.689 12:45:15 -- fips/fips.sh@113 -- # build_openssl_config 00:17:42.689 12:45:15 -- fips/fips.sh@37 -- # cat 00:17:42.689 12:45:15 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:17:42.689 12:45:15 -- fips/fips.sh@58 -- # cat - 00:17:42.689 12:45:15 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:42.689 12:45:15 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:17:42.689 12:45:15 -- fips/fips.sh@116 -- # mapfile -t providers 00:17:42.689 12:45:15 -- fips/fips.sh@116 -- # openssl list -providers 00:17:42.689 12:45:15 -- fips/fips.sh@116 -- # grep name 00:17:42.689 12:45:15 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:17:42.689 12:45:15 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:17:42.689 12:45:15 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:42.689 12:45:15 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:17:42.689 12:45:15 -- fips/fips.sh@127 -- # : 00:17:42.689 12:45:15 -- common/autotest_common.sh@650 -- # local es=0 00:17:42.689 12:45:15 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:42.689 12:45:15 -- common/autotest_common.sh@638 -- # local arg=openssl 00:17:42.689 12:45:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.689 12:45:15 -- common/autotest_common.sh@642 -- # type -t openssl 00:17:42.689 12:45:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.689 12:45:15 -- common/autotest_common.sh@644 -- # type -P openssl 00:17:42.689 12:45:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.689 12:45:15 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:17:42.689 12:45:15 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:17:42.689 12:45:15 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:17:42.946 Error setting digest 00:17:42.946 40B279195E7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:17:42.946 40B279195E7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:17:42.946 12:45:15 -- common/autotest_common.sh@653 -- # es=1 00:17:42.946 12:45:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:42.946 12:45:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:42.946 12:45:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:42.946 12:45:15 -- fips/fips.sh@130 -- # nvmftestinit 00:17:42.946 12:45:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:42.946 12:45:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:42.946 12:45:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:42.946 12:45:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:42.946 12:45:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:42.946 12:45:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.946 12:45:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:42.946 12:45:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.946 12:45:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:42.946 12:45:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:42.946 12:45:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:42.946 12:45:15 -- common/autotest_common.sh@10 -- # set +x 00:17:44.847 12:45:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:44.847 12:45:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:44.847 12:45:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:44.847 12:45:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:44.847 12:45:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:44.847 12:45:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:44.847 12:45:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:44.847 12:45:17 -- nvmf/common.sh@294 -- # net_devs=() 00:17:44.847 12:45:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:44.847 12:45:17 -- nvmf/common.sh@295 -- # e810=() 00:17:44.847 12:45:17 -- nvmf/common.sh@295 -- # local -ga e810 00:17:44.847 12:45:17 -- nvmf/common.sh@296 -- # x722=() 00:17:44.847 12:45:17 -- nvmf/common.sh@296 -- # local -ga x722 00:17:44.847 12:45:17 -- nvmf/common.sh@297 -- # mlx=() 00:17:44.847 12:45:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:44.847 12:45:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:44.847 12:45:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:44.847 12:45:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:44.847 12:45:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:44.847 12:45:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:44.847 12:45:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:44.847 12:45:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:44.847 12:45:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:44.847 12:45:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:44.848 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:44.848 12:45:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:44.848 12:45:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:44.848 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:44.848 12:45:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:44.848 12:45:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:44.848 12:45:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.848 12:45:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:44.848 12:45:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.848 12:45:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:44.848 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:44.848 12:45:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.848 12:45:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:44.848 12:45:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.848 12:45:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:44.848 12:45:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.848 12:45:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:44.848 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:44.848 12:45:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.848 12:45:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:44.848 12:45:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:44.848 12:45:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:44.848 12:45:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:44.848 12:45:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:44.848 12:45:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:44.848 12:45:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:44.848 12:45:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:44.848 12:45:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:44.848 12:45:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:44.848 12:45:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:44.848 12:45:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:44.848 12:45:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:44.848 12:45:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:44.848 12:45:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:44.848 12:45:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:44.848 12:45:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:44.848 12:45:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:44.848 12:45:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:44.848 12:45:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:44.848 12:45:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:44.848 12:45:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:44.848 12:45:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:44.848 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:44.848 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:17:44.848 00:17:44.848 --- 10.0.0.2 ping statistics --- 00:17:44.848 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.848 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:17:44.848 12:45:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:44.848 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:44.848 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.202 ms 00:17:44.848 00:17:44.848 --- 10.0.0.1 ping statistics --- 00:17:44.848 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.848 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:17:44.848 12:45:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:44.848 12:45:17 -- nvmf/common.sh@410 -- # return 0 00:17:44.848 12:45:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:44.848 12:45:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:44.848 12:45:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:44.848 12:45:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:44.848 12:45:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:44.848 12:45:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:44.848 12:45:17 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:17:44.848 12:45:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:44.848 12:45:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:44.848 12:45:17 -- common/autotest_common.sh@10 -- # set +x 00:17:44.848 12:45:17 -- nvmf/common.sh@469 -- # nvmfpid=3548158 00:17:44.848 12:45:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:44.848 12:45:17 -- nvmf/common.sh@470 -- # waitforlisten 3548158 00:17:44.848 12:45:17 -- common/autotest_common.sh@829 -- # '[' -z 3548158 ']' 00:17:44.848 12:45:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.848 12:45:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.848 12:45:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.848 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.848 12:45:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.848 12:45:17 -- common/autotest_common.sh@10 -- # set +x 00:17:45.107 [2024-11-20 12:45:18.022932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:45.107 [2024-11-20 12:45:18.023013] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:45.107 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.107 [2024-11-20 12:45:18.089463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.107 [2024-11-20 12:45:18.196908] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:45.107 [2024-11-20 12:45:18.197075] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:45.107 [2024-11-20 12:45:18.197108] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:45.107 [2024-11-20 12:45:18.197121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:45.107 [2024-11-20 12:45:18.197164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:46.042 12:45:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.042 12:45:18 -- common/autotest_common.sh@862 -- # return 0 00:17:46.042 12:45:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:46.042 12:45:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:46.042 12:45:18 -- common/autotest_common.sh@10 -- # set +x 00:17:46.042 12:45:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:46.042 12:45:18 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:17:46.042 12:45:18 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:46.042 12:45:18 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:46.042 12:45:18 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:46.042 12:45:18 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:46.042 12:45:18 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:46.042 12:45:18 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:46.042 12:45:18 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:46.299 [2024-11-20 12:45:19.225405] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:46.299 [2024-11-20 12:45:19.241419] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:46.299 [2024-11-20 12:45:19.241693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:46.299 malloc0 00:17:46.299 12:45:19 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:46.299 12:45:19 -- fips/fips.sh@147 -- # bdevperf_pid=3548320 00:17:46.299 12:45:19 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.299 12:45:19 -- fips/fips.sh@148 -- # waitforlisten 3548320 /var/tmp/bdevperf.sock 00:17:46.299 12:45:19 -- common/autotest_common.sh@829 -- # '[' -z 3548320 ']' 00:17:46.299 12:45:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.299 12:45:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:46.299 12:45:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.299 12:45:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:46.299 12:45:19 -- common/autotest_common.sh@10 -- # set +x 00:17:46.299 [2024-11-20 12:45:19.358913] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:46.299 [2024-11-20 12:45:19.358993] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3548320 ] 00:17:46.299 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.556 [2024-11-20 12:45:19.416412] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.557 [2024-11-20 12:45:19.519158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.490 12:45:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.490 12:45:20 -- common/autotest_common.sh@862 -- # return 0 00:17:47.490 12:45:20 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:47.490 [2024-11-20 12:45:20.527535] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.748 TLSTESTn1 00:17:47.748 12:45:20 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:47.748 Running I/O for 10 seconds... 00:17:57.716 00:17:57.716 Latency(us) 00:17:57.716 [2024-11-20T11:45:30.824Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.716 [2024-11-20T11:45:30.824Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:57.716 Verification LBA range: start 0x0 length 0x2000 00:17:57.716 TLSTESTn1 : 10.02 4389.05 17.14 0.00 0.00 29122.87 6699.24 43496.49 00:17:57.716 [2024-11-20T11:45:30.824Z] =================================================================================================================== 00:17:57.716 [2024-11-20T11:45:30.824Z] Total : 4389.05 17.14 0.00 0.00 29122.87 6699.24 43496.49 00:17:57.716 0 00:17:57.716 12:45:30 -- fips/fips.sh@1 -- # cleanup 00:17:57.716 12:45:30 -- fips/fips.sh@15 -- # process_shm --id 0 00:17:57.716 12:45:30 -- common/autotest_common.sh@806 -- # type=--id 00:17:57.716 12:45:30 -- common/autotest_common.sh@807 -- # id=0 00:17:57.716 12:45:30 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:57.716 12:45:30 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:57.716 12:45:30 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:57.716 12:45:30 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:57.716 12:45:30 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:57.716 12:45:30 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:57.716 nvmf_trace.0 00:17:57.975 12:45:30 -- common/autotest_common.sh@821 -- # return 0 00:17:57.975 12:45:30 -- fips/fips.sh@16 -- # killprocess 3548320 00:17:57.975 12:45:30 -- common/autotest_common.sh@936 -- # '[' -z 3548320 ']' 00:17:57.975 12:45:30 -- common/autotest_common.sh@940 -- # kill -0 3548320 00:17:57.975 12:45:30 -- common/autotest_common.sh@941 -- # uname 00:17:57.975 12:45:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:57.975 12:45:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3548320 00:17:57.975 12:45:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:57.975 12:45:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:57.975 12:45:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3548320' 00:17:57.975 killing process with pid 3548320 00:17:57.975 12:45:30 -- common/autotest_common.sh@955 -- # kill 3548320 00:17:57.975 Received shutdown signal, test time was about 10.000000 seconds 00:17:57.975 00:17:57.975 Latency(us) 00:17:57.975 [2024-11-20T11:45:31.083Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.975 [2024-11-20T11:45:31.083Z] =================================================================================================================== 00:17:57.975 [2024-11-20T11:45:31.083Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:57.975 12:45:30 -- common/autotest_common.sh@960 -- # wait 3548320 00:17:58.233 12:45:31 -- fips/fips.sh@17 -- # nvmftestfini 00:17:58.233 12:45:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:58.233 12:45:31 -- nvmf/common.sh@116 -- # sync 00:17:58.233 12:45:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:58.233 12:45:31 -- nvmf/common.sh@119 -- # set +e 00:17:58.233 12:45:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:58.233 12:45:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:58.233 rmmod nvme_tcp 00:17:58.233 rmmod nvme_fabrics 00:17:58.233 rmmod nvme_keyring 00:17:58.233 12:45:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:58.233 12:45:31 -- nvmf/common.sh@123 -- # set -e 00:17:58.233 12:45:31 -- nvmf/common.sh@124 -- # return 0 00:17:58.233 12:45:31 -- nvmf/common.sh@477 -- # '[' -n 3548158 ']' 00:17:58.233 12:45:31 -- nvmf/common.sh@478 -- # killprocess 3548158 00:17:58.233 12:45:31 -- common/autotest_common.sh@936 -- # '[' -z 3548158 ']' 00:17:58.233 12:45:31 -- common/autotest_common.sh@940 -- # kill -0 3548158 00:17:58.233 12:45:31 -- common/autotest_common.sh@941 -- # uname 00:17:58.233 12:45:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.233 12:45:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3548158 00:17:58.233 12:45:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:58.233 12:45:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:58.233 12:45:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3548158' 00:17:58.233 killing process with pid 3548158 00:17:58.233 12:45:31 -- common/autotest_common.sh@955 -- # kill 3548158 00:17:58.233 12:45:31 -- common/autotest_common.sh@960 -- # wait 3548158 00:17:58.491 12:45:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:58.491 12:45:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:58.491 12:45:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:58.491 12:45:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:58.491 12:45:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:58.491 12:45:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:58.491 12:45:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:58.491 12:45:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:01.028 12:45:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:01.028 12:45:33 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:01.028 00:18:01.028 real 0m18.003s 00:18:01.028 user 0m22.945s 00:18:01.028 sys 0m6.164s 00:18:01.028 12:45:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:01.028 12:45:33 -- common/autotest_common.sh@10 -- # set +x 00:18:01.028 ************************************ 00:18:01.028 END TEST nvmf_fips 00:18:01.028 ************************************ 00:18:01.028 12:45:33 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:01.028 12:45:33 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:01.028 12:45:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:01.028 12:45:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:01.028 12:45:33 -- common/autotest_common.sh@10 -- # set +x 00:18:01.028 ************************************ 00:18:01.028 START TEST nvmf_fuzz 00:18:01.028 ************************************ 00:18:01.028 12:45:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:01.028 * Looking for test storage... 00:18:01.028 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:01.028 12:45:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:01.028 12:45:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:01.028 12:45:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:01.028 12:45:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:01.028 12:45:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:01.029 12:45:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:01.029 12:45:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:01.029 12:45:33 -- scripts/common.sh@335 -- # IFS=.-: 00:18:01.029 12:45:33 -- scripts/common.sh@335 -- # read -ra ver1 00:18:01.029 12:45:33 -- scripts/common.sh@336 -- # IFS=.-: 00:18:01.029 12:45:33 -- scripts/common.sh@336 -- # read -ra ver2 00:18:01.029 12:45:33 -- scripts/common.sh@337 -- # local 'op=<' 00:18:01.029 12:45:33 -- scripts/common.sh@339 -- # ver1_l=2 00:18:01.029 12:45:33 -- scripts/common.sh@340 -- # ver2_l=1 00:18:01.029 12:45:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:01.029 12:45:33 -- scripts/common.sh@343 -- # case "$op" in 00:18:01.029 12:45:33 -- scripts/common.sh@344 -- # : 1 00:18:01.029 12:45:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:01.029 12:45:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:01.029 12:45:33 -- scripts/common.sh@364 -- # decimal 1 00:18:01.029 12:45:33 -- scripts/common.sh@352 -- # local d=1 00:18:01.029 12:45:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:01.029 12:45:33 -- scripts/common.sh@354 -- # echo 1 00:18:01.029 12:45:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:01.029 12:45:33 -- scripts/common.sh@365 -- # decimal 2 00:18:01.029 12:45:33 -- scripts/common.sh@352 -- # local d=2 00:18:01.029 12:45:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:01.029 12:45:33 -- scripts/common.sh@354 -- # echo 2 00:18:01.029 12:45:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:01.029 12:45:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:01.029 12:45:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:01.029 12:45:33 -- scripts/common.sh@367 -- # return 0 00:18:01.029 12:45:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:01.029 12:45:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:01.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.029 --rc genhtml_branch_coverage=1 00:18:01.029 --rc genhtml_function_coverage=1 00:18:01.029 --rc genhtml_legend=1 00:18:01.029 --rc geninfo_all_blocks=1 00:18:01.029 --rc geninfo_unexecuted_blocks=1 00:18:01.029 00:18:01.029 ' 00:18:01.029 12:45:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:01.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.029 --rc genhtml_branch_coverage=1 00:18:01.029 --rc genhtml_function_coverage=1 00:18:01.029 --rc genhtml_legend=1 00:18:01.029 --rc geninfo_all_blocks=1 00:18:01.029 --rc geninfo_unexecuted_blocks=1 00:18:01.029 00:18:01.029 ' 00:18:01.029 12:45:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:01.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.029 --rc genhtml_branch_coverage=1 00:18:01.029 --rc genhtml_function_coverage=1 00:18:01.029 --rc genhtml_legend=1 00:18:01.029 --rc geninfo_all_blocks=1 00:18:01.029 --rc geninfo_unexecuted_blocks=1 00:18:01.029 00:18:01.029 ' 00:18:01.029 12:45:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:01.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.029 --rc genhtml_branch_coverage=1 00:18:01.029 --rc genhtml_function_coverage=1 00:18:01.029 --rc genhtml_legend=1 00:18:01.029 --rc geninfo_all_blocks=1 00:18:01.029 --rc geninfo_unexecuted_blocks=1 00:18:01.029 00:18:01.029 ' 00:18:01.029 12:45:33 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:01.029 12:45:33 -- nvmf/common.sh@7 -- # uname -s 00:18:01.029 12:45:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:01.029 12:45:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:01.029 12:45:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:01.029 12:45:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:01.029 12:45:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:01.029 12:45:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:01.029 12:45:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:01.029 12:45:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:01.029 12:45:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:01.029 12:45:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:01.029 12:45:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:01.029 12:45:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:01.029 12:45:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:01.029 12:45:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:01.029 12:45:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:01.029 12:45:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:01.029 12:45:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:01.029 12:45:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:01.029 12:45:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:01.029 12:45:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.029 12:45:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.029 12:45:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.029 12:45:33 -- paths/export.sh@5 -- # export PATH 00:18:01.029 12:45:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.029 12:45:33 -- nvmf/common.sh@46 -- # : 0 00:18:01.029 12:45:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:01.029 12:45:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:01.029 12:45:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:01.029 12:45:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:01.029 12:45:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:01.029 12:45:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:01.029 12:45:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:01.029 12:45:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:01.029 12:45:33 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:01.029 12:45:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:01.029 12:45:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:01.029 12:45:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:01.029 12:45:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:01.029 12:45:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:01.029 12:45:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:01.029 12:45:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:01.029 12:45:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:01.029 12:45:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:01.029 12:45:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:01.029 12:45:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:01.029 12:45:33 -- common/autotest_common.sh@10 -- # set +x 00:18:02.930 12:45:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:02.930 12:45:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:02.930 12:45:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:02.930 12:45:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:02.930 12:45:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:02.930 12:45:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:02.930 12:45:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:02.930 12:45:35 -- nvmf/common.sh@294 -- # net_devs=() 00:18:02.930 12:45:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:02.930 12:45:35 -- nvmf/common.sh@295 -- # e810=() 00:18:02.930 12:45:35 -- nvmf/common.sh@295 -- # local -ga e810 00:18:02.930 12:45:35 -- nvmf/common.sh@296 -- # x722=() 00:18:02.930 12:45:35 -- nvmf/common.sh@296 -- # local -ga x722 00:18:02.930 12:45:35 -- nvmf/common.sh@297 -- # mlx=() 00:18:02.930 12:45:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:02.930 12:45:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:02.930 12:45:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:02.930 12:45:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:02.930 12:45:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:02.930 12:45:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.930 12:45:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:02.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:02.930 12:45:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.930 12:45:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:02.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:02.930 12:45:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:02.930 12:45:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.930 12:45:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.930 12:45:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.930 12:45:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.930 12:45:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:02.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:02.930 12:45:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.930 12:45:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.930 12:45:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.930 12:45:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.930 12:45:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.930 12:45:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:02.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:02.930 12:45:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.930 12:45:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:02.930 12:45:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:02.930 12:45:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:02.930 12:45:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:02.930 12:45:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:02.930 12:45:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:02.930 12:45:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:02.930 12:45:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:02.930 12:45:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:02.930 12:45:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:02.930 12:45:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:02.930 12:45:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:02.930 12:45:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:02.930 12:45:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:02.930 12:45:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:02.930 12:45:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:02.930 12:45:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:02.930 12:45:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:02.930 12:45:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:02.930 12:45:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:02.930 12:45:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:02.930 12:45:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:02.930 12:45:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:02.930 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:02.930 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:18:02.930 00:18:02.930 --- 10.0.0.2 ping statistics --- 00:18:02.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.930 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:18:02.930 12:45:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:02.930 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:02.930 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:18:02.930 00:18:02.930 --- 10.0.0.1 ping statistics --- 00:18:02.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.930 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:18:02.930 12:45:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:02.930 12:45:35 -- nvmf/common.sh@410 -- # return 0 00:18:02.930 12:45:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:02.930 12:45:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:02.930 12:45:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:02.930 12:45:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:02.930 12:45:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:02.930 12:45:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:02.930 12:45:36 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3551762 00:18:02.930 12:45:36 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:02.930 12:45:36 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:02.930 12:45:36 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3551762 00:18:02.930 12:45:36 -- common/autotest_common.sh@829 -- # '[' -z 3551762 ']' 00:18:02.930 12:45:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.930 12:45:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.930 12:45:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.930 12:45:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.930 12:45:36 -- common/autotest_common.sh@10 -- # set +x 00:18:04.304 12:45:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.304 12:45:37 -- common/autotest_common.sh@862 -- # return 0 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:04.304 12:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.304 12:45:37 -- common/autotest_common.sh@10 -- # set +x 00:18:04.304 12:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:04.304 12:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.304 12:45:37 -- common/autotest_common.sh@10 -- # set +x 00:18:04.304 Malloc0 00:18:04.304 12:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:04.304 12:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.304 12:45:37 -- common/autotest_common.sh@10 -- # set +x 00:18:04.304 12:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:04.304 12:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.304 12:45:37 -- common/autotest_common.sh@10 -- # set +x 00:18:04.304 12:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:04.304 12:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.304 12:45:37 -- common/autotest_common.sh@10 -- # set +x 00:18:04.304 12:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:04.304 12:45:37 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:36.444 Fuzzing completed. Shutting down the fuzz application 00:18:36.444 00:18:36.444 Dumping successful admin opcodes: 00:18:36.444 8, 9, 10, 24, 00:18:36.444 Dumping successful io opcodes: 00:18:36.444 0, 9, 00:18:36.444 NS: 0x200003aeff00 I/O qp, Total commands completed: 475580, total successful commands: 2748, random_seed: 3372497216 00:18:36.444 NS: 0x200003aeff00 admin qp, Total commands completed: 57232, total successful commands: 455, random_seed: 966350848 00:18:36.444 12:46:07 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:36.445 Fuzzing completed. Shutting down the fuzz application 00:18:36.445 00:18:36.445 Dumping successful admin opcodes: 00:18:36.445 24, 00:18:36.445 Dumping successful io opcodes: 00:18:36.445 00:18:36.445 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2225626382 00:18:36.445 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2225781462 00:18:36.445 12:46:09 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:36.445 12:46:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:36.445 12:46:09 -- common/autotest_common.sh@10 -- # set +x 00:18:36.445 12:46:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:36.445 12:46:09 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:36.445 12:46:09 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:36.445 12:46:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:36.445 12:46:09 -- nvmf/common.sh@116 -- # sync 00:18:36.445 12:46:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:36.445 12:46:09 -- nvmf/common.sh@119 -- # set +e 00:18:36.445 12:46:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:36.445 12:46:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:36.445 rmmod nvme_tcp 00:18:36.445 rmmod nvme_fabrics 00:18:36.445 rmmod nvme_keyring 00:18:36.445 12:46:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:36.445 12:46:09 -- nvmf/common.sh@123 -- # set -e 00:18:36.445 12:46:09 -- nvmf/common.sh@124 -- # return 0 00:18:36.445 12:46:09 -- nvmf/common.sh@477 -- # '[' -n 3551762 ']' 00:18:36.445 12:46:09 -- nvmf/common.sh@478 -- # killprocess 3551762 00:18:36.445 12:46:09 -- common/autotest_common.sh@936 -- # '[' -z 3551762 ']' 00:18:36.445 12:46:09 -- common/autotest_common.sh@940 -- # kill -0 3551762 00:18:36.445 12:46:09 -- common/autotest_common.sh@941 -- # uname 00:18:36.445 12:46:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:36.445 12:46:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3551762 00:18:36.445 12:46:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:36.445 12:46:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:36.445 12:46:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3551762' 00:18:36.445 killing process with pid 3551762 00:18:36.445 12:46:09 -- common/autotest_common.sh@955 -- # kill 3551762 00:18:36.445 12:46:09 -- common/autotest_common.sh@960 -- # wait 3551762 00:18:36.445 12:46:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:36.445 12:46:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:36.445 12:46:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:36.445 12:46:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:36.445 12:46:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:36.445 12:46:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:36.445 12:46:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:36.445 12:46:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:38.980 12:46:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:38.980 12:46:11 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:38.980 00:18:38.980 real 0m38.029s 00:18:38.980 user 0m52.532s 00:18:38.980 sys 0m14.792s 00:18:38.980 12:46:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:38.980 12:46:11 -- common/autotest_common.sh@10 -- # set +x 00:18:38.980 ************************************ 00:18:38.980 END TEST nvmf_fuzz 00:18:38.980 ************************************ 00:18:38.980 12:46:11 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:38.980 12:46:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:38.980 12:46:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:38.980 12:46:11 -- common/autotest_common.sh@10 -- # set +x 00:18:38.980 ************************************ 00:18:38.980 START TEST nvmf_multiconnection 00:18:38.980 ************************************ 00:18:38.980 12:46:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:38.980 * Looking for test storage... 00:18:38.980 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:38.980 12:46:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:38.980 12:46:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:38.980 12:46:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:38.980 12:46:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:38.980 12:46:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:38.980 12:46:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:38.980 12:46:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:38.980 12:46:11 -- scripts/common.sh@335 -- # IFS=.-: 00:18:38.980 12:46:11 -- scripts/common.sh@335 -- # read -ra ver1 00:18:38.980 12:46:11 -- scripts/common.sh@336 -- # IFS=.-: 00:18:38.980 12:46:11 -- scripts/common.sh@336 -- # read -ra ver2 00:18:38.980 12:46:11 -- scripts/common.sh@337 -- # local 'op=<' 00:18:38.980 12:46:11 -- scripts/common.sh@339 -- # ver1_l=2 00:18:38.980 12:46:11 -- scripts/common.sh@340 -- # ver2_l=1 00:18:38.980 12:46:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:38.980 12:46:11 -- scripts/common.sh@343 -- # case "$op" in 00:18:38.980 12:46:11 -- scripts/common.sh@344 -- # : 1 00:18:38.980 12:46:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:38.980 12:46:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:38.980 12:46:11 -- scripts/common.sh@364 -- # decimal 1 00:18:38.981 12:46:11 -- scripts/common.sh@352 -- # local d=1 00:18:38.981 12:46:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:38.981 12:46:11 -- scripts/common.sh@354 -- # echo 1 00:18:38.981 12:46:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:38.981 12:46:11 -- scripts/common.sh@365 -- # decimal 2 00:18:38.981 12:46:11 -- scripts/common.sh@352 -- # local d=2 00:18:38.981 12:46:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:38.981 12:46:11 -- scripts/common.sh@354 -- # echo 2 00:18:38.981 12:46:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:38.981 12:46:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:38.981 12:46:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:38.981 12:46:11 -- scripts/common.sh@367 -- # return 0 00:18:38.981 12:46:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:38.981 12:46:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:38.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.981 --rc genhtml_branch_coverage=1 00:18:38.981 --rc genhtml_function_coverage=1 00:18:38.981 --rc genhtml_legend=1 00:18:38.981 --rc geninfo_all_blocks=1 00:18:38.981 --rc geninfo_unexecuted_blocks=1 00:18:38.981 00:18:38.981 ' 00:18:38.981 12:46:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:38.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.981 --rc genhtml_branch_coverage=1 00:18:38.981 --rc genhtml_function_coverage=1 00:18:38.981 --rc genhtml_legend=1 00:18:38.981 --rc geninfo_all_blocks=1 00:18:38.981 --rc geninfo_unexecuted_blocks=1 00:18:38.981 00:18:38.981 ' 00:18:38.981 12:46:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:38.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.981 --rc genhtml_branch_coverage=1 00:18:38.981 --rc genhtml_function_coverage=1 00:18:38.981 --rc genhtml_legend=1 00:18:38.981 --rc geninfo_all_blocks=1 00:18:38.981 --rc geninfo_unexecuted_blocks=1 00:18:38.981 00:18:38.981 ' 00:18:38.981 12:46:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:38.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.981 --rc genhtml_branch_coverage=1 00:18:38.981 --rc genhtml_function_coverage=1 00:18:38.981 --rc genhtml_legend=1 00:18:38.981 --rc geninfo_all_blocks=1 00:18:38.981 --rc geninfo_unexecuted_blocks=1 00:18:38.981 00:18:38.981 ' 00:18:38.981 12:46:11 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:38.981 12:46:11 -- nvmf/common.sh@7 -- # uname -s 00:18:38.981 12:46:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:38.981 12:46:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:38.981 12:46:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:38.981 12:46:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:38.981 12:46:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:38.981 12:46:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:38.981 12:46:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:38.981 12:46:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:38.981 12:46:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:38.981 12:46:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:38.981 12:46:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:38.981 12:46:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:38.981 12:46:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:38.981 12:46:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:38.981 12:46:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:38.981 12:46:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:38.981 12:46:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:38.981 12:46:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:38.981 12:46:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:38.981 12:46:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.981 12:46:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.981 12:46:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.981 12:46:11 -- paths/export.sh@5 -- # export PATH 00:18:38.981 12:46:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.981 12:46:11 -- nvmf/common.sh@46 -- # : 0 00:18:38.981 12:46:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:38.981 12:46:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:38.981 12:46:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:38.981 12:46:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:38.981 12:46:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:38.981 12:46:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:38.981 12:46:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:38.981 12:46:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:38.981 12:46:11 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:38.981 12:46:11 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:38.981 12:46:11 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:38.981 12:46:11 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:38.981 12:46:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:38.981 12:46:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:38.981 12:46:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:38.981 12:46:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:38.981 12:46:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:38.981 12:46:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.981 12:46:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.981 12:46:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:38.981 12:46:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:38.981 12:46:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:38.981 12:46:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:38.981 12:46:11 -- common/autotest_common.sh@10 -- # set +x 00:18:40.885 12:46:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:40.885 12:46:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:40.885 12:46:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:40.885 12:46:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:40.885 12:46:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:40.885 12:46:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:40.885 12:46:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:40.885 12:46:13 -- nvmf/common.sh@294 -- # net_devs=() 00:18:40.885 12:46:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:40.885 12:46:13 -- nvmf/common.sh@295 -- # e810=() 00:18:40.885 12:46:13 -- nvmf/common.sh@295 -- # local -ga e810 00:18:40.885 12:46:13 -- nvmf/common.sh@296 -- # x722=() 00:18:40.885 12:46:13 -- nvmf/common.sh@296 -- # local -ga x722 00:18:40.885 12:46:13 -- nvmf/common.sh@297 -- # mlx=() 00:18:40.885 12:46:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:40.885 12:46:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:40.885 12:46:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:40.885 12:46:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:40.885 12:46:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:40.885 12:46:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.885 12:46:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:40.885 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:40.885 12:46:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.885 12:46:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:40.885 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:40.885 12:46:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:40.885 12:46:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:40.885 12:46:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.885 12:46:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.886 12:46:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.886 12:46:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.886 12:46:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:40.886 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:40.886 12:46:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.886 12:46:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.886 12:46:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.886 12:46:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.886 12:46:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.886 12:46:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:40.886 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:40.886 12:46:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.886 12:46:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:40.886 12:46:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:40.886 12:46:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:40.886 12:46:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:40.886 12:46:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:40.886 12:46:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:40.886 12:46:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:40.886 12:46:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:40.886 12:46:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:40.886 12:46:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:40.886 12:46:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:40.886 12:46:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:40.886 12:46:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:40.886 12:46:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:40.886 12:46:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:40.886 12:46:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:40.886 12:46:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:40.886 12:46:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:40.886 12:46:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:40.886 12:46:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:40.886 12:46:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:40.886 12:46:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:40.886 12:46:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:40.886 12:46:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:40.886 12:46:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:40.886 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:40.886 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:18:40.886 00:18:40.886 --- 10.0.0.2 ping statistics --- 00:18:40.886 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.886 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:18:40.886 12:46:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:40.886 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:40.886 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:18:40.886 00:18:40.886 --- 10.0.0.1 ping statistics --- 00:18:40.886 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.886 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:18:40.886 12:46:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:40.886 12:46:13 -- nvmf/common.sh@410 -- # return 0 00:18:40.886 12:46:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:40.886 12:46:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:40.886 12:46:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:40.886 12:46:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:40.886 12:46:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:40.886 12:46:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:40.886 12:46:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:40.886 12:46:13 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:40.886 12:46:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:40.886 12:46:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:40.886 12:46:13 -- common/autotest_common.sh@10 -- # set +x 00:18:40.886 12:46:13 -- nvmf/common.sh@469 -- # nvmfpid=3557644 00:18:40.886 12:46:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:40.886 12:46:13 -- nvmf/common.sh@470 -- # waitforlisten 3557644 00:18:40.886 12:46:13 -- common/autotest_common.sh@829 -- # '[' -z 3557644 ']' 00:18:40.886 12:46:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:40.886 12:46:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:40.886 12:46:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:40.886 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:40.886 12:46:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:40.886 12:46:13 -- common/autotest_common.sh@10 -- # set +x 00:18:40.886 [2024-11-20 12:46:13.966629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:40.886 [2024-11-20 12:46:13.966704] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:41.145 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.145 [2024-11-20 12:46:14.035956] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:41.145 [2024-11-20 12:46:14.159028] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:41.145 [2024-11-20 12:46:14.159219] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:41.145 [2024-11-20 12:46:14.159248] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:41.145 [2024-11-20 12:46:14.159260] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:41.145 [2024-11-20 12:46:14.159320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:41.145 [2024-11-20 12:46:14.159401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:41.145 [2024-11-20 12:46:14.159461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:41.145 [2024-11-20 12:46:14.159463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:42.078 12:46:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:42.078 12:46:14 -- common/autotest_common.sh@862 -- # return 0 00:18:42.078 12:46:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:42.078 12:46:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:42.078 12:46:14 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:42.078 12:46:14 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:42.078 12:46:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:14 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 [2024-11-20 12:46:14.968622] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:42.078 12:46:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:14 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:42.078 12:46:14 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.078 12:46:14 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:42.078 12:46:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:14 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 Malloc1 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 [2024-11-20 12:46:15.025541] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.078 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 Malloc2 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.078 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 Malloc3 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.078 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 Malloc4 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.078 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.078 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.078 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:42.078 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.078 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 Malloc5 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.337 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 Malloc6 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.337 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 Malloc7 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.337 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 Malloc8 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.337 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 Malloc9 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.337 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.337 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.337 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:42.337 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.337 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 Malloc10 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.596 12:46:15 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 Malloc11 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:18:42.596 12:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.596 12:46:15 -- common/autotest_common.sh@10 -- # set +x 00:18:42.596 12:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.596 12:46:15 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:42.596 12:46:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:42.596 12:46:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:43.162 12:46:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:18:43.162 12:46:16 -- common/autotest_common.sh@1187 -- # local i=0 00:18:43.162 12:46:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:43.162 12:46:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:43.162 12:46:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:45.060 12:46:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:45.060 12:46:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:45.060 12:46:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:18:45.060 12:46:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:45.060 12:46:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:45.060 12:46:18 -- common/autotest_common.sh@1197 -- # return 0 00:18:45.060 12:46:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:45.060 12:46:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:18:45.994 12:46:18 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:18:45.994 12:46:18 -- common/autotest_common.sh@1187 -- # local i=0 00:18:45.994 12:46:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:45.994 12:46:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:45.994 12:46:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:47.891 12:46:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:47.891 12:46:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:47.891 12:46:20 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:18:47.891 12:46:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:47.891 12:46:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:47.891 12:46:20 -- common/autotest_common.sh@1197 -- # return 0 00:18:47.891 12:46:20 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:47.891 12:46:20 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:18:48.457 12:46:21 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:18:48.457 12:46:21 -- common/autotest_common.sh@1187 -- # local i=0 00:18:48.457 12:46:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:48.457 12:46:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:48.457 12:46:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:50.984 12:46:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:50.984 12:46:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:50.984 12:46:23 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:18:50.984 12:46:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:50.984 12:46:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:50.984 12:46:23 -- common/autotest_common.sh@1197 -- # return 0 00:18:50.984 12:46:23 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:50.984 12:46:23 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:18:51.242 12:46:24 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:18:51.242 12:46:24 -- common/autotest_common.sh@1187 -- # local i=0 00:18:51.242 12:46:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:51.242 12:46:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:51.242 12:46:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:53.769 12:46:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:53.769 12:46:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:53.769 12:46:26 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:18:53.769 12:46:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:53.769 12:46:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:53.769 12:46:26 -- common/autotest_common.sh@1197 -- # return 0 00:18:53.769 12:46:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:53.769 12:46:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:18:54.027 12:46:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:18:54.027 12:46:26 -- common/autotest_common.sh@1187 -- # local i=0 00:18:54.027 12:46:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:54.027 12:46:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:54.027 12:46:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:55.923 12:46:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:55.923 12:46:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:55.923 12:46:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:18:55.923 12:46:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:55.923 12:46:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:55.923 12:46:28 -- common/autotest_common.sh@1197 -- # return 0 00:18:55.924 12:46:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:55.924 12:46:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:18:56.856 12:46:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:18:56.856 12:46:29 -- common/autotest_common.sh@1187 -- # local i=0 00:18:56.856 12:46:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:56.856 12:46:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:56.856 12:46:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:59.380 12:46:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:59.380 12:46:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:59.380 12:46:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:18:59.380 12:46:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:59.380 12:46:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:59.380 12:46:31 -- common/autotest_common.sh@1197 -- # return 0 00:18:59.380 12:46:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.380 12:46:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:18:59.637 12:46:32 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:18:59.637 12:46:32 -- common/autotest_common.sh@1187 -- # local i=0 00:18:59.637 12:46:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:59.637 12:46:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:59.637 12:46:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:02.163 12:46:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:02.163 12:46:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:02.163 12:46:34 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:02.163 12:46:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:02.163 12:46:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:02.163 12:46:34 -- common/autotest_common.sh@1197 -- # return 0 00:19:02.163 12:46:34 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.163 12:46:34 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:02.421 12:46:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:02.421 12:46:35 -- common/autotest_common.sh@1187 -- # local i=0 00:19:02.421 12:46:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:02.421 12:46:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:02.421 12:46:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:04.946 12:46:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:04.946 12:46:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:04.946 12:46:37 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:04.946 12:46:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:04.946 12:46:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:04.946 12:46:37 -- common/autotest_common.sh@1197 -- # return 0 00:19:04.946 12:46:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:04.946 12:46:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:05.204 12:46:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:05.204 12:46:38 -- common/autotest_common.sh@1187 -- # local i=0 00:19:05.204 12:46:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:05.204 12:46:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:05.204 12:46:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:07.730 12:46:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:07.730 12:46:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:07.730 12:46:40 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:07.730 12:46:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:07.730 12:46:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:07.730 12:46:40 -- common/autotest_common.sh@1197 -- # return 0 00:19:07.730 12:46:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:07.730 12:46:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:08.294 12:46:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:08.294 12:46:41 -- common/autotest_common.sh@1187 -- # local i=0 00:19:08.294 12:46:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:08.294 12:46:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:08.294 12:46:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:10.190 12:46:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:10.190 12:46:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:10.190 12:46:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:10.190 12:46:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:10.190 12:46:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:10.190 12:46:43 -- common/autotest_common.sh@1197 -- # return 0 00:19:10.190 12:46:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:10.190 12:46:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:11.123 12:46:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:11.123 12:46:44 -- common/autotest_common.sh@1187 -- # local i=0 00:19:11.123 12:46:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:11.123 12:46:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:11.123 12:46:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:13.110 12:46:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:13.110 12:46:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:13.110 12:46:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:13.110 12:46:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:13.110 12:46:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:13.110 12:46:46 -- common/autotest_common.sh@1197 -- # return 0 00:19:13.110 12:46:46 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:13.110 [global] 00:19:13.110 thread=1 00:19:13.110 invalidate=1 00:19:13.110 rw=read 00:19:13.110 time_based=1 00:19:13.110 runtime=10 00:19:13.110 ioengine=libaio 00:19:13.110 direct=1 00:19:13.110 bs=262144 00:19:13.110 iodepth=64 00:19:13.110 norandommap=1 00:19:13.110 numjobs=1 00:19:13.110 00:19:13.110 [job0] 00:19:13.110 filename=/dev/nvme0n1 00:19:13.110 [job1] 00:19:13.110 filename=/dev/nvme10n1 00:19:13.110 [job2] 00:19:13.110 filename=/dev/nvme1n1 00:19:13.110 [job3] 00:19:13.110 filename=/dev/nvme2n1 00:19:13.110 [job4] 00:19:13.110 filename=/dev/nvme3n1 00:19:13.110 [job5] 00:19:13.110 filename=/dev/nvme4n1 00:19:13.110 [job6] 00:19:13.110 filename=/dev/nvme5n1 00:19:13.110 [job7] 00:19:13.110 filename=/dev/nvme6n1 00:19:13.110 [job8] 00:19:13.110 filename=/dev/nvme7n1 00:19:13.110 [job9] 00:19:13.110 filename=/dev/nvme8n1 00:19:13.110 [job10] 00:19:13.110 filename=/dev/nvme9n1 00:19:13.110 Could not set queue depth (nvme0n1) 00:19:13.110 Could not set queue depth (nvme10n1) 00:19:13.110 Could not set queue depth (nvme1n1) 00:19:13.110 Could not set queue depth (nvme2n1) 00:19:13.110 Could not set queue depth (nvme3n1) 00:19:13.110 Could not set queue depth (nvme4n1) 00:19:13.110 Could not set queue depth (nvme5n1) 00:19:13.110 Could not set queue depth (nvme6n1) 00:19:13.110 Could not set queue depth (nvme7n1) 00:19:13.110 Could not set queue depth (nvme8n1) 00:19:13.110 Could not set queue depth (nvme9n1) 00:19:13.368 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:13.368 fio-3.35 00:19:13.368 Starting 11 threads 00:19:25.575 00:19:25.575 job0: (groupid=0, jobs=1): err= 0: pid=3562150: Wed Nov 20 12:46:56 2024 00:19:25.575 read: IOPS=546, BW=137MiB/s (143MB/s)(1378MiB/10092msec) 00:19:25.575 slat (usec): min=13, max=80398, avg=1600.64, stdev=5176.63 00:19:25.575 clat (msec): min=27, max=388, avg=115.51, stdev=44.65 00:19:25.575 lat (msec): min=30, max=448, avg=117.11, stdev=45.48 00:19:25.575 clat percentiles (msec): 00:19:25.575 | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 81], 00:19:25.575 | 30.00th=[ 88], 40.00th=[ 101], 50.00th=[ 114], 60.00th=[ 123], 00:19:25.575 | 70.00th=[ 131], 80.00th=[ 142], 90.00th=[ 161], 95.00th=[ 186], 00:19:25.575 | 99.00th=[ 321], 99.50th=[ 355], 99.90th=[ 380], 99.95th=[ 384], 00:19:25.575 | 99.99th=[ 388] 00:19:25.575 bw ( KiB/s): min=51200, max=211968, per=7.07%, avg=139424.40, stdev=37130.79, samples=20 00:19:25.575 iops : min= 200, max= 828, avg=544.55, stdev=145.07, samples=20 00:19:25.575 lat (msec) : 50=1.80%, 100=38.20%, 250=58.39%, 500=1.61% 00:19:25.575 cpu : usr=0.39%, sys=1.98%, ctx=1172, majf=0, minf=4097 00:19:25.575 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:25.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.575 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.575 issued rwts: total=5511,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.575 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.575 job1: (groupid=0, jobs=1): err= 0: pid=3562151: Wed Nov 20 12:46:56 2024 00:19:25.575 read: IOPS=684, BW=171MiB/s (180MB/s)(1729MiB/10098msec) 00:19:25.575 slat (usec): min=9, max=151488, avg=1373.40, stdev=5164.47 00:19:25.575 clat (msec): min=2, max=477, avg=91.97, stdev=50.00 00:19:25.575 lat (msec): min=2, max=477, avg=93.34, stdev=50.78 00:19:25.575 clat percentiles (msec): 00:19:25.575 | 1.00th=[ 16], 5.00th=[ 33], 10.00th=[ 47], 20.00th=[ 53], 00:19:25.575 | 30.00th=[ 58], 40.00th=[ 68], 50.00th=[ 82], 60.00th=[ 99], 00:19:25.575 | 70.00th=[ 112], 80.00th=[ 125], 90.00th=[ 157], 95.00th=[ 178], 00:19:25.575 | 99.00th=[ 279], 99.50th=[ 334], 99.90th=[ 376], 99.95th=[ 376], 00:19:25.575 | 99.99th=[ 477] 00:19:25.575 bw ( KiB/s): min=62339, max=312832, per=8.89%, avg=175412.05, stdev=74312.18, samples=20 00:19:25.575 iops : min= 243, max= 1222, avg=685.15, stdev=290.36, samples=20 00:19:25.575 lat (msec) : 4=0.03%, 10=0.35%, 20=1.36%, 50=13.53%, 100=46.32% 00:19:25.575 lat (msec) : 250=36.85%, 500=1.56% 00:19:25.575 cpu : usr=0.50%, sys=2.39%, ctx=1286, majf=0, minf=4097 00:19:25.575 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:25.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.575 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.575 issued rwts: total=6917,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.575 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.575 job2: (groupid=0, jobs=1): err= 0: pid=3562152: Wed Nov 20 12:46:56 2024 00:19:25.575 read: IOPS=641, BW=160MiB/s (168MB/s)(1619MiB/10096msec) 00:19:25.575 slat (usec): min=10, max=117677, avg=1266.61, stdev=5097.18 00:19:25.575 clat (usec): min=1745, max=427031, avg=98438.19, stdev=52332.08 00:19:25.575 lat (usec): min=1808, max=427063, avg=99704.80, stdev=53257.93 00:19:25.575 clat percentiles (msec): 00:19:25.575 | 1.00th=[ 7], 5.00th=[ 24], 10.00th=[ 36], 20.00th=[ 58], 00:19:25.575 | 30.00th=[ 68], 40.00th=[ 82], 50.00th=[ 99], 60.00th=[ 111], 00:19:25.575 | 70.00th=[ 122], 80.00th=[ 133], 90.00th=[ 157], 95.00th=[ 178], 00:19:25.575 | 99.00th=[ 305], 99.50th=[ 355], 99.90th=[ 384], 99.95th=[ 388], 00:19:25.575 | 99.99th=[ 426] 00:19:25.575 bw ( KiB/s): min=48128, max=250890, per=8.32%, avg=164045.15, stdev=55521.53, samples=20 00:19:25.575 iops : min= 188, max= 980, avg=640.75, stdev=216.87, samples=20 00:19:25.575 lat (msec) : 2=0.03%, 4=0.32%, 10=1.37%, 20=2.67%, 50=11.49% 00:19:25.575 lat (msec) : 100=35.01%, 250=47.55%, 500=1.54% 00:19:25.575 cpu : usr=0.31%, sys=2.28%, ctx=1358, majf=0, minf=4097 00:19:25.575 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:25.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.575 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.575 issued rwts: total=6475,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.575 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.575 job3: (groupid=0, jobs=1): err= 0: pid=3562153: Wed Nov 20 12:46:56 2024 00:19:25.575 read: IOPS=869, BW=217MiB/s (228MB/s)(2201MiB/10124msec) 00:19:25.575 slat (usec): min=11, max=109444, avg=916.11, stdev=3263.63 00:19:25.575 clat (msec): min=10, max=354, avg=72.61, stdev=35.87 00:19:25.575 lat (msec): min=10, max=358, avg=73.52, stdev=36.26 00:19:25.575 clat percentiles (msec): 00:19:25.575 | 1.00th=[ 28], 5.00th=[ 32], 10.00th=[ 33], 20.00th=[ 47], 00:19:25.575 | 30.00th=[ 54], 40.00th=[ 60], 50.00th=[ 67], 60.00th=[ 75], 00:19:25.575 | 70.00th=[ 83], 80.00th=[ 91], 90.00th=[ 116], 95.00th=[ 134], 00:19:25.575 | 99.00th=[ 176], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 355], 00:19:25.575 | 99.99th=[ 355] 00:19:25.575 bw ( KiB/s): min=119568, max=500758, per=11.34%, avg=223628.00, stdev=89254.16, samples=20 00:19:25.575 iops : min= 467, max= 1956, avg=873.50, stdev=348.61, samples=20 00:19:25.575 lat (msec) : 20=0.23%, 50=24.03%, 100=59.84%, 250=15.26%, 500=0.65% 00:19:25.575 cpu : usr=0.57%, sys=2.85%, ctx=1717, majf=0, minf=4097 00:19:25.575 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:25.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.575 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.575 issued rwts: total=8803,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.575 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.575 job4: (groupid=0, jobs=1): err= 0: pid=3562154: Wed Nov 20 12:46:56 2024 00:19:25.575 read: IOPS=757, BW=189MiB/s (198MB/s)(1911MiB/10094msec) 00:19:25.575 slat (usec): min=14, max=176294, avg=1198.31, stdev=4736.09 00:19:25.575 clat (msec): min=2, max=429, avg=83.25, stdev=51.02 00:19:25.575 lat (msec): min=2, max=435, avg=84.44, stdev=51.70 00:19:25.575 clat percentiles (msec): 00:19:25.575 | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 52], 00:19:25.575 | 30.00th=[ 59], 40.00th=[ 66], 50.00th=[ 73], 60.00th=[ 81], 00:19:25.575 | 70.00th=[ 90], 80.00th=[ 110], 90.00th=[ 138], 95.00th=[ 165], 00:19:25.575 | 99.00th=[ 284], 99.50th=[ 393], 99.90th=[ 409], 99.95th=[ 418], 00:19:25.575 | 99.99th=[ 430] 00:19:25.575 bw ( KiB/s): min=43944, max=376320, per=9.84%, avg=194002.40, stdev=83578.84, samples=20 00:19:25.575 iops : min= 171, max= 1470, avg=757.75, stdev=326.60, samples=20 00:19:25.575 lat (msec) : 4=0.04%, 10=0.05%, 20=1.15%, 50=17.50%, 100=56.90% 00:19:25.575 lat (msec) : 250=22.56%, 500=1.81% 00:19:25.575 cpu : usr=0.42%, sys=2.50%, ctx=1375, majf=0, minf=4097 00:19:25.575 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:25.575 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.575 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.575 issued rwts: total=7642,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.575 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.575 job5: (groupid=0, jobs=1): err= 0: pid=3562155: Wed Nov 20 12:46:56 2024 00:19:25.575 read: IOPS=617, BW=154MiB/s (162MB/s)(1562MiB/10122msec) 00:19:25.575 slat (usec): min=10, max=78202, avg=1314.14, stdev=4454.69 00:19:25.576 clat (usec): min=1922, max=363442, avg=102285.47, stdev=49252.08 00:19:25.576 lat (usec): min=1937, max=371417, avg=103599.61, stdev=50066.29 00:19:25.576 clat percentiles (msec): 00:19:25.576 | 1.00th=[ 17], 5.00th=[ 41], 10.00th=[ 52], 20.00th=[ 61], 00:19:25.576 | 30.00th=[ 69], 40.00th=[ 82], 50.00th=[ 99], 60.00th=[ 114], 00:19:25.576 | 70.00th=[ 126], 80.00th=[ 136], 90.00th=[ 150], 95.00th=[ 199], 00:19:25.576 | 99.00th=[ 257], 99.50th=[ 268], 99.90th=[ 351], 99.95th=[ 363], 00:19:25.576 | 99.99th=[ 363] 00:19:25.576 bw ( KiB/s): min=60806, max=285184, per=8.03%, avg=158290.55, stdev=63441.56, samples=20 00:19:25.576 iops : min= 237, max= 1114, avg=618.15, stdev=247.88, samples=20 00:19:25.576 lat (msec) : 2=0.03%, 4=0.06%, 10=0.48%, 20=0.69%, 50=7.70% 00:19:25.576 lat (msec) : 100=42.80%, 250=46.45%, 500=1.78% 00:19:25.576 cpu : usr=0.42%, sys=2.09%, ctx=1341, majf=0, minf=4097 00:19:25.576 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:25.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.576 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.576 issued rwts: total=6247,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.576 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.576 job6: (groupid=0, jobs=1): err= 0: pid=3562156: Wed Nov 20 12:46:56 2024 00:19:25.576 read: IOPS=553, BW=138MiB/s (145MB/s)(1397MiB/10095msec) 00:19:25.576 slat (usec): min=13, max=68312, avg=1758.69, stdev=4841.54 00:19:25.576 clat (msec): min=13, max=415, avg=113.78, stdev=47.04 00:19:25.576 lat (msec): min=13, max=415, avg=115.53, stdev=47.79 00:19:25.576 clat percentiles (msec): 00:19:25.576 | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 60], 20.00th=[ 77], 00:19:25.576 | 30.00th=[ 85], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 124], 00:19:25.576 | 70.00th=[ 132], 80.00th=[ 142], 90.00th=[ 159], 95.00th=[ 182], 00:19:25.576 | 99.00th=[ 317], 99.50th=[ 368], 99.90th=[ 397], 99.95th=[ 405], 00:19:25.576 | 99.99th=[ 414] 00:19:25.576 bw ( KiB/s): min=53141, max=295936, per=7.17%, avg=141338.50, stdev=53373.04, samples=20 00:19:25.576 iops : min= 207, max= 1156, avg=552.05, stdev=208.56, samples=20 00:19:25.576 lat (msec) : 20=0.02%, 50=5.16%, 100=33.10%, 250=60.35%, 500=1.38% 00:19:25.576 cpu : usr=0.36%, sys=2.03%, ctx=1119, majf=0, minf=3721 00:19:25.576 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:25.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.576 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.576 issued rwts: total=5586,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.576 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.576 job7: (groupid=0, jobs=1): err= 0: pid=3562157: Wed Nov 20 12:46:56 2024 00:19:25.576 read: IOPS=872, BW=218MiB/s (229MB/s)(2184MiB/10012msec) 00:19:25.576 slat (usec): min=13, max=139118, avg=989.10, stdev=3502.83 00:19:25.576 clat (msec): min=2, max=225, avg=72.31, stdev=41.85 00:19:25.576 lat (msec): min=2, max=225, avg=73.30, stdev=42.38 00:19:25.576 clat percentiles (msec): 00:19:25.576 | 1.00th=[ 14], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 30], 00:19:25.576 | 30.00th=[ 34], 40.00th=[ 48], 50.00th=[ 66], 60.00th=[ 84], 00:19:25.576 | 70.00th=[ 101], 80.00th=[ 117], 90.00th=[ 131], 95.00th=[ 142], 00:19:25.576 | 99.00th=[ 167], 99.50th=[ 180], 99.90th=[ 220], 99.95th=[ 220], 00:19:25.576 | 99.99th=[ 226] 00:19:25.576 bw ( KiB/s): min=119808, max=499736, per=11.25%, avg=221861.05, stdev=125580.39, samples=20 00:19:25.576 iops : min= 468, max= 1952, avg=866.60, stdev=490.48, samples=20 00:19:25.576 lat (msec) : 4=0.03%, 10=0.46%, 20=1.88%, 50=39.26%, 100=28.45% 00:19:25.576 lat (msec) : 250=29.92% 00:19:25.576 cpu : usr=0.68%, sys=2.86%, ctx=1661, majf=0, minf=4097 00:19:25.576 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:25.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.576 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.576 issued rwts: total=8734,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.576 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.576 job8: (groupid=0, jobs=1): err= 0: pid=3562158: Wed Nov 20 12:46:56 2024 00:19:25.576 read: IOPS=626, BW=157MiB/s (164MB/s)(1587MiB/10126msec) 00:19:25.576 slat (usec): min=14, max=73519, avg=1482.05, stdev=4505.22 00:19:25.576 clat (msec): min=12, max=345, avg=100.49, stdev=46.37 00:19:25.576 lat (msec): min=13, max=345, avg=101.97, stdev=47.09 00:19:25.576 clat percentiles (msec): 00:19:25.576 | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 56], 20.00th=[ 62], 00:19:25.576 | 30.00th=[ 68], 40.00th=[ 77], 50.00th=[ 91], 60.00th=[ 107], 00:19:25.576 | 70.00th=[ 118], 80.00th=[ 129], 90.00th=[ 150], 95.00th=[ 190], 00:19:25.576 | 99.00th=[ 259], 99.50th=[ 288], 99.90th=[ 330], 99.95th=[ 347], 00:19:25.576 | 99.99th=[ 347] 00:19:25.576 bw ( KiB/s): min=62850, max=265216, per=8.16%, avg=160887.05, stdev=59692.76, samples=20 00:19:25.576 iops : min= 245, max= 1036, avg=628.35, stdev=233.16, samples=20 00:19:25.576 lat (msec) : 20=0.03%, 50=2.80%, 100=53.65%, 250=41.71%, 500=1.81% 00:19:25.576 cpu : usr=0.33%, sys=2.26%, ctx=1207, majf=0, minf=4097 00:19:25.576 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:25.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.576 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.576 issued rwts: total=6349,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.576 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.576 job9: (groupid=0, jobs=1): err= 0: pid=3562159: Wed Nov 20 12:46:56 2024 00:19:25.576 read: IOPS=842, BW=211MiB/s (221MB/s)(2132MiB/10120msec) 00:19:25.576 slat (usec): min=11, max=175907, avg=990.70, stdev=4943.93 00:19:25.576 clat (msec): min=2, max=410, avg=74.88, stdev=48.87 00:19:25.576 lat (msec): min=2, max=414, avg=75.87, stdev=49.69 00:19:25.576 clat percentiles (msec): 00:19:25.576 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 27], 20.00th=[ 42], 00:19:25.576 | 30.00th=[ 51], 40.00th=[ 56], 50.00th=[ 61], 60.00th=[ 74], 00:19:25.576 | 70.00th=[ 90], 80.00th=[ 107], 90.00th=[ 129], 95.00th=[ 159], 00:19:25.576 | 99.00th=[ 255], 99.50th=[ 271], 99.90th=[ 317], 99.95th=[ 317], 00:19:25.576 | 99.99th=[ 409] 00:19:25.576 bw ( KiB/s): min=108327, max=333312, per=10.99%, avg=216634.85, stdev=67668.79, samples=20 00:19:25.576 iops : min= 423, max= 1302, avg=846.20, stdev=264.35, samples=20 00:19:25.576 lat (msec) : 4=0.83%, 10=2.57%, 20=4.26%, 50=21.32%, 100=47.67% 00:19:25.576 lat (msec) : 250=22.01%, 500=1.35% 00:19:25.576 cpu : usr=0.53%, sys=2.90%, ctx=1689, majf=0, minf=4097 00:19:25.576 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:25.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.576 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.576 issued rwts: total=8528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.576 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.576 job10: (groupid=0, jobs=1): err= 0: pid=3562160: Wed Nov 20 12:46:56 2024 00:19:25.576 read: IOPS=714, BW=179MiB/s (187MB/s)(1803MiB/10102msec) 00:19:25.576 slat (usec): min=9, max=104508, avg=874.20, stdev=3965.63 00:19:25.576 clat (usec): min=1338, max=351843, avg=88680.26, stdev=53333.69 00:19:25.576 lat (usec): min=1354, max=351898, avg=89554.46, stdev=54119.11 00:19:25.576 clat percentiles (msec): 00:19:25.576 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 20], 20.00th=[ 38], 00:19:25.576 | 30.00th=[ 63], 40.00th=[ 74], 50.00th=[ 87], 60.00th=[ 101], 00:19:25.576 | 70.00th=[ 115], 80.00th=[ 128], 90.00th=[ 148], 95.00th=[ 171], 00:19:25.576 | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 292], 99.95th=[ 292], 00:19:25.576 | 99.99th=[ 351] 00:19:25.576 bw ( KiB/s): min=62339, max=529920, per=9.28%, avg=182996.00, stdev=96963.42, samples=20 00:19:25.576 iops : min= 243, max= 2070, avg=714.70, stdev=378.79, samples=20 00:19:25.576 lat (msec) : 2=0.26%, 4=0.94%, 10=4.28%, 20=5.35%, 50=12.73% 00:19:25.576 lat (msec) : 100=36.57%, 250=38.28%, 500=1.58% 00:19:25.576 cpu : usr=0.35%, sys=2.12%, ctx=1713, majf=0, minf=4097 00:19:25.576 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:25.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.576 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:25.576 issued rwts: total=7213,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.576 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:25.576 00:19:25.576 Run status group 0 (all jobs): 00:19:25.576 READ: bw=1926MiB/s (2019MB/s), 137MiB/s-218MiB/s (143MB/s-229MB/s), io=19.0GiB (20.4GB), run=10012-10126msec 00:19:25.576 00:19:25.577 Disk stats (read/write): 00:19:25.577 nvme0n1: ios=10868/0, merge=0/0, ticks=1234608/0, in_queue=1234608, util=97.32% 00:19:25.577 nvme10n1: ios=13664/0, merge=0/0, ticks=1229252/0, in_queue=1229252, util=97.55% 00:19:25.577 nvme1n1: ios=12775/0, merge=0/0, ticks=1232250/0, in_queue=1232250, util=97.79% 00:19:25.577 nvme2n1: ios=17479/0, merge=0/0, ticks=1228673/0, in_queue=1228673, util=97.93% 00:19:25.577 nvme3n1: ios=15140/0, merge=0/0, ticks=1233460/0, in_queue=1233460, util=98.00% 00:19:25.577 nvme4n1: ios=12332/0, merge=0/0, ticks=1227849/0, in_queue=1227849, util=98.29% 00:19:25.577 nvme5n1: ios=11017/0, merge=0/0, ticks=1230458/0, in_queue=1230458, util=98.46% 00:19:25.577 nvme6n1: ios=17126/0, merge=0/0, ticks=1239101/0, in_queue=1239101, util=98.56% 00:19:25.577 nvme7n1: ios=12530/0, merge=0/0, ticks=1226176/0, in_queue=1226176, util=98.93% 00:19:25.577 nvme8n1: ios=16897/0, merge=0/0, ticks=1229225/0, in_queue=1229225, util=99.09% 00:19:25.577 nvme9n1: ios=14264/0, merge=0/0, ticks=1238114/0, in_queue=1238114, util=99.19% 00:19:25.577 12:46:56 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:25.577 [global] 00:19:25.577 thread=1 00:19:25.577 invalidate=1 00:19:25.577 rw=randwrite 00:19:25.577 time_based=1 00:19:25.577 runtime=10 00:19:25.577 ioengine=libaio 00:19:25.577 direct=1 00:19:25.577 bs=262144 00:19:25.577 iodepth=64 00:19:25.577 norandommap=1 00:19:25.577 numjobs=1 00:19:25.577 00:19:25.577 [job0] 00:19:25.577 filename=/dev/nvme0n1 00:19:25.577 [job1] 00:19:25.577 filename=/dev/nvme10n1 00:19:25.577 [job2] 00:19:25.577 filename=/dev/nvme1n1 00:19:25.577 [job3] 00:19:25.577 filename=/dev/nvme2n1 00:19:25.577 [job4] 00:19:25.577 filename=/dev/nvme3n1 00:19:25.577 [job5] 00:19:25.577 filename=/dev/nvme4n1 00:19:25.577 [job6] 00:19:25.577 filename=/dev/nvme5n1 00:19:25.577 [job7] 00:19:25.577 filename=/dev/nvme6n1 00:19:25.577 [job8] 00:19:25.577 filename=/dev/nvme7n1 00:19:25.577 [job9] 00:19:25.577 filename=/dev/nvme8n1 00:19:25.577 [job10] 00:19:25.577 filename=/dev/nvme9n1 00:19:25.577 Could not set queue depth (nvme0n1) 00:19:25.577 Could not set queue depth (nvme10n1) 00:19:25.577 Could not set queue depth (nvme1n1) 00:19:25.577 Could not set queue depth (nvme2n1) 00:19:25.577 Could not set queue depth (nvme3n1) 00:19:25.577 Could not set queue depth (nvme4n1) 00:19:25.577 Could not set queue depth (nvme5n1) 00:19:25.577 Could not set queue depth (nvme6n1) 00:19:25.577 Could not set queue depth (nvme7n1) 00:19:25.577 Could not set queue depth (nvme8n1) 00:19:25.577 Could not set queue depth (nvme9n1) 00:19:25.577 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.577 fio-3.35 00:19:25.577 Starting 11 threads 00:19:35.547 00:19:35.547 job0: (groupid=0, jobs=1): err= 0: pid=3563206: Wed Nov 20 12:47:07 2024 00:19:35.547 write: IOPS=605, BW=151MiB/s (159MB/s)(1530MiB/10112msec); 0 zone resets 00:19:35.547 slat (usec): min=15, max=58516, avg=1165.42, stdev=3094.60 00:19:35.547 clat (usec): min=1561, max=326504, avg=104560.21, stdev=61945.80 00:19:35.547 lat (usec): min=1615, max=326592, avg=105725.63, stdev=62571.16 00:19:35.547 clat percentiles (msec): 00:19:35.547 | 1.00th=[ 7], 5.00th=[ 18], 10.00th=[ 31], 20.00th=[ 47], 00:19:35.547 | 30.00th=[ 59], 40.00th=[ 82], 50.00th=[ 101], 60.00th=[ 115], 00:19:35.547 | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 194], 95.00th=[ 211], 00:19:35.547 | 99.00th=[ 275], 99.50th=[ 292], 99.90th=[ 317], 99.95th=[ 321], 00:19:35.547 | 99.99th=[ 326] 00:19:35.547 bw ( KiB/s): min=87040, max=332646, per=11.22%, avg=154995.90, stdev=73500.05, samples=20 00:19:35.547 iops : min= 340, max= 1299, avg=605.35, stdev=287.11, samples=20 00:19:35.547 lat (msec) : 2=0.02%, 4=0.23%, 10=1.57%, 20=4.07%, 50=20.17% 00:19:35.547 lat (msec) : 100=23.60%, 250=48.86%, 500=1.49% 00:19:35.547 cpu : usr=1.86%, sys=2.12%, ctx=3132, majf=0, minf=1 00:19:35.547 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:35.547 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.547 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.547 issued rwts: total=0,6119,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.547 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.547 job1: (groupid=0, jobs=1): err= 0: pid=3563222: Wed Nov 20 12:47:07 2024 00:19:35.547 write: IOPS=382, BW=95.7MiB/s (100MB/s)(975MiB/10191msec); 0 zone resets 00:19:35.547 slat (usec): min=19, max=69615, avg=2018.36, stdev=5260.04 00:19:35.547 clat (usec): min=1189, max=500536, avg=165128.77, stdev=84413.35 00:19:35.547 lat (usec): min=1224, max=500579, avg=167147.13, stdev=85668.21 00:19:35.547 clat percentiles (msec): 00:19:35.547 | 1.00th=[ 9], 5.00th=[ 33], 10.00th=[ 59], 20.00th=[ 88], 00:19:35.547 | 30.00th=[ 107], 40.00th=[ 136], 50.00th=[ 159], 60.00th=[ 180], 00:19:35.547 | 70.00th=[ 220], 80.00th=[ 247], 90.00th=[ 279], 95.00th=[ 300], 00:19:35.547 | 99.00th=[ 347], 99.50th=[ 368], 99.90th=[ 430], 99.95th=[ 502], 00:19:35.547 | 99.99th=[ 502] 00:19:35.547 bw ( KiB/s): min=51200, max=182784, per=7.11%, avg=98213.50, stdev=40524.88, samples=20 00:19:35.547 iops : min= 200, max= 714, avg=383.60, stdev=158.34, samples=20 00:19:35.548 lat (msec) : 2=0.13%, 4=0.33%, 10=0.72%, 20=1.33%, 50=6.05% 00:19:35.548 lat (msec) : 100=17.33%, 250=54.82%, 500=19.26%, 750=0.03% 00:19:35.548 cpu : usr=1.34%, sys=1.23%, ctx=1887, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,3900,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job2: (groupid=0, jobs=1): err= 0: pid=3563223: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=501, BW=125MiB/s (132MB/s)(1263MiB/10069msec); 0 zone resets 00:19:35.548 slat (usec): min=19, max=77851, avg=1594.18, stdev=4581.64 00:19:35.548 clat (usec): min=1744, max=382775, avg=125564.61, stdev=80128.27 00:19:35.548 lat (usec): min=1785, max=386025, avg=127158.79, stdev=81167.46 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 7], 5.00th=[ 18], 10.00th=[ 36], 20.00th=[ 56], 00:19:35.548 | 30.00th=[ 75], 40.00th=[ 92], 50.00th=[ 109], 60.00th=[ 131], 00:19:35.548 | 70.00th=[ 144], 80.00th=[ 197], 90.00th=[ 251], 95.00th=[ 288], 00:19:35.548 | 99.00th=[ 342], 99.50th=[ 351], 99.90th=[ 376], 99.95th=[ 380], 00:19:35.548 | 99.99th=[ 384] 00:19:35.548 bw ( KiB/s): min=46592, max=306075, per=9.24%, avg=127714.15, stdev=65065.52, samples=20 00:19:35.548 iops : min= 182, max= 1195, avg=498.80, stdev=254.11, samples=20 00:19:35.548 lat (msec) : 2=0.04%, 4=0.38%, 10=1.68%, 20=3.86%, 50=9.14% 00:19:35.548 lat (msec) : 100=29.55%, 250=45.36%, 500=9.99% 00:19:35.548 cpu : usr=1.34%, sys=1.88%, ctx=2351, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,5053,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job3: (groupid=0, jobs=1): err= 0: pid=3563224: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=388, BW=97.0MiB/s (102MB/s)(981MiB/10115msec); 0 zone resets 00:19:35.548 slat (usec): min=21, max=141733, avg=1894.33, stdev=5675.01 00:19:35.548 clat (msec): min=3, max=411, avg=162.97, stdev=85.60 00:19:35.548 lat (msec): min=3, max=411, avg=164.86, stdev=86.83 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 12], 5.00th=[ 31], 10.00th=[ 45], 20.00th=[ 73], 00:19:35.548 | 30.00th=[ 120], 40.00th=[ 142], 50.00th=[ 163], 60.00th=[ 188], 00:19:35.548 | 70.00th=[ 205], 80.00th=[ 230], 90.00th=[ 275], 95.00th=[ 326], 00:19:35.548 | 99.00th=[ 363], 99.50th=[ 372], 99.90th=[ 384], 99.95th=[ 388], 00:19:35.548 | 99.99th=[ 414] 00:19:35.548 bw ( KiB/s): min=47104, max=252928, per=7.15%, avg=98848.70, stdev=43479.48, samples=20 00:19:35.548 iops : min= 184, max= 988, avg=386.10, stdev=169.85, samples=20 00:19:35.548 lat (msec) : 4=0.05%, 10=0.69%, 20=2.09%, 50=10.60%, 100=11.21% 00:19:35.548 lat (msec) : 250=61.86%, 500=13.50% 00:19:35.548 cpu : usr=1.32%, sys=1.37%, ctx=2012, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,3925,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job4: (groupid=0, jobs=1): err= 0: pid=3563225: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=609, BW=152MiB/s (160MB/s)(1552MiB/10189msec); 0 zone resets 00:19:35.548 slat (usec): min=16, max=50091, avg=838.39, stdev=3069.79 00:19:35.548 clat (usec): min=1113, max=502493, avg=104142.61, stdev=79588.20 00:19:35.548 lat (usec): min=1162, max=502575, avg=104981.00, stdev=80397.25 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 14], 20.00th=[ 27], 00:19:35.548 | 30.00th=[ 46], 40.00th=[ 73], 50.00th=[ 94], 60.00th=[ 117], 00:19:35.548 | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 266], 00:19:35.548 | 99.00th=[ 326], 99.50th=[ 347], 99.90th=[ 447], 99.95th=[ 489], 00:19:35.548 | 99.99th=[ 502] 00:19:35.548 bw ( KiB/s): min=61317, max=313344, per=11.38%, avg=157224.60, stdev=75117.16, samples=20 00:19:35.548 iops : min= 239, max= 1224, avg=614.05, stdev=293.50, samples=20 00:19:35.548 lat (msec) : 2=0.31%, 4=1.00%, 10=5.16%, 20=9.02%, 50=16.07% 00:19:35.548 lat (msec) : 100=20.95%, 250=41.72%, 500=5.75%, 750=0.03% 00:19:35.548 cpu : usr=1.83%, sys=2.30%, ctx=4302, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,6206,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job5: (groupid=0, jobs=1): err= 0: pid=3563226: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=488, BW=122MiB/s (128MB/s)(1245MiB/10191msec); 0 zone resets 00:19:35.548 slat (usec): min=24, max=52400, avg=1254.16, stdev=3975.95 00:19:35.548 clat (msec): min=2, max=424, avg=129.31, stdev=80.56 00:19:35.548 lat (msec): min=2, max=424, avg=130.57, stdev=81.72 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 10], 5.00th=[ 22], 10.00th=[ 37], 20.00th=[ 61], 00:19:35.548 | 30.00th=[ 82], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 126], 00:19:35.548 | 70.00th=[ 153], 80.00th=[ 213], 90.00th=[ 249], 95.00th=[ 284], 00:19:35.548 | 99.00th=[ 334], 99.50th=[ 342], 99.90th=[ 418], 99.95th=[ 422], 00:19:35.548 | 99.99th=[ 426] 00:19:35.548 bw ( KiB/s): min=51200, max=229888, per=9.10%, avg=125822.15, stdev=57912.89, samples=20 00:19:35.548 iops : min= 200, max= 898, avg=491.45, stdev=226.26, samples=20 00:19:35.548 lat (msec) : 4=0.06%, 10=1.08%, 20=3.07%, 50=10.62%, 100=25.05% 00:19:35.548 lat (msec) : 250=50.21%, 500=9.90% 00:19:35.548 cpu : usr=1.41%, sys=1.75%, ctx=3072, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,4979,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job6: (groupid=0, jobs=1): err= 0: pid=3563227: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=511, BW=128MiB/s (134MB/s)(1302MiB/10186msec); 0 zone resets 00:19:35.548 slat (usec): min=16, max=48018, avg=1605.96, stdev=3980.90 00:19:35.548 clat (usec): min=1241, max=448482, avg=123522.94, stdev=80128.41 00:19:35.548 lat (usec): min=1401, max=448544, avg=125128.89, stdev=81245.46 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 37], 20.00th=[ 54], 00:19:35.548 | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 104], 60.00th=[ 128], 00:19:35.548 | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 251], 95.00th=[ 284], 00:19:35.548 | 99.00th=[ 342], 99.50th=[ 351], 99.90th=[ 430], 99.95th=[ 435], 00:19:35.548 | 99.99th=[ 447] 00:19:35.548 bw ( KiB/s): min=51200, max=279552, per=9.53%, avg=131669.10, stdev=68516.49, samples=20 00:19:35.548 iops : min= 200, max= 1092, avg=514.30, stdev=267.67, samples=20 00:19:35.548 lat (msec) : 2=0.08%, 4=0.46%, 10=1.92%, 20=3.38%, 50=12.94% 00:19:35.548 lat (msec) : 100=29.77%, 250=41.19%, 500=10.26% 00:19:35.548 cpu : usr=1.51%, sys=1.81%, ctx=2261, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,5207,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job7: (groupid=0, jobs=1): err= 0: pid=3563228: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=636, BW=159MiB/s (167MB/s)(1601MiB/10070msec); 0 zone resets 00:19:35.548 slat (usec): min=18, max=55297, avg=883.46, stdev=2728.19 00:19:35.548 clat (usec): min=847, max=339296, avg=99699.98, stdev=61855.45 00:19:35.548 lat (usec): min=889, max=342978, avg=100583.44, stdev=62375.75 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 5], 5.00th=[ 11], 10.00th=[ 21], 20.00th=[ 41], 00:19:35.548 | 30.00th=[ 62], 40.00th=[ 79], 50.00th=[ 95], 60.00th=[ 113], 00:19:35.548 | 70.00th=[ 129], 80.00th=[ 144], 90.00th=[ 192], 95.00th=[ 215], 00:19:35.548 | 99.00th=[ 253], 99.50th=[ 271], 99.90th=[ 321], 99.95th=[ 334], 00:19:35.548 | 99.99th=[ 338] 00:19:35.548 bw ( KiB/s): min=80384, max=282624, per=11.75%, avg=162332.80, stdev=58917.45, samples=20 00:19:35.548 iops : min= 314, max= 1104, avg=634.05, stdev=230.20, samples=20 00:19:35.548 lat (usec) : 1000=0.05% 00:19:35.548 lat (msec) : 2=0.23%, 4=0.59%, 10=3.86%, 20=5.11%, 50=15.57% 00:19:35.548 lat (msec) : 100=27.21%, 250=46.32%, 500=1.06% 00:19:35.548 cpu : usr=1.83%, sys=2.23%, ctx=4028, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.548 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.548 issued rwts: total=0,6405,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.548 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.548 job8: (groupid=0, jobs=1): err= 0: pid=3563229: Wed Nov 20 12:47:07 2024 00:19:35.548 write: IOPS=363, BW=90.9MiB/s (95.3MB/s)(919MiB/10114msec); 0 zone resets 00:19:35.548 slat (usec): min=18, max=82881, avg=2164.08, stdev=5684.25 00:19:35.548 clat (usec): min=1317, max=366298, avg=173771.50, stdev=85042.59 00:19:35.548 lat (usec): min=1417, max=366386, avg=175935.59, stdev=86265.49 00:19:35.548 clat percentiles (msec): 00:19:35.548 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 42], 20.00th=[ 91], 00:19:35.548 | 30.00th=[ 132], 40.00th=[ 165], 50.00th=[ 184], 60.00th=[ 199], 00:19:35.548 | 70.00th=[ 220], 80.00th=[ 247], 90.00th=[ 279], 95.00th=[ 321], 00:19:35.548 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 359], 99.95th=[ 363], 00:19:35.548 | 99.99th=[ 368] 00:19:35.548 bw ( KiB/s): min=44032, max=203880, per=6.69%, avg=92466.85, stdev=39391.73, samples=20 00:19:35.548 iops : min= 172, max= 796, avg=361.15, stdev=153.84, samples=20 00:19:35.548 lat (msec) : 2=0.11%, 4=0.30%, 10=0.95%, 20=3.35%, 50=6.28% 00:19:35.548 lat (msec) : 100=10.66%, 250=60.09%, 500=18.25% 00:19:35.548 cpu : usr=1.30%, sys=1.18%, ctx=1835, majf=0, minf=1 00:19:35.548 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:19:35.548 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.549 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.549 issued rwts: total=0,3676,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.549 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.549 job9: (groupid=0, jobs=1): err= 0: pid=3563230: Wed Nov 20 12:47:07 2024 00:19:35.549 write: IOPS=535, BW=134MiB/s (140MB/s)(1345MiB/10041msec); 0 zone resets 00:19:35.549 slat (usec): min=21, max=220570, avg=1225.33, stdev=5011.44 00:19:35.549 clat (usec): min=1018, max=334154, avg=118117.49, stdev=84887.14 00:19:35.549 lat (usec): min=1096, max=334192, avg=119342.82, stdev=85905.10 00:19:35.549 clat percentiles (msec): 00:19:35.549 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 19], 20.00th=[ 38], 00:19:35.549 | 30.00th=[ 52], 40.00th=[ 79], 50.00th=[ 94], 60.00th=[ 131], 00:19:35.549 | 70.00th=[ 159], 80.00th=[ 215], 90.00th=[ 247], 95.00th=[ 266], 00:19:35.549 | 99.00th=[ 300], 99.50th=[ 313], 99.90th=[ 334], 99.95th=[ 334], 00:19:35.549 | 99.99th=[ 334] 00:19:35.549 bw ( KiB/s): min=53248, max=281088, per=9.85%, avg=136124.20, stdev=60483.46, samples=20 00:19:35.549 iops : min= 208, max= 1098, avg=531.70, stdev=236.30, samples=20 00:19:35.549 lat (msec) : 2=0.15%, 4=0.72%, 10=3.29%, 20=6.88%, 50=17.65% 00:19:35.549 lat (msec) : 100=23.68%, 250=39.03%, 500=8.60% 00:19:35.549 cpu : usr=1.76%, sys=1.99%, ctx=3168, majf=0, minf=1 00:19:35.549 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:35.549 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.549 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.549 issued rwts: total=0,5381,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.549 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.549 job10: (groupid=0, jobs=1): err= 0: pid=3563231: Wed Nov 20 12:47:07 2024 00:19:35.549 write: IOPS=409, BW=102MiB/s (107MB/s)(1041MiB/10183msec); 0 zone resets 00:19:35.549 slat (usec): min=24, max=98461, avg=1738.85, stdev=4981.77 00:19:35.549 clat (usec): min=934, max=482860, avg=154638.93, stdev=81167.98 00:19:35.549 lat (usec): min=1007, max=482922, avg=156377.78, stdev=82209.51 00:19:35.549 clat percentiles (msec): 00:19:35.549 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 36], 20.00th=[ 83], 00:19:35.549 | 30.00th=[ 112], 40.00th=[ 140], 50.00th=[ 153], 60.00th=[ 176], 00:19:35.549 | 70.00th=[ 197], 80.00th=[ 226], 90.00th=[ 257], 95.00th=[ 288], 00:19:35.549 | 99.00th=[ 334], 99.50th=[ 409], 99.90th=[ 468], 99.95th=[ 468], 00:19:35.549 | 99.99th=[ 485] 00:19:35.549 bw ( KiB/s): min=61440, max=165376, per=7.60%, avg=104991.40, stdev=35419.94, samples=20 00:19:35.549 iops : min= 240, max= 646, avg=410.10, stdev=138.37, samples=20 00:19:35.549 lat (usec) : 1000=0.05% 00:19:35.549 lat (msec) : 2=0.26%, 4=0.86%, 10=1.66%, 20=2.42%, 50=7.66% 00:19:35.549 lat (msec) : 100=11.31%, 250=64.30%, 500=11.48% 00:19:35.549 cpu : usr=1.30%, sys=1.41%, ctx=2252, majf=0, minf=1 00:19:35.549 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:19:35.549 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.549 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:35.549 issued rwts: total=0,4165,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.549 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:35.549 00:19:35.549 Run status group 0 (all jobs): 00:19:35.549 WRITE: bw=1350MiB/s (1415MB/s), 90.9MiB/s-159MiB/s (95.3MB/s-167MB/s), io=13.4GiB (14.4GB), run=10041-10191msec 00:19:35.549 00:19:35.549 Disk stats (read/write): 00:19:35.549 nvme0n1: ios=49/12046, merge=0/0, ticks=232/1218672, in_queue=1218904, util=98.10% 00:19:35.549 nvme10n1: ios=48/7772, merge=0/0, ticks=83/1242278, in_queue=1242361, util=97.94% 00:19:35.549 nvme1n1: ios=35/9870, merge=0/0, ticks=1409/1212602, in_queue=1214011, util=100.00% 00:19:35.549 nvme2n1: ios=0/7655, merge=0/0, ticks=0/1217539, in_queue=1217539, util=97.79% 00:19:35.549 nvme3n1: ios=33/12404, merge=0/0, ticks=678/1256647, in_queue=1257325, util=100.00% 00:19:35.549 nvme4n1: ios=45/9947, merge=0/0, ticks=1665/1247588, in_queue=1249253, util=100.00% 00:19:35.549 nvme5n1: ios=0/10410, merge=0/0, ticks=0/1242152, in_queue=1242152, util=98.39% 00:19:35.549 nvme6n1: ios=0/12573, merge=0/0, ticks=0/1231360, in_queue=1231360, util=98.46% 00:19:35.549 nvme7n1: ios=38/7159, merge=0/0, ticks=498/1213636, in_queue=1214134, util=100.00% 00:19:35.549 nvme8n1: ios=45/10447, merge=0/0, ticks=1771/1199243, in_queue=1201014, util=100.00% 00:19:35.549 nvme9n1: ios=0/8324, merge=0/0, ticks=0/1246882, in_queue=1246882, util=99.10% 00:19:35.549 12:47:07 -- target/multiconnection.sh@36 -- # sync 00:19:35.549 12:47:07 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:35.549 12:47:07 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.549 12:47:07 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:35.549 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:35.549 12:47:08 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:35.549 12:47:08 -- common/autotest_common.sh@1208 -- # local i=0 00:19:35.549 12:47:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:35.549 12:47:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:19:35.549 12:47:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:35.549 12:47:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:19:35.549 12:47:08 -- common/autotest_common.sh@1220 -- # return 0 00:19:35.549 12:47:08 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:35.549 12:47:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.549 12:47:08 -- common/autotest_common.sh@10 -- # set +x 00:19:35.549 12:47:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.549 12:47:08 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.549 12:47:08 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:35.549 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:35.549 12:47:08 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:35.549 12:47:08 -- common/autotest_common.sh@1208 -- # local i=0 00:19:35.549 12:47:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:35.549 12:47:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:19:35.549 12:47:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:35.549 12:47:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:19:35.549 12:47:08 -- common/autotest_common.sh@1220 -- # return 0 00:19:35.549 12:47:08 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:35.549 12:47:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.549 12:47:08 -- common/autotest_common.sh@10 -- # set +x 00:19:35.549 12:47:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.549 12:47:08 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.549 12:47:08 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:35.807 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:35.807 12:47:08 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:35.807 12:47:08 -- common/autotest_common.sh@1208 -- # local i=0 00:19:35.807 12:47:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:35.807 12:47:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:19:35.807 12:47:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:35.807 12:47:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:19:35.807 12:47:08 -- common/autotest_common.sh@1220 -- # return 0 00:19:35.807 12:47:08 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:35.807 12:47:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.807 12:47:08 -- common/autotest_common.sh@10 -- # set +x 00:19:35.807 12:47:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.807 12:47:08 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.807 12:47:08 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:36.065 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:36.065 12:47:08 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:36.065 12:47:08 -- common/autotest_common.sh@1208 -- # local i=0 00:19:36.065 12:47:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:36.065 12:47:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:19:36.065 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:36.065 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:19:36.065 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:36.065 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:36.065 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.065 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:36.065 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.065 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.065 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:36.065 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:36.065 12:47:09 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:36.066 12:47:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:36.066 12:47:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:36.066 12:47:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:19:36.066 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:36.066 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:19:36.323 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:36.323 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:36.323 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.323 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:36.323 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.323 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.323 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:36.323 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:36.323 12:47:09 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:36.323 12:47:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:36.323 12:47:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:36.323 12:47:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:19:36.323 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:36.323 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:19:36.323 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:36.323 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:36.323 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.323 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:36.323 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.323 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.323 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:36.581 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:36.582 12:47:09 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:36.582 12:47:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:36.582 12:47:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:36.582 12:47:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:19:36.582 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:36.582 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:19:36.582 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:36.582 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:36.582 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.582 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:36.582 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.582 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.582 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:36.582 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:36.582 12:47:09 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:36.582 12:47:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:36.582 12:47:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:36.582 12:47:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:19:36.582 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:36.582 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:19:36.840 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:36.840 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:36.840 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.840 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:36.840 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.840 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.840 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:36.840 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:36.840 12:47:09 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:36.840 12:47:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:36.840 12:47:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:36.840 12:47:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:19:36.840 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:36.840 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:19:36.840 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:36.840 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:36.840 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.840 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:36.840 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.840 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.840 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:37.099 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:37.099 12:47:09 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:37.099 12:47:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:37.099 12:47:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:37.099 12:47:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:19:37.099 12:47:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:37.099 12:47:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:19:37.099 12:47:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:37.099 12:47:09 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:37.099 12:47:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:37.099 12:47:09 -- common/autotest_common.sh@10 -- # set +x 00:19:37.099 12:47:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:37.099 12:47:09 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.099 12:47:09 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:37.099 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:37.099 12:47:10 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:37.099 12:47:10 -- common/autotest_common.sh@1208 -- # local i=0 00:19:37.099 12:47:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:37.099 12:47:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:19:37.099 12:47:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:37.099 12:47:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:19:37.099 12:47:10 -- common/autotest_common.sh@1220 -- # return 0 00:19:37.099 12:47:10 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:37.099 12:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:37.099 12:47:10 -- common/autotest_common.sh@10 -- # set +x 00:19:37.099 12:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:37.099 12:47:10 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:37.099 12:47:10 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:37.099 12:47:10 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:37.099 12:47:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:37.099 12:47:10 -- nvmf/common.sh@116 -- # sync 00:19:37.099 12:47:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:37.099 12:47:10 -- nvmf/common.sh@119 -- # set +e 00:19:37.099 12:47:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:37.099 12:47:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:37.099 rmmod nvme_tcp 00:19:37.099 rmmod nvme_fabrics 00:19:37.099 rmmod nvme_keyring 00:19:37.099 12:47:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:37.099 12:47:10 -- nvmf/common.sh@123 -- # set -e 00:19:37.099 12:47:10 -- nvmf/common.sh@124 -- # return 0 00:19:37.099 12:47:10 -- nvmf/common.sh@477 -- # '[' -n 3557644 ']' 00:19:37.099 12:47:10 -- nvmf/common.sh@478 -- # killprocess 3557644 00:19:37.099 12:47:10 -- common/autotest_common.sh@936 -- # '[' -z 3557644 ']' 00:19:37.099 12:47:10 -- common/autotest_common.sh@940 -- # kill -0 3557644 00:19:37.099 12:47:10 -- common/autotest_common.sh@941 -- # uname 00:19:37.099 12:47:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:37.099 12:47:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3557644 00:19:37.099 12:47:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:37.356 12:47:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:37.356 12:47:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3557644' 00:19:37.356 killing process with pid 3557644 00:19:37.356 12:47:10 -- common/autotest_common.sh@955 -- # kill 3557644 00:19:37.356 12:47:10 -- common/autotest_common.sh@960 -- # wait 3557644 00:19:37.926 12:47:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:37.926 12:47:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:37.926 12:47:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:37.926 12:47:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:37.926 12:47:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:37.926 12:47:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:37.926 12:47:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:37.926 12:47:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.829 12:47:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:39.829 00:19:39.829 real 1m1.204s 00:19:39.829 user 3m21.622s 00:19:39.829 sys 0m26.850s 00:19:39.829 12:47:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:39.829 12:47:12 -- common/autotest_common.sh@10 -- # set +x 00:19:39.829 ************************************ 00:19:39.829 END TEST nvmf_multiconnection 00:19:39.829 ************************************ 00:19:39.829 12:47:12 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:39.829 12:47:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:39.829 12:47:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:39.829 12:47:12 -- common/autotest_common.sh@10 -- # set +x 00:19:39.829 ************************************ 00:19:39.829 START TEST nvmf_initiator_timeout 00:19:39.830 ************************************ 00:19:39.830 12:47:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:39.830 * Looking for test storage... 00:19:39.830 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:39.830 12:47:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:39.830 12:47:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:39.830 12:47:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:40.088 12:47:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:40.088 12:47:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:40.088 12:47:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:40.088 12:47:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:40.088 12:47:12 -- scripts/common.sh@335 -- # IFS=.-: 00:19:40.088 12:47:12 -- scripts/common.sh@335 -- # read -ra ver1 00:19:40.088 12:47:12 -- scripts/common.sh@336 -- # IFS=.-: 00:19:40.088 12:47:12 -- scripts/common.sh@336 -- # read -ra ver2 00:19:40.088 12:47:12 -- scripts/common.sh@337 -- # local 'op=<' 00:19:40.088 12:47:12 -- scripts/common.sh@339 -- # ver1_l=2 00:19:40.088 12:47:12 -- scripts/common.sh@340 -- # ver2_l=1 00:19:40.088 12:47:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:40.088 12:47:12 -- scripts/common.sh@343 -- # case "$op" in 00:19:40.088 12:47:12 -- scripts/common.sh@344 -- # : 1 00:19:40.088 12:47:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:40.088 12:47:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:40.088 12:47:12 -- scripts/common.sh@364 -- # decimal 1 00:19:40.088 12:47:12 -- scripts/common.sh@352 -- # local d=1 00:19:40.088 12:47:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:40.088 12:47:12 -- scripts/common.sh@354 -- # echo 1 00:19:40.088 12:47:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:40.088 12:47:12 -- scripts/common.sh@365 -- # decimal 2 00:19:40.088 12:47:12 -- scripts/common.sh@352 -- # local d=2 00:19:40.088 12:47:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:40.088 12:47:12 -- scripts/common.sh@354 -- # echo 2 00:19:40.088 12:47:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:40.088 12:47:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:40.088 12:47:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:40.088 12:47:12 -- scripts/common.sh@367 -- # return 0 00:19:40.088 12:47:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:40.088 12:47:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:40.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:40.088 --rc genhtml_branch_coverage=1 00:19:40.088 --rc genhtml_function_coverage=1 00:19:40.088 --rc genhtml_legend=1 00:19:40.088 --rc geninfo_all_blocks=1 00:19:40.088 --rc geninfo_unexecuted_blocks=1 00:19:40.088 00:19:40.088 ' 00:19:40.088 12:47:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:40.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:40.088 --rc genhtml_branch_coverage=1 00:19:40.088 --rc genhtml_function_coverage=1 00:19:40.088 --rc genhtml_legend=1 00:19:40.088 --rc geninfo_all_blocks=1 00:19:40.088 --rc geninfo_unexecuted_blocks=1 00:19:40.088 00:19:40.088 ' 00:19:40.088 12:47:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:40.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:40.088 --rc genhtml_branch_coverage=1 00:19:40.088 --rc genhtml_function_coverage=1 00:19:40.088 --rc genhtml_legend=1 00:19:40.088 --rc geninfo_all_blocks=1 00:19:40.088 --rc geninfo_unexecuted_blocks=1 00:19:40.088 00:19:40.088 ' 00:19:40.088 12:47:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:40.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:40.088 --rc genhtml_branch_coverage=1 00:19:40.088 --rc genhtml_function_coverage=1 00:19:40.088 --rc genhtml_legend=1 00:19:40.088 --rc geninfo_all_blocks=1 00:19:40.088 --rc geninfo_unexecuted_blocks=1 00:19:40.088 00:19:40.088 ' 00:19:40.088 12:47:12 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:40.088 12:47:12 -- nvmf/common.sh@7 -- # uname -s 00:19:40.088 12:47:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:40.088 12:47:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:40.088 12:47:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:40.088 12:47:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:40.088 12:47:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:40.088 12:47:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:40.088 12:47:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:40.088 12:47:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:40.088 12:47:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:40.088 12:47:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:40.088 12:47:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:40.088 12:47:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:40.088 12:47:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:40.088 12:47:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:40.088 12:47:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:40.088 12:47:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:40.088 12:47:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:40.088 12:47:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:40.088 12:47:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:40.088 12:47:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:40.089 12:47:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:40.089 12:47:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:40.089 12:47:13 -- paths/export.sh@5 -- # export PATH 00:19:40.089 12:47:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:40.089 12:47:13 -- nvmf/common.sh@46 -- # : 0 00:19:40.089 12:47:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:40.089 12:47:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:40.089 12:47:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:40.089 12:47:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:40.089 12:47:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:40.089 12:47:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:40.089 12:47:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:40.089 12:47:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:40.089 12:47:13 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:40.089 12:47:13 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:40.089 12:47:13 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:40.089 12:47:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:40.089 12:47:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:40.089 12:47:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:40.089 12:47:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:40.089 12:47:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:40.089 12:47:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:40.089 12:47:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:40.089 12:47:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:40.089 12:47:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:40.089 12:47:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:40.089 12:47:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:40.089 12:47:13 -- common/autotest_common.sh@10 -- # set +x 00:19:41.991 12:47:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:41.991 12:47:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:41.991 12:47:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:41.991 12:47:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:41.991 12:47:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:41.991 12:47:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:41.991 12:47:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:41.991 12:47:15 -- nvmf/common.sh@294 -- # net_devs=() 00:19:41.991 12:47:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:41.991 12:47:15 -- nvmf/common.sh@295 -- # e810=() 00:19:41.991 12:47:15 -- nvmf/common.sh@295 -- # local -ga e810 00:19:41.991 12:47:15 -- nvmf/common.sh@296 -- # x722=() 00:19:41.991 12:47:15 -- nvmf/common.sh@296 -- # local -ga x722 00:19:41.991 12:47:15 -- nvmf/common.sh@297 -- # mlx=() 00:19:41.991 12:47:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:41.991 12:47:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:41.991 12:47:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:41.991 12:47:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:41.991 12:47:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:41.991 12:47:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:41.991 12:47:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:41.991 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:41.991 12:47:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:41.991 12:47:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:41.991 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:41.991 12:47:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:41.991 12:47:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:41.991 12:47:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.991 12:47:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:41.991 12:47:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.991 12:47:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:41.991 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:41.991 12:47:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.991 12:47:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:41.991 12:47:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.991 12:47:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:41.991 12:47:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.991 12:47:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:41.991 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:41.991 12:47:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.991 12:47:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:41.991 12:47:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:41.991 12:47:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:41.991 12:47:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:41.991 12:47:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:41.991 12:47:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:41.991 12:47:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:41.991 12:47:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:41.991 12:47:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:41.991 12:47:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:41.991 12:47:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:41.991 12:47:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:41.991 12:47:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:41.991 12:47:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:41.991 12:47:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:41.991 12:47:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:41.991 12:47:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:42.250 12:47:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:42.250 12:47:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:42.250 12:47:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:42.250 12:47:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:42.250 12:47:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:42.250 12:47:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:42.250 12:47:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:42.250 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:42.250 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:19:42.250 00:19:42.250 --- 10.0.0.2 ping statistics --- 00:19:42.250 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:42.250 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:19:42.250 12:47:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:42.250 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:42.250 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:19:42.250 00:19:42.250 --- 10.0.0.1 ping statistics --- 00:19:42.250 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:42.250 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:19:42.250 12:47:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:42.250 12:47:15 -- nvmf/common.sh@410 -- # return 0 00:19:42.250 12:47:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:42.250 12:47:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:42.250 12:47:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:42.250 12:47:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:42.250 12:47:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:42.250 12:47:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:42.250 12:47:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:42.250 12:47:15 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:42.250 12:47:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:42.250 12:47:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:42.250 12:47:15 -- common/autotest_common.sh@10 -- # set +x 00:19:42.250 12:47:15 -- nvmf/common.sh@469 -- # nvmfpid=3566639 00:19:42.251 12:47:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:42.251 12:47:15 -- nvmf/common.sh@470 -- # waitforlisten 3566639 00:19:42.251 12:47:15 -- common/autotest_common.sh@829 -- # '[' -z 3566639 ']' 00:19:42.251 12:47:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:42.251 12:47:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:42.251 12:47:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:42.251 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:42.251 12:47:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:42.251 12:47:15 -- common/autotest_common.sh@10 -- # set +x 00:19:42.251 [2024-11-20 12:47:15.283980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:42.251 [2024-11-20 12:47:15.284080] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:42.251 EAL: No free 2048 kB hugepages reported on node 1 00:19:42.251 [2024-11-20 12:47:15.354062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:42.510 [2024-11-20 12:47:15.473557] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:42.510 [2024-11-20 12:47:15.473717] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:42.510 [2024-11-20 12:47:15.473736] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:42.510 [2024-11-20 12:47:15.473751] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:42.510 [2024-11-20 12:47:15.473833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:42.510 [2024-11-20 12:47:15.473891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:42.510 [2024-11-20 12:47:15.473931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:42.510 [2024-11-20 12:47:15.473935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:43.447 12:47:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:43.447 12:47:16 -- common/autotest_common.sh@862 -- # return 0 00:19:43.447 12:47:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:43.447 12:47:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 12:47:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:43.447 12:47:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 Malloc0 00:19:43.447 12:47:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:19:43.447 12:47:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 Delay0 00:19:43.447 12:47:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:43.447 12:47:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 [2024-11-20 12:47:16.300910] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:43.447 12:47:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:43.447 12:47:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 12:47:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:19:43.447 12:47:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 12:47:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:43.447 12:47:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:43.447 12:47:16 -- common/autotest_common.sh@10 -- # set +x 00:19:43.447 [2024-11-20 12:47:16.329233] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:43.447 12:47:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:43.447 12:47:16 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:44.015 12:47:16 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:19:44.015 12:47:16 -- common/autotest_common.sh@1187 -- # local i=0 00:19:44.016 12:47:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:44.016 12:47:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:44.016 12:47:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.918 12:47:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.918 12:47:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.918 12:47:18 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:45.918 12:47:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.918 12:47:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.918 12:47:18 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.918 12:47:18 -- target/initiator_timeout.sh@35 -- # fio_pid=3567192 00:19:45.918 12:47:18 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:19:45.918 12:47:18 -- target/initiator_timeout.sh@37 -- # sleep 3 00:19:45.918 [global] 00:19:45.918 thread=1 00:19:45.918 invalidate=1 00:19:45.918 rw=write 00:19:45.918 time_based=1 00:19:45.918 runtime=60 00:19:45.918 ioengine=libaio 00:19:45.918 direct=1 00:19:45.918 bs=4096 00:19:45.918 iodepth=1 00:19:45.918 norandommap=0 00:19:45.918 numjobs=1 00:19:45.918 00:19:45.918 verify_dump=1 00:19:45.918 verify_backlog=512 00:19:45.918 verify_state_save=0 00:19:45.918 do_verify=1 00:19:45.918 verify=crc32c-intel 00:19:45.918 [job0] 00:19:45.918 filename=/dev/nvme0n1 00:19:45.918 Could not set queue depth (nvme0n1) 00:19:46.191 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:46.191 fio-3.35 00:19:46.191 Starting 1 thread 00:19:49.480 12:47:21 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:19:49.480 12:47:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.480 12:47:21 -- common/autotest_common.sh@10 -- # set +x 00:19:49.480 true 00:19:49.480 12:47:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.480 12:47:21 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:19:49.480 12:47:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.480 12:47:21 -- common/autotest_common.sh@10 -- # set +x 00:19:49.480 true 00:19:49.480 12:47:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.480 12:47:21 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:19:49.480 12:47:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.480 12:47:21 -- common/autotest_common.sh@10 -- # set +x 00:19:49.480 true 00:19:49.480 12:47:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.480 12:47:21 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:19:49.480 12:47:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.480 12:47:21 -- common/autotest_common.sh@10 -- # set +x 00:19:49.480 true 00:19:49.480 12:47:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.480 12:47:21 -- target/initiator_timeout.sh@45 -- # sleep 3 00:19:52.015 12:47:24 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:19:52.015 12:47:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.015 12:47:24 -- common/autotest_common.sh@10 -- # set +x 00:19:52.015 true 00:19:52.015 12:47:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.015 12:47:24 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:19:52.015 12:47:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.015 12:47:24 -- common/autotest_common.sh@10 -- # set +x 00:19:52.015 true 00:19:52.015 12:47:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.015 12:47:24 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:19:52.015 12:47:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.015 12:47:24 -- common/autotest_common.sh@10 -- # set +x 00:19:52.015 true 00:19:52.015 12:47:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.015 12:47:25 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:19:52.015 12:47:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.015 12:47:25 -- common/autotest_common.sh@10 -- # set +x 00:19:52.015 true 00:19:52.015 12:47:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.015 12:47:25 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:19:52.015 12:47:25 -- target/initiator_timeout.sh@54 -- # wait 3567192 00:20:48.304 00:20:48.304 job0: (groupid=0, jobs=1): err= 0: pid=3567261: Wed Nov 20 12:48:19 2024 00:20:48.304 read: IOPS=81, BW=327KiB/s (335kB/s)(19.2MiB/60025msec) 00:20:48.304 slat (usec): min=5, max=15555, avg=19.47, stdev=267.12 00:20:48.304 clat (usec): min=233, max=40887k, avg=11940.82, stdev=583551.84 00:20:48.304 lat (usec): min=239, max=40887k, avg=11960.29, stdev=583552.00 00:20:48.304 clat percentiles (usec): 00:20:48.304 | 1.00th=[ 265], 5.00th=[ 277], 10.00th=[ 281], 00:20:48.304 | 20.00th=[ 289], 30.00th=[ 297], 40.00th=[ 310], 00:20:48.304 | 50.00th=[ 318], 60.00th=[ 326], 70.00th=[ 334], 00:20:48.304 | 80.00th=[ 359], 90.00th=[ 506], 95.00th=[ 41157], 00:20:48.304 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41681], 00:20:48.304 | 99.95th=[ 43254], 99.99th=[17112761] 00:20:48.304 write: IOPS=85, BW=341KiB/s (349kB/s)(20.0MiB/60025msec); 0 zone resets 00:20:48.304 slat (usec): min=7, max=30084, avg=21.04, stdev=420.30 00:20:48.304 clat (usec): min=174, max=1031, avg=224.57, stdev=27.87 00:20:48.304 lat (usec): min=184, max=30323, avg=245.61, stdev=421.71 00:20:48.304 clat percentiles (usec): 00:20:48.304 | 1.00th=[ 184], 5.00th=[ 192], 10.00th=[ 196], 20.00th=[ 202], 00:20:48.304 | 30.00th=[ 208], 40.00th=[ 215], 50.00th=[ 223], 60.00th=[ 233], 00:20:48.304 | 70.00th=[ 237], 80.00th=[ 243], 90.00th=[ 251], 95.00th=[ 260], 00:20:48.304 | 99.00th=[ 310], 99.50th=[ 334], 99.90th=[ 408], 99.95th=[ 424], 00:20:48.304 | 99.99th=[ 1029] 00:20:48.304 bw ( KiB/s): min= 1544, max= 8192, per=100.00%, avg=5851.43, stdev=2365.29, samples=7 00:20:48.304 iops : min= 386, max= 2048, avg=1462.86, stdev=591.32, samples=7 00:20:48.304 lat (usec) : 250=46.01%, 500=49.00%, 750=0.93%, 1000=0.01% 00:20:48.304 lat (msec) : 2=0.07%, 4=0.01%, 50=3.96%, >=2000=0.01% 00:20:48.304 cpu : usr=0.20%, sys=0.32%, ctx=10035, majf=0, minf=1 00:20:48.304 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:48.304 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:48.304 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:48.304 issued rwts: total=4910,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:48.304 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:48.304 00:20:48.304 Run status group 0 (all jobs): 00:20:48.304 READ: bw=327KiB/s (335kB/s), 327KiB/s-327KiB/s (335kB/s-335kB/s), io=19.2MiB (20.1MB), run=60025-60025msec 00:20:48.304 WRITE: bw=341KiB/s (349kB/s), 341KiB/s-341KiB/s (349kB/s-349kB/s), io=20.0MiB (21.0MB), run=60025-60025msec 00:20:48.304 00:20:48.304 Disk stats (read/write): 00:20:48.304 nvme0n1: ios=4958/5120, merge=0/0, ticks=18799/1087, in_queue=19886, util=99.70% 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:48.304 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:48.304 12:48:19 -- common/autotest_common.sh@1208 -- # local i=0 00:20:48.304 12:48:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:48.304 12:48:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:48.304 12:48:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:48.304 12:48:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:48.304 12:48:19 -- common/autotest_common.sh@1220 -- # return 0 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:20:48.304 nvmf hotplug test: fio successful as expected 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:48.304 12:48:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:48.304 12:48:19 -- common/autotest_common.sh@10 -- # set +x 00:20:48.304 12:48:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:20:48.304 12:48:19 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:20:48.304 12:48:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:48.304 12:48:19 -- nvmf/common.sh@116 -- # sync 00:20:48.304 12:48:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:48.304 12:48:19 -- nvmf/common.sh@119 -- # set +e 00:20:48.304 12:48:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:48.304 12:48:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:48.304 rmmod nvme_tcp 00:20:48.304 rmmod nvme_fabrics 00:20:48.304 rmmod nvme_keyring 00:20:48.304 12:48:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:48.304 12:48:19 -- nvmf/common.sh@123 -- # set -e 00:20:48.304 12:48:19 -- nvmf/common.sh@124 -- # return 0 00:20:48.304 12:48:19 -- nvmf/common.sh@477 -- # '[' -n 3566639 ']' 00:20:48.304 12:48:19 -- nvmf/common.sh@478 -- # killprocess 3566639 00:20:48.304 12:48:19 -- common/autotest_common.sh@936 -- # '[' -z 3566639 ']' 00:20:48.304 12:48:19 -- common/autotest_common.sh@940 -- # kill -0 3566639 00:20:48.304 12:48:19 -- common/autotest_common.sh@941 -- # uname 00:20:48.304 12:48:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:48.304 12:48:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3566639 00:20:48.304 12:48:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:48.304 12:48:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:48.304 12:48:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3566639' 00:20:48.304 killing process with pid 3566639 00:20:48.304 12:48:19 -- common/autotest_common.sh@955 -- # kill 3566639 00:20:48.304 12:48:19 -- common/autotest_common.sh@960 -- # wait 3566639 00:20:48.304 12:48:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:48.304 12:48:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:48.304 12:48:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:48.304 12:48:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:48.304 12:48:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:48.304 12:48:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:48.304 12:48:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:48.304 12:48:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:48.874 12:48:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:48.874 00:20:48.874 real 1m9.002s 00:20:48.874 user 4m13.842s 00:20:48.874 sys 0m6.504s 00:20:48.874 12:48:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:48.874 12:48:21 -- common/autotest_common.sh@10 -- # set +x 00:20:48.874 ************************************ 00:20:48.874 END TEST nvmf_initiator_timeout 00:20:48.874 ************************************ 00:20:48.874 12:48:21 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:20:48.874 12:48:21 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:20:48.874 12:48:21 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:20:48.874 12:48:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:48.874 12:48:21 -- common/autotest_common.sh@10 -- # set +x 00:20:51.411 12:48:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:51.411 12:48:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:51.411 12:48:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:51.411 12:48:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:51.411 12:48:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:51.411 12:48:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:51.411 12:48:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:51.411 12:48:23 -- nvmf/common.sh@294 -- # net_devs=() 00:20:51.411 12:48:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:51.411 12:48:23 -- nvmf/common.sh@295 -- # e810=() 00:20:51.411 12:48:23 -- nvmf/common.sh@295 -- # local -ga e810 00:20:51.411 12:48:23 -- nvmf/common.sh@296 -- # x722=() 00:20:51.411 12:48:23 -- nvmf/common.sh@296 -- # local -ga x722 00:20:51.412 12:48:23 -- nvmf/common.sh@297 -- # mlx=() 00:20:51.412 12:48:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:51.412 12:48:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:51.412 12:48:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:51.412 12:48:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:51.412 12:48:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:51.412 12:48:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:51.412 12:48:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:51.412 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:51.412 12:48:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:51.412 12:48:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:51.412 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:51.412 12:48:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:51.412 12:48:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:51.412 12:48:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:51.412 12:48:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:51.412 12:48:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:51.412 12:48:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:51.412 12:48:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:51.412 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:51.412 12:48:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:51.412 12:48:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:51.412 12:48:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:51.412 12:48:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:51.412 12:48:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:51.412 12:48:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:51.412 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:51.412 12:48:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:51.412 12:48:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:51.412 12:48:23 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:51.412 12:48:23 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:20:51.412 12:48:23 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:20:51.412 12:48:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:51.412 12:48:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:51.412 12:48:23 -- common/autotest_common.sh@10 -- # set +x 00:20:51.412 ************************************ 00:20:51.412 START TEST nvmf_perf_adq 00:20:51.412 ************************************ 00:20:51.412 12:48:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:20:51.412 * Looking for test storage... 00:20:51.412 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:51.412 12:48:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:51.412 12:48:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:51.412 12:48:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:51.412 12:48:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:51.412 12:48:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:51.412 12:48:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:51.412 12:48:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:51.412 12:48:24 -- scripts/common.sh@335 -- # IFS=.-: 00:20:51.412 12:48:24 -- scripts/common.sh@335 -- # read -ra ver1 00:20:51.412 12:48:24 -- scripts/common.sh@336 -- # IFS=.-: 00:20:51.412 12:48:24 -- scripts/common.sh@336 -- # read -ra ver2 00:20:51.412 12:48:24 -- scripts/common.sh@337 -- # local 'op=<' 00:20:51.412 12:48:24 -- scripts/common.sh@339 -- # ver1_l=2 00:20:51.412 12:48:24 -- scripts/common.sh@340 -- # ver2_l=1 00:20:51.412 12:48:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:51.412 12:48:24 -- scripts/common.sh@343 -- # case "$op" in 00:20:51.412 12:48:24 -- scripts/common.sh@344 -- # : 1 00:20:51.412 12:48:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:51.412 12:48:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:51.412 12:48:24 -- scripts/common.sh@364 -- # decimal 1 00:20:51.412 12:48:24 -- scripts/common.sh@352 -- # local d=1 00:20:51.412 12:48:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:51.412 12:48:24 -- scripts/common.sh@354 -- # echo 1 00:20:51.412 12:48:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:51.412 12:48:24 -- scripts/common.sh@365 -- # decimal 2 00:20:51.412 12:48:24 -- scripts/common.sh@352 -- # local d=2 00:20:51.412 12:48:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:51.412 12:48:24 -- scripts/common.sh@354 -- # echo 2 00:20:51.412 12:48:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:51.412 12:48:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:51.412 12:48:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:51.412 12:48:24 -- scripts/common.sh@367 -- # return 0 00:20:51.412 12:48:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:51.412 12:48:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:51.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.412 --rc genhtml_branch_coverage=1 00:20:51.412 --rc genhtml_function_coverage=1 00:20:51.412 --rc genhtml_legend=1 00:20:51.412 --rc geninfo_all_blocks=1 00:20:51.412 --rc geninfo_unexecuted_blocks=1 00:20:51.412 00:20:51.412 ' 00:20:51.412 12:48:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:51.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.412 --rc genhtml_branch_coverage=1 00:20:51.412 --rc genhtml_function_coverage=1 00:20:51.412 --rc genhtml_legend=1 00:20:51.412 --rc geninfo_all_blocks=1 00:20:51.412 --rc geninfo_unexecuted_blocks=1 00:20:51.412 00:20:51.412 ' 00:20:51.412 12:48:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:51.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.412 --rc genhtml_branch_coverage=1 00:20:51.412 --rc genhtml_function_coverage=1 00:20:51.412 --rc genhtml_legend=1 00:20:51.412 --rc geninfo_all_blocks=1 00:20:51.412 --rc geninfo_unexecuted_blocks=1 00:20:51.412 00:20:51.412 ' 00:20:51.412 12:48:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:51.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:51.412 --rc genhtml_branch_coverage=1 00:20:51.412 --rc genhtml_function_coverage=1 00:20:51.412 --rc genhtml_legend=1 00:20:51.412 --rc geninfo_all_blocks=1 00:20:51.412 --rc geninfo_unexecuted_blocks=1 00:20:51.412 00:20:51.412 ' 00:20:51.412 12:48:24 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:51.412 12:48:24 -- nvmf/common.sh@7 -- # uname -s 00:20:51.412 12:48:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:51.412 12:48:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:51.412 12:48:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:51.412 12:48:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:51.412 12:48:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:51.412 12:48:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:51.412 12:48:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:51.412 12:48:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:51.412 12:48:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:51.412 12:48:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:51.412 12:48:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:51.412 12:48:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:51.412 12:48:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:51.412 12:48:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:51.412 12:48:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:51.412 12:48:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:51.412 12:48:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:51.412 12:48:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:51.412 12:48:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:51.412 12:48:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.412 12:48:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.412 12:48:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.412 12:48:24 -- paths/export.sh@5 -- # export PATH 00:20:51.412 12:48:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.412 12:48:24 -- nvmf/common.sh@46 -- # : 0 00:20:51.412 12:48:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:51.412 12:48:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:51.412 12:48:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:51.412 12:48:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:51.412 12:48:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:51.412 12:48:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:51.412 12:48:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:51.412 12:48:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:51.412 12:48:24 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:20:51.412 12:48:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:51.412 12:48:24 -- common/autotest_common.sh@10 -- # set +x 00:20:53.388 12:48:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:53.388 12:48:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:53.388 12:48:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:53.388 12:48:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:53.388 12:48:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:53.388 12:48:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:53.388 12:48:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:53.388 12:48:26 -- nvmf/common.sh@294 -- # net_devs=() 00:20:53.388 12:48:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:53.388 12:48:26 -- nvmf/common.sh@295 -- # e810=() 00:20:53.388 12:48:26 -- nvmf/common.sh@295 -- # local -ga e810 00:20:53.388 12:48:26 -- nvmf/common.sh@296 -- # x722=() 00:20:53.388 12:48:26 -- nvmf/common.sh@296 -- # local -ga x722 00:20:53.388 12:48:26 -- nvmf/common.sh@297 -- # mlx=() 00:20:53.388 12:48:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:53.388 12:48:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:53.388 12:48:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:53.388 12:48:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:53.388 12:48:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:53.388 12:48:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:53.388 12:48:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:53.388 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:53.388 12:48:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:53.388 12:48:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:53.388 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:53.388 12:48:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:53.388 12:48:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:53.388 12:48:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:53.388 12:48:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:53.388 12:48:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:53.388 12:48:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:53.388 12:48:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:53.388 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:53.388 12:48:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:53.388 12:48:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:53.388 12:48:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:53.388 12:48:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:53.388 12:48:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:53.388 12:48:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:53.388 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:53.388 12:48:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:53.388 12:48:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:53.388 12:48:26 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:53.388 12:48:26 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:20:53.388 12:48:26 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:20:53.388 12:48:26 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:20:53.388 12:48:26 -- target/perf_adq.sh@52 -- # rmmod ice 00:20:53.956 12:48:26 -- target/perf_adq.sh@53 -- # modprobe ice 00:20:56.495 12:48:29 -- target/perf_adq.sh@54 -- # sleep 5 00:21:01.783 12:48:34 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:01.783 12:48:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:01.783 12:48:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:01.783 12:48:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:01.783 12:48:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:01.783 12:48:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:01.783 12:48:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:01.783 12:48:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:01.783 12:48:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:01.783 12:48:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:01.783 12:48:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:01.783 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.783 12:48:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:01.783 12:48:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:01.783 12:48:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:01.783 12:48:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:01.783 12:48:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:01.783 12:48:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:01.783 12:48:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:01.783 12:48:34 -- nvmf/common.sh@294 -- # net_devs=() 00:21:01.783 12:48:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:01.783 12:48:34 -- nvmf/common.sh@295 -- # e810=() 00:21:01.783 12:48:34 -- nvmf/common.sh@295 -- # local -ga e810 00:21:01.783 12:48:34 -- nvmf/common.sh@296 -- # x722=() 00:21:01.783 12:48:34 -- nvmf/common.sh@296 -- # local -ga x722 00:21:01.783 12:48:34 -- nvmf/common.sh@297 -- # mlx=() 00:21:01.783 12:48:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:01.783 12:48:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:01.783 12:48:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:01.783 12:48:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:01.783 12:48:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:01.783 12:48:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:01.783 12:48:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:01.783 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:01.783 12:48:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:01.783 12:48:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:01.783 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:01.783 12:48:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:01.783 12:48:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:01.783 12:48:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:01.783 12:48:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:01.783 12:48:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:01.783 12:48:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:01.783 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:01.783 12:48:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:01.783 12:48:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:01.783 12:48:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:01.783 12:48:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:01.783 12:48:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:01.783 12:48:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:01.783 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:01.783 12:48:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:01.783 12:48:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:01.783 12:48:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:01.783 12:48:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:01.783 12:48:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:01.783 12:48:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:01.783 12:48:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:01.783 12:48:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:01.783 12:48:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:01.783 12:48:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:01.783 12:48:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:01.783 12:48:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:01.783 12:48:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:01.783 12:48:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:01.783 12:48:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:01.783 12:48:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:01.783 12:48:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:01.783 12:48:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:01.783 12:48:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:01.783 12:48:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:01.783 12:48:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:01.783 12:48:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:01.783 12:48:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:01.783 12:48:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:01.783 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:01.783 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:21:01.783 00:21:01.783 --- 10.0.0.2 ping statistics --- 00:21:01.783 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:01.783 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:21:01.783 12:48:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:01.783 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:01.783 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:21:01.783 00:21:01.783 --- 10.0.0.1 ping statistics --- 00:21:01.783 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:01.783 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:21:01.783 12:48:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:01.783 12:48:34 -- nvmf/common.sh@410 -- # return 0 00:21:01.783 12:48:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:01.783 12:48:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:01.783 12:48:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:01.783 12:48:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:01.783 12:48:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:01.783 12:48:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:01.783 12:48:34 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:01.783 12:48:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:01.783 12:48:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:01.783 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.783 12:48:34 -- nvmf/common.sh@469 -- # nvmfpid=3579817 00:21:01.784 12:48:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:01.784 12:48:34 -- nvmf/common.sh@470 -- # waitforlisten 3579817 00:21:01.784 12:48:34 -- common/autotest_common.sh@829 -- # '[' -z 3579817 ']' 00:21:01.784 12:48:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:01.784 12:48:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.784 12:48:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:01.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:01.784 12:48:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 [2024-11-20 12:48:34.399340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:01.784 [2024-11-20 12:48:34.399423] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:01.784 EAL: No free 2048 kB hugepages reported on node 1 00:21:01.784 [2024-11-20 12:48:34.468563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:01.784 [2024-11-20 12:48:34.574345] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:01.784 [2024-11-20 12:48:34.574527] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:01.784 [2024-11-20 12:48:34.574544] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:01.784 [2024-11-20 12:48:34.574556] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:01.784 [2024-11-20 12:48:34.574713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:01.784 [2024-11-20 12:48:34.574739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:01.784 [2024-11-20 12:48:34.574830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:01.784 [2024-11-20 12:48:34.574833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:01.784 12:48:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.784 12:48:34 -- common/autotest_common.sh@862 -- # return 0 00:21:01.784 12:48:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:01.784 12:48:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 12:48:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:01.784 12:48:34 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:01.784 12:48:34 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 [2024-11-20 12:48:34.768095] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 Malloc1 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:01.784 12:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:01.784 12:48:34 -- common/autotest_common.sh@10 -- # set +x 00:21:01.784 [2024-11-20 12:48:34.821517] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:01.784 12:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:01.784 12:48:34 -- target/perf_adq.sh@73 -- # perfpid=3579845 00:21:01.784 12:48:34 -- target/perf_adq.sh@74 -- # sleep 2 00:21:01.784 12:48:34 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:01.784 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.325 12:48:36 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:04.325 12:48:36 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:04.325 12:48:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:04.325 12:48:36 -- target/perf_adq.sh@76 -- # wc -l 00:21:04.325 12:48:36 -- common/autotest_common.sh@10 -- # set +x 00:21:04.325 12:48:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:04.325 12:48:36 -- target/perf_adq.sh@76 -- # count=4 00:21:04.325 12:48:36 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:04.325 12:48:36 -- target/perf_adq.sh@81 -- # wait 3579845 00:21:12.459 Initializing NVMe Controllers 00:21:12.459 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:12.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:12.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:12.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:12.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:12.459 Initialization complete. Launching workers. 00:21:12.459 ======================================================== 00:21:12.459 Latency(us) 00:21:12.459 Device Information : IOPS MiB/s Average min max 00:21:12.459 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11392.60 44.50 5617.76 1489.07 8830.06 00:21:12.459 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10581.80 41.34 6047.74 1515.80 10468.34 00:21:12.459 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10842.90 42.36 5904.01 1852.47 8670.94 00:21:12.459 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11275.90 44.05 5677.32 1452.65 9834.36 00:21:12.459 ======================================================== 00:21:12.459 Total : 44093.20 172.24 5806.58 1452.65 10468.34 00:21:12.459 00:21:12.459 12:48:44 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:12.459 12:48:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:12.459 12:48:44 -- nvmf/common.sh@116 -- # sync 00:21:12.459 12:48:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:12.459 12:48:44 -- nvmf/common.sh@119 -- # set +e 00:21:12.459 12:48:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:12.459 12:48:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:12.459 rmmod nvme_tcp 00:21:12.459 rmmod nvme_fabrics 00:21:12.459 rmmod nvme_keyring 00:21:12.459 12:48:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:12.459 12:48:45 -- nvmf/common.sh@123 -- # set -e 00:21:12.459 12:48:45 -- nvmf/common.sh@124 -- # return 0 00:21:12.459 12:48:45 -- nvmf/common.sh@477 -- # '[' -n 3579817 ']' 00:21:12.459 12:48:45 -- nvmf/common.sh@478 -- # killprocess 3579817 00:21:12.459 12:48:45 -- common/autotest_common.sh@936 -- # '[' -z 3579817 ']' 00:21:12.459 12:48:45 -- common/autotest_common.sh@940 -- # kill -0 3579817 00:21:12.459 12:48:45 -- common/autotest_common.sh@941 -- # uname 00:21:12.459 12:48:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:12.459 12:48:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3579817 00:21:12.459 12:48:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:12.459 12:48:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:12.459 12:48:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3579817' 00:21:12.459 killing process with pid 3579817 00:21:12.459 12:48:45 -- common/autotest_common.sh@955 -- # kill 3579817 00:21:12.459 12:48:45 -- common/autotest_common.sh@960 -- # wait 3579817 00:21:12.459 12:48:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:12.459 12:48:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:12.459 12:48:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:12.459 12:48:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:12.459 12:48:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:12.459 12:48:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:12.459 12:48:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:12.459 12:48:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:14.372 12:48:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:14.372 12:48:47 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:14.372 12:48:47 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:15.311 12:48:48 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:17.866 12:48:50 -- target/perf_adq.sh@54 -- # sleep 5 00:21:23.152 12:48:55 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:23.152 12:48:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:23.152 12:48:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:23.152 12:48:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:23.152 12:48:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:23.152 12:48:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:23.152 12:48:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:23.152 12:48:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:23.152 12:48:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:23.152 12:48:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:23.152 12:48:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:23.152 12:48:55 -- common/autotest_common.sh@10 -- # set +x 00:21:23.152 12:48:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:23.152 12:48:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:23.152 12:48:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:23.152 12:48:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:23.152 12:48:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:23.152 12:48:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:23.152 12:48:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:23.152 12:48:55 -- nvmf/common.sh@294 -- # net_devs=() 00:21:23.152 12:48:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:23.152 12:48:55 -- nvmf/common.sh@295 -- # e810=() 00:21:23.152 12:48:55 -- nvmf/common.sh@295 -- # local -ga e810 00:21:23.152 12:48:55 -- nvmf/common.sh@296 -- # x722=() 00:21:23.152 12:48:55 -- nvmf/common.sh@296 -- # local -ga x722 00:21:23.152 12:48:55 -- nvmf/common.sh@297 -- # mlx=() 00:21:23.152 12:48:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:23.152 12:48:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:23.152 12:48:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:23.152 12:48:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:23.152 12:48:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:23.152 12:48:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:23.152 12:48:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:23.152 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:23.152 12:48:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:23.152 12:48:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:23.152 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:23.152 12:48:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:23.152 12:48:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:23.152 12:48:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.152 12:48:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:23.152 12:48:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.152 12:48:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:23.152 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:23.152 12:48:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.152 12:48:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:23.152 12:48:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.152 12:48:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:23.152 12:48:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.152 12:48:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:23.152 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:23.152 12:48:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.152 12:48:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:23.152 12:48:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:23.152 12:48:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:23.152 12:48:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:23.152 12:48:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:23.152 12:48:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:23.152 12:48:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:23.152 12:48:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:23.152 12:48:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:23.152 12:48:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:23.152 12:48:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:23.152 12:48:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:23.152 12:48:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:23.152 12:48:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:23.152 12:48:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:23.152 12:48:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:23.152 12:48:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:23.152 12:48:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:23.152 12:48:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:23.152 12:48:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:23.152 12:48:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:23.152 12:48:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:23.152 12:48:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:23.152 12:48:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:23.152 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:23.152 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:21:23.152 00:21:23.152 --- 10.0.0.2 ping statistics --- 00:21:23.152 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:23.152 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:21:23.152 12:48:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:23.152 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:23.152 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:21:23.152 00:21:23.152 --- 10.0.0.1 ping statistics --- 00:21:23.152 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:23.153 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:21:23.153 12:48:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:23.153 12:48:55 -- nvmf/common.sh@410 -- # return 0 00:21:23.153 12:48:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:23.153 12:48:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:23.153 12:48:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:23.153 12:48:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:23.153 12:48:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:23.153 12:48:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:23.153 12:48:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:23.153 12:48:55 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:23.153 12:48:55 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:23.153 12:48:55 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:23.153 12:48:55 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:23.153 net.core.busy_poll = 1 00:21:23.153 12:48:55 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:23.153 net.core.busy_read = 1 00:21:23.153 12:48:55 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:23.153 12:48:55 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:23.153 12:48:55 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:23.153 12:48:55 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:23.153 12:48:55 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:23.153 12:48:55 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:23.153 12:48:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:23.153 12:48:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:23.153 12:48:55 -- common/autotest_common.sh@10 -- # set +x 00:21:23.153 12:48:55 -- nvmf/common.sh@469 -- # nvmfpid=3582677 00:21:23.153 12:48:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:23.153 12:48:55 -- nvmf/common.sh@470 -- # waitforlisten 3582677 00:21:23.153 12:48:55 -- common/autotest_common.sh@829 -- # '[' -z 3582677 ']' 00:21:23.153 12:48:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:23.153 12:48:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.153 12:48:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:23.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:23.153 12:48:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.153 12:48:55 -- common/autotest_common.sh@10 -- # set +x 00:21:23.153 [2024-11-20 12:48:55.894960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:23.153 [2024-11-20 12:48:55.895045] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:23.153 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.153 [2024-11-20 12:48:55.958551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:23.153 [2024-11-20 12:48:56.064906] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:23.153 [2024-11-20 12:48:56.065053] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:23.153 [2024-11-20 12:48:56.065077] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:23.153 [2024-11-20 12:48:56.065090] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:23.153 [2024-11-20 12:48:56.065142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:23.153 [2024-11-20 12:48:56.065203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:23.153 [2024-11-20 12:48:56.065270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:23.153 [2024-11-20 12:48:56.065272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:23.153 12:48:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:23.153 12:48:56 -- common/autotest_common.sh@862 -- # return 0 00:21:23.153 12:48:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:23.153 12:48:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:23.153 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.153 12:48:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:23.153 12:48:56 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:23.153 12:48:56 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:23.153 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.153 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.153 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.153 12:48:56 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:23.153 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.153 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.413 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.413 12:48:56 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:23.413 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.413 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.413 [2024-11-20 12:48:56.303821] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:23.413 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.413 12:48:56 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:23.413 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.413 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.413 Malloc1 00:21:23.413 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.413 12:48:56 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:23.413 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.413 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.413 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.413 12:48:56 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:23.413 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.413 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.413 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.413 12:48:56 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:23.413 12:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.413 12:48:56 -- common/autotest_common.sh@10 -- # set +x 00:21:23.413 [2024-11-20 12:48:56.356943] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:23.413 12:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.413 12:48:56 -- target/perf_adq.sh@94 -- # perfpid=3582703 00:21:23.413 12:48:56 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:23.413 12:48:56 -- target/perf_adq.sh@95 -- # sleep 2 00:21:23.413 EAL: No free 2048 kB hugepages reported on node 1 00:21:25.319 12:48:58 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:25.319 12:48:58 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:25.319 12:48:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.319 12:48:58 -- target/perf_adq.sh@97 -- # wc -l 00:21:25.319 12:48:58 -- common/autotest_common.sh@10 -- # set +x 00:21:25.319 12:48:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.319 12:48:58 -- target/perf_adq.sh@97 -- # count=3 00:21:25.319 12:48:58 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:21:25.319 12:48:58 -- target/perf_adq.sh@103 -- # wait 3582703 00:21:33.445 Initializing NVMe Controllers 00:21:33.445 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:33.445 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:33.445 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:33.445 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:33.445 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:33.445 Initialization complete. Launching workers. 00:21:33.445 ======================================================== 00:21:33.445 Latency(us) 00:21:33.445 Device Information : IOPS MiB/s Average min max 00:21:33.445 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4310.60 16.84 14856.33 2311.51 60160.71 00:21:33.445 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4969.40 19.41 12887.86 1326.16 59910.20 00:21:33.445 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5160.90 20.16 12410.00 1480.41 59094.59 00:21:33.445 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5247.40 20.50 12205.51 1560.12 62294.74 00:21:33.445 ======================================================== 00:21:33.445 Total : 19688.29 76.91 13011.72 1326.16 62294.74 00:21:33.445 00:21:33.445 12:49:06 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:33.445 12:49:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:33.445 12:49:06 -- nvmf/common.sh@116 -- # sync 00:21:33.445 12:49:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:33.445 12:49:06 -- nvmf/common.sh@119 -- # set +e 00:21:33.445 12:49:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:33.445 12:49:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:33.445 rmmod nvme_tcp 00:21:33.445 rmmod nvme_fabrics 00:21:33.445 rmmod nvme_keyring 00:21:33.705 12:49:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:33.706 12:49:06 -- nvmf/common.sh@123 -- # set -e 00:21:33.706 12:49:06 -- nvmf/common.sh@124 -- # return 0 00:21:33.706 12:49:06 -- nvmf/common.sh@477 -- # '[' -n 3582677 ']' 00:21:33.706 12:49:06 -- nvmf/common.sh@478 -- # killprocess 3582677 00:21:33.706 12:49:06 -- common/autotest_common.sh@936 -- # '[' -z 3582677 ']' 00:21:33.706 12:49:06 -- common/autotest_common.sh@940 -- # kill -0 3582677 00:21:33.706 12:49:06 -- common/autotest_common.sh@941 -- # uname 00:21:33.706 12:49:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:33.706 12:49:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3582677 00:21:33.706 12:49:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:33.706 12:49:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:33.706 12:49:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3582677' 00:21:33.706 killing process with pid 3582677 00:21:33.706 12:49:06 -- common/autotest_common.sh@955 -- # kill 3582677 00:21:33.706 12:49:06 -- common/autotest_common.sh@960 -- # wait 3582677 00:21:33.966 12:49:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:33.966 12:49:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:33.966 12:49:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:33.966 12:49:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:33.966 12:49:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:33.966 12:49:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:33.966 12:49:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:33.966 12:49:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:37.260 12:49:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:37.260 12:49:09 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:37.260 00:21:37.260 real 0m45.971s 00:21:37.260 user 2m37.738s 00:21:37.260 sys 0m10.138s 00:21:37.260 12:49:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:37.260 12:49:09 -- common/autotest_common.sh@10 -- # set +x 00:21:37.260 ************************************ 00:21:37.260 END TEST nvmf_perf_adq 00:21:37.260 ************************************ 00:21:37.260 12:49:09 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:37.260 12:49:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:37.260 12:49:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:37.260 12:49:09 -- common/autotest_common.sh@10 -- # set +x 00:21:37.260 ************************************ 00:21:37.260 START TEST nvmf_shutdown 00:21:37.260 ************************************ 00:21:37.260 12:49:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:37.260 * Looking for test storage... 00:21:37.260 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:37.260 12:49:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:37.260 12:49:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:37.260 12:49:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:37.260 12:49:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:37.260 12:49:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:37.260 12:49:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:37.260 12:49:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:37.260 12:49:10 -- scripts/common.sh@335 -- # IFS=.-: 00:21:37.260 12:49:10 -- scripts/common.sh@335 -- # read -ra ver1 00:21:37.260 12:49:10 -- scripts/common.sh@336 -- # IFS=.-: 00:21:37.260 12:49:10 -- scripts/common.sh@336 -- # read -ra ver2 00:21:37.260 12:49:10 -- scripts/common.sh@337 -- # local 'op=<' 00:21:37.260 12:49:10 -- scripts/common.sh@339 -- # ver1_l=2 00:21:37.260 12:49:10 -- scripts/common.sh@340 -- # ver2_l=1 00:21:37.260 12:49:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:37.260 12:49:10 -- scripts/common.sh@343 -- # case "$op" in 00:21:37.260 12:49:10 -- scripts/common.sh@344 -- # : 1 00:21:37.260 12:49:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:37.260 12:49:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:37.260 12:49:10 -- scripts/common.sh@364 -- # decimal 1 00:21:37.260 12:49:10 -- scripts/common.sh@352 -- # local d=1 00:21:37.260 12:49:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:37.260 12:49:10 -- scripts/common.sh@354 -- # echo 1 00:21:37.260 12:49:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:37.260 12:49:10 -- scripts/common.sh@365 -- # decimal 2 00:21:37.260 12:49:10 -- scripts/common.sh@352 -- # local d=2 00:21:37.260 12:49:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:37.260 12:49:10 -- scripts/common.sh@354 -- # echo 2 00:21:37.260 12:49:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:37.260 12:49:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:37.260 12:49:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:37.261 12:49:10 -- scripts/common.sh@367 -- # return 0 00:21:37.261 12:49:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:37.261 12:49:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:37.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.261 --rc genhtml_branch_coverage=1 00:21:37.261 --rc genhtml_function_coverage=1 00:21:37.261 --rc genhtml_legend=1 00:21:37.261 --rc geninfo_all_blocks=1 00:21:37.261 --rc geninfo_unexecuted_blocks=1 00:21:37.261 00:21:37.261 ' 00:21:37.261 12:49:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:37.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.261 --rc genhtml_branch_coverage=1 00:21:37.261 --rc genhtml_function_coverage=1 00:21:37.261 --rc genhtml_legend=1 00:21:37.261 --rc geninfo_all_blocks=1 00:21:37.261 --rc geninfo_unexecuted_blocks=1 00:21:37.261 00:21:37.261 ' 00:21:37.261 12:49:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:37.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.261 --rc genhtml_branch_coverage=1 00:21:37.261 --rc genhtml_function_coverage=1 00:21:37.261 --rc genhtml_legend=1 00:21:37.261 --rc geninfo_all_blocks=1 00:21:37.261 --rc geninfo_unexecuted_blocks=1 00:21:37.261 00:21:37.261 ' 00:21:37.261 12:49:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:37.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.261 --rc genhtml_branch_coverage=1 00:21:37.261 --rc genhtml_function_coverage=1 00:21:37.261 --rc genhtml_legend=1 00:21:37.261 --rc geninfo_all_blocks=1 00:21:37.261 --rc geninfo_unexecuted_blocks=1 00:21:37.261 00:21:37.261 ' 00:21:37.261 12:49:10 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:37.261 12:49:10 -- nvmf/common.sh@7 -- # uname -s 00:21:37.261 12:49:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:37.261 12:49:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:37.261 12:49:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:37.261 12:49:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:37.261 12:49:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:37.261 12:49:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:37.261 12:49:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:37.261 12:49:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:37.261 12:49:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:37.261 12:49:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:37.261 12:49:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:37.261 12:49:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:37.261 12:49:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:37.261 12:49:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:37.261 12:49:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:37.261 12:49:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:37.261 12:49:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:37.261 12:49:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:37.261 12:49:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:37.261 12:49:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.261 12:49:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.261 12:49:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.261 12:49:10 -- paths/export.sh@5 -- # export PATH 00:21:37.261 12:49:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.261 12:49:10 -- nvmf/common.sh@46 -- # : 0 00:21:37.261 12:49:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:37.261 12:49:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:37.261 12:49:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:37.261 12:49:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:37.261 12:49:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:37.261 12:49:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:37.261 12:49:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:37.261 12:49:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:37.261 12:49:10 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:37.261 12:49:10 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:37.261 12:49:10 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:37.261 12:49:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:37.261 12:49:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:37.261 12:49:10 -- common/autotest_common.sh@10 -- # set +x 00:21:37.261 ************************************ 00:21:37.261 START TEST nvmf_shutdown_tc1 00:21:37.261 ************************************ 00:21:37.261 12:49:10 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:21:37.261 12:49:10 -- target/shutdown.sh@74 -- # starttarget 00:21:37.261 12:49:10 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:37.261 12:49:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:37.261 12:49:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:37.261 12:49:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:37.261 12:49:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:37.261 12:49:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:37.261 12:49:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:37.261 12:49:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:37.261 12:49:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:37.261 12:49:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:37.261 12:49:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:37.261 12:49:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:37.261 12:49:10 -- common/autotest_common.sh@10 -- # set +x 00:21:39.167 12:49:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:39.167 12:49:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:39.167 12:49:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:39.167 12:49:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:39.167 12:49:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:39.167 12:49:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:39.167 12:49:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:39.167 12:49:12 -- nvmf/common.sh@294 -- # net_devs=() 00:21:39.167 12:49:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:39.167 12:49:12 -- nvmf/common.sh@295 -- # e810=() 00:21:39.167 12:49:12 -- nvmf/common.sh@295 -- # local -ga e810 00:21:39.167 12:49:12 -- nvmf/common.sh@296 -- # x722=() 00:21:39.167 12:49:12 -- nvmf/common.sh@296 -- # local -ga x722 00:21:39.167 12:49:12 -- nvmf/common.sh@297 -- # mlx=() 00:21:39.167 12:49:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:39.167 12:49:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.167 12:49:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:39.167 12:49:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:39.167 12:49:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:39.167 12:49:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.167 12:49:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:39.167 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:39.167 12:49:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.167 12:49:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:39.167 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:39.167 12:49:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:39.167 12:49:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.167 12:49:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.167 12:49:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.167 12:49:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.167 12:49:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:39.167 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:39.167 12:49:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.167 12:49:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.167 12:49:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.167 12:49:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.167 12:49:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.167 12:49:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:39.167 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:39.167 12:49:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.167 12:49:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:39.167 12:49:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:39.167 12:49:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:39.167 12:49:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:39.167 12:49:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:39.167 12:49:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:39.167 12:49:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:39.167 12:49:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:39.167 12:49:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:39.167 12:49:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:39.167 12:49:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:39.167 12:49:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:39.167 12:49:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:39.167 12:49:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:39.167 12:49:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:39.167 12:49:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:39.167 12:49:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:39.167 12:49:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:39.167 12:49:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:39.167 12:49:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:39.167 12:49:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:39.428 12:49:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:39.428 12:49:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:39.428 12:49:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:39.428 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:39.428 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:21:39.428 00:21:39.428 --- 10.0.0.2 ping statistics --- 00:21:39.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.428 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:21:39.428 12:49:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:39.428 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:39.428 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:21:39.428 00:21:39.428 --- 10.0.0.1 ping statistics --- 00:21:39.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.428 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:21:39.428 12:49:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:39.428 12:49:12 -- nvmf/common.sh@410 -- # return 0 00:21:39.428 12:49:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:39.428 12:49:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:39.428 12:49:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:39.428 12:49:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:39.428 12:49:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:39.428 12:49:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:39.428 12:49:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:39.428 12:49:12 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:39.428 12:49:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:39.428 12:49:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:39.428 12:49:12 -- common/autotest_common.sh@10 -- # set +x 00:21:39.428 12:49:12 -- nvmf/common.sh@469 -- # nvmfpid=3586054 00:21:39.428 12:49:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:39.428 12:49:12 -- nvmf/common.sh@470 -- # waitforlisten 3586054 00:21:39.428 12:49:12 -- common/autotest_common.sh@829 -- # '[' -z 3586054 ']' 00:21:39.428 12:49:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.428 12:49:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:39.428 12:49:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.428 12:49:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:39.428 12:49:12 -- common/autotest_common.sh@10 -- # set +x 00:21:39.428 [2024-11-20 12:49:12.394178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:39.428 [2024-11-20 12:49:12.394254] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:39.428 EAL: No free 2048 kB hugepages reported on node 1 00:21:39.428 [2024-11-20 12:49:12.464817] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:39.687 [2024-11-20 12:49:12.587005] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:39.687 [2024-11-20 12:49:12.587188] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:39.687 [2024-11-20 12:49:12.587208] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:39.687 [2024-11-20 12:49:12.587221] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:39.687 [2024-11-20 12:49:12.587283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:39.687 [2024-11-20 12:49:12.587342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:39.687 [2024-11-20 12:49:12.587391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:39.687 [2024-11-20 12:49:12.587394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:40.621 12:49:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:40.621 12:49:13 -- common/autotest_common.sh@862 -- # return 0 00:21:40.621 12:49:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:40.621 12:49:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:40.621 12:49:13 -- common/autotest_common.sh@10 -- # set +x 00:21:40.621 12:49:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:40.621 12:49:13 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:40.621 12:49:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.621 12:49:13 -- common/autotest_common.sh@10 -- # set +x 00:21:40.621 [2024-11-20 12:49:13.423730] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:40.621 12:49:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.621 12:49:13 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:40.621 12:49:13 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:40.621 12:49:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:40.621 12:49:13 -- common/autotest_common.sh@10 -- # set +x 00:21:40.621 12:49:13 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:40.621 12:49:13 -- target/shutdown.sh@28 -- # cat 00:21:40.621 12:49:13 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:40.621 12:49:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.621 12:49:13 -- common/autotest_common.sh@10 -- # set +x 00:21:40.621 Malloc1 00:21:40.621 [2024-11-20 12:49:13.503141] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:40.621 Malloc2 00:21:40.621 Malloc3 00:21:40.621 Malloc4 00:21:40.621 Malloc5 00:21:40.621 Malloc6 00:21:40.880 Malloc7 00:21:40.880 Malloc8 00:21:40.880 Malloc9 00:21:40.880 Malloc10 00:21:40.880 12:49:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.880 12:49:13 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:40.880 12:49:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:40.880 12:49:13 -- common/autotest_common.sh@10 -- # set +x 00:21:40.880 12:49:13 -- target/shutdown.sh@78 -- # perfpid=3586369 00:21:40.880 12:49:13 -- target/shutdown.sh@79 -- # waitforlisten 3586369 /var/tmp/bdevperf.sock 00:21:40.880 12:49:13 -- common/autotest_common.sh@829 -- # '[' -z 3586369 ']' 00:21:40.880 12:49:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:40.880 12:49:13 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:40.880 12:49:13 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:40.880 12:49:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:40.880 12:49:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:40.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:40.880 12:49:13 -- nvmf/common.sh@520 -- # config=() 00:21:40.880 12:49:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:40.880 12:49:13 -- nvmf/common.sh@520 -- # local subsystem config 00:21:40.880 12:49:13 -- common/autotest_common.sh@10 -- # set +x 00:21:40.880 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:40.880 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:40.880 { 00:21:40.880 "params": { 00:21:40.880 "name": "Nvme$subsystem", 00:21:40.880 "trtype": "$TEST_TRANSPORT", 00:21:40.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:40.880 "adrfam": "ipv4", 00:21:40.880 "trsvcid": "$NVMF_PORT", 00:21:40.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:40.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:40.880 "hdgst": ${hdgst:-false}, 00:21:40.880 "ddgst": ${ddgst:-false} 00:21:40.880 }, 00:21:40.880 "method": "bdev_nvme_attach_controller" 00:21:40.880 } 00:21:40.880 EOF 00:21:40.880 )") 00:21:40.880 12:49:13 -- nvmf/common.sh@542 -- # cat 00:21:40.880 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:40.880 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:40.880 { 00:21:40.880 "params": { 00:21:40.880 "name": "Nvme$subsystem", 00:21:40.880 "trtype": "$TEST_TRANSPORT", 00:21:40.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:40.880 "adrfam": "ipv4", 00:21:40.880 "trsvcid": "$NVMF_PORT", 00:21:40.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:40.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:40.880 "hdgst": ${hdgst:-false}, 00:21:40.880 "ddgst": ${ddgst:-false} 00:21:40.880 }, 00:21:40.880 "method": "bdev_nvme_attach_controller" 00:21:40.880 } 00:21:40.880 EOF 00:21:40.880 )") 00:21:40.880 12:49:13 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:41.141 { 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme$subsystem", 00:21:41.141 "trtype": "$TEST_TRANSPORT", 00:21:41.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "$NVMF_PORT", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:41.141 "hdgst": ${hdgst:-false}, 00:21:41.141 "ddgst": ${ddgst:-false} 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 } 00:21:41.141 EOF 00:21:41.141 )") 00:21:41.141 12:49:14 -- nvmf/common.sh@542 -- # cat 00:21:41.141 12:49:14 -- nvmf/common.sh@544 -- # jq . 00:21:41.141 12:49:14 -- nvmf/common.sh@545 -- # IFS=, 00:21:41.141 12:49:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme1", 00:21:41.141 "trtype": "tcp", 00:21:41.141 "traddr": "10.0.0.2", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "4420", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:41.141 "hdgst": false, 00:21:41.141 "ddgst": false 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 },{ 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme2", 00:21:41.141 "trtype": "tcp", 00:21:41.141 "traddr": "10.0.0.2", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "4420", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:41.141 "hdgst": false, 00:21:41.141 "ddgst": false 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 },{ 00:21:41.141 "params": { 00:21:41.141 "name": "Nvme3", 00:21:41.141 "trtype": "tcp", 00:21:41.141 "traddr": "10.0.0.2", 00:21:41.141 "adrfam": "ipv4", 00:21:41.141 "trsvcid": "4420", 00:21:41.141 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:41.141 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:41.141 "hdgst": false, 00:21:41.141 "ddgst": false 00:21:41.141 }, 00:21:41.141 "method": "bdev_nvme_attach_controller" 00:21:41.141 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme4", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme5", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme6", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme7", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme8", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme9", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 },{ 00:21:41.142 "params": { 00:21:41.142 "name": "Nvme10", 00:21:41.142 "trtype": "tcp", 00:21:41.142 "traddr": "10.0.0.2", 00:21:41.142 "adrfam": "ipv4", 00:21:41.142 "trsvcid": "4420", 00:21:41.142 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:41.142 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:41.142 "hdgst": false, 00:21:41.142 "ddgst": false 00:21:41.142 }, 00:21:41.142 "method": "bdev_nvme_attach_controller" 00:21:41.142 }' 00:21:41.142 [2024-11-20 12:49:14.019121] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:41.142 [2024-11-20 12:49:14.019201] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:41.142 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.142 [2024-11-20 12:49:14.081582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:41.142 [2024-11-20 12:49:14.189665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:43.045 12:49:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:43.045 12:49:15 -- common/autotest_common.sh@862 -- # return 0 00:21:43.045 12:49:15 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:43.045 12:49:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.045 12:49:15 -- common/autotest_common.sh@10 -- # set +x 00:21:43.045 12:49:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.045 12:49:15 -- target/shutdown.sh@83 -- # kill -9 3586369 00:21:43.045 12:49:15 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:21:43.045 12:49:15 -- target/shutdown.sh@87 -- # sleep 1 00:21:44.032 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3586369 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:21:44.032 12:49:16 -- target/shutdown.sh@88 -- # kill -0 3586054 00:21:44.032 12:49:16 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:21:44.032 12:49:16 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:44.032 12:49:16 -- nvmf/common.sh@520 -- # config=() 00:21:44.032 12:49:16 -- nvmf/common.sh@520 -- # local subsystem config 00:21:44.032 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.032 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.032 { 00:21:44.032 "params": { 00:21:44.032 "name": "Nvme$subsystem", 00:21:44.032 "trtype": "$TEST_TRANSPORT", 00:21:44.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.032 "adrfam": "ipv4", 00:21:44.032 "trsvcid": "$NVMF_PORT", 00:21:44.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.032 "hdgst": ${hdgst:-false}, 00:21:44.032 "ddgst": ${ddgst:-false} 00:21:44.032 }, 00:21:44.032 "method": "bdev_nvme_attach_controller" 00:21:44.032 } 00:21:44.032 EOF 00:21:44.032 )") 00:21:44.032 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.032 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.032 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.032 { 00:21:44.032 "params": { 00:21:44.032 "name": "Nvme$subsystem", 00:21:44.032 "trtype": "$TEST_TRANSPORT", 00:21:44.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.032 "adrfam": "ipv4", 00:21:44.032 "trsvcid": "$NVMF_PORT", 00:21:44.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.032 "hdgst": ${hdgst:-false}, 00:21:44.032 "ddgst": ${ddgst:-false} 00:21:44.032 }, 00:21:44.032 "method": "bdev_nvme_attach_controller" 00:21:44.032 } 00:21:44.032 EOF 00:21:44.032 )") 00:21:44.032 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.032 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:44.033 { 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme$subsystem", 00:21:44.033 "trtype": "$TEST_TRANSPORT", 00:21:44.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "$NVMF_PORT", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:44.033 "hdgst": ${hdgst:-false}, 00:21:44.033 "ddgst": ${ddgst:-false} 00:21:44.033 }, 00:21:44.033 "method": "bdev_nvme_attach_controller" 00:21:44.033 } 00:21:44.033 EOF 00:21:44.033 )") 00:21:44.033 12:49:16 -- nvmf/common.sh@542 -- # cat 00:21:44.033 12:49:16 -- nvmf/common.sh@544 -- # jq . 00:21:44.033 12:49:16 -- nvmf/common.sh@545 -- # IFS=, 00:21:44.033 12:49:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:44.033 "params": { 00:21:44.033 "name": "Nvme1", 00:21:44.033 "trtype": "tcp", 00:21:44.033 "traddr": "10.0.0.2", 00:21:44.033 "adrfam": "ipv4", 00:21:44.033 "trsvcid": "4420", 00:21:44.033 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.033 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:44.033 "hdgst": false, 00:21:44.033 "ddgst": false 00:21:44.033 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme2", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme3", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme4", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme5", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme6", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme7", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme8", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme9", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 },{ 00:21:44.034 "params": { 00:21:44.034 "name": "Nvme10", 00:21:44.034 "trtype": "tcp", 00:21:44.034 "traddr": "10.0.0.2", 00:21:44.034 "adrfam": "ipv4", 00:21:44.034 "trsvcid": "4420", 00:21:44.034 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:44.034 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:44.034 "hdgst": false, 00:21:44.034 "ddgst": false 00:21:44.034 }, 00:21:44.034 "method": "bdev_nvme_attach_controller" 00:21:44.034 }' 00:21:44.034 [2024-11-20 12:49:16.841471] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:44.034 [2024-11-20 12:49:16.841554] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3586681 ] 00:21:44.034 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.034 [2024-11-20 12:49:16.906783] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:44.034 [2024-11-20 12:49:17.017123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:45.474 Running I/O for 1 seconds... 00:21:46.850 00:21:46.850 Latency(us) 00:21:46.850 [2024-11-20T11:49:19.958Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme1n1 : 1.08 402.09 25.13 0.00 0.00 156412.92 18058.81 121945.51 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme2n1 : 1.06 374.22 23.39 0.00 0.00 165042.41 41943.04 142140.30 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme3n1 : 1.08 400.41 25.03 0.00 0.00 154817.87 18350.08 118838.61 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme4n1 : 1.09 399.26 24.95 0.00 0.00 154185.44 18252.99 118838.61 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme5n1 : 1.09 398.33 24.90 0.00 0.00 153577.61 17185.00 117285.17 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme6n1 : 1.10 393.54 24.60 0.00 0.00 155027.32 10874.12 142140.30 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme7n1 : 1.09 396.98 24.81 0.00 0.00 151800.91 18544.26 121168.78 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme8n1 : 1.10 396.03 24.75 0.00 0.00 151572.94 14854.83 123498.95 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme9n1 : 1.10 399.61 24.98 0.00 0.00 148692.13 20194.80 124275.67 00:21:46.850 [2024-11-20T11:49:19.958Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:46.850 Verification LBA range: start 0x0 length 0x400 00:21:46.850 Nvme10n1 : 1.11 397.16 24.82 0.00 0.00 150102.29 3665.16 127382.57 00:21:46.850 [2024-11-20T11:49:19.958Z] =================================================================================================================== 00:21:46.850 [2024-11-20T11:49:19.958Z] Total : 3957.63 247.35 0.00 0.00 154021.11 3665.16 142140.30 00:21:46.850 12:49:19 -- target/shutdown.sh@93 -- # stoptarget 00:21:46.850 12:49:19 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:46.850 12:49:19 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:46.850 12:49:19 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:46.850 12:49:19 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:46.850 12:49:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:46.850 12:49:19 -- nvmf/common.sh@116 -- # sync 00:21:46.850 12:49:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:46.850 12:49:19 -- nvmf/common.sh@119 -- # set +e 00:21:46.850 12:49:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:46.850 12:49:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:46.850 rmmod nvme_tcp 00:21:46.850 rmmod nvme_fabrics 00:21:47.109 rmmod nvme_keyring 00:21:47.109 12:49:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:47.109 12:49:19 -- nvmf/common.sh@123 -- # set -e 00:21:47.109 12:49:19 -- nvmf/common.sh@124 -- # return 0 00:21:47.109 12:49:19 -- nvmf/common.sh@477 -- # '[' -n 3586054 ']' 00:21:47.109 12:49:19 -- nvmf/common.sh@478 -- # killprocess 3586054 00:21:47.109 12:49:19 -- common/autotest_common.sh@936 -- # '[' -z 3586054 ']' 00:21:47.109 12:49:19 -- common/autotest_common.sh@940 -- # kill -0 3586054 00:21:47.109 12:49:19 -- common/autotest_common.sh@941 -- # uname 00:21:47.109 12:49:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:47.109 12:49:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3586054 00:21:47.109 12:49:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:47.109 12:49:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:47.109 12:49:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3586054' 00:21:47.109 killing process with pid 3586054 00:21:47.109 12:49:20 -- common/autotest_common.sh@955 -- # kill 3586054 00:21:47.109 12:49:20 -- common/autotest_common.sh@960 -- # wait 3586054 00:21:47.678 12:49:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:47.678 12:49:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:47.678 12:49:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:47.678 12:49:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:47.679 12:49:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:47.679 12:49:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:47.679 12:49:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:47.679 12:49:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:49.586 12:49:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:49.586 00:21:49.586 real 0m12.467s 00:21:49.586 user 0m36.751s 00:21:49.586 sys 0m3.319s 00:21:49.586 12:49:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:49.586 12:49:22 -- common/autotest_common.sh@10 -- # set +x 00:21:49.586 ************************************ 00:21:49.586 END TEST nvmf_shutdown_tc1 00:21:49.586 ************************************ 00:21:49.586 12:49:22 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:21:49.586 12:49:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:49.586 12:49:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:49.586 12:49:22 -- common/autotest_common.sh@10 -- # set +x 00:21:49.586 ************************************ 00:21:49.586 START TEST nvmf_shutdown_tc2 00:21:49.586 ************************************ 00:21:49.586 12:49:22 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:21:49.586 12:49:22 -- target/shutdown.sh@98 -- # starttarget 00:21:49.586 12:49:22 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:49.586 12:49:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:49.586 12:49:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:49.586 12:49:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:49.586 12:49:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:49.586 12:49:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:49.586 12:49:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:49.586 12:49:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:49.586 12:49:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:49.586 12:49:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:49.586 12:49:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:49.586 12:49:22 -- common/autotest_common.sh@10 -- # set +x 00:21:49.586 12:49:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:49.586 12:49:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:49.586 12:49:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:49.586 12:49:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:49.586 12:49:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:49.586 12:49:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:49.586 12:49:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:49.586 12:49:22 -- nvmf/common.sh@294 -- # net_devs=() 00:21:49.586 12:49:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:49.586 12:49:22 -- nvmf/common.sh@295 -- # e810=() 00:21:49.586 12:49:22 -- nvmf/common.sh@295 -- # local -ga e810 00:21:49.586 12:49:22 -- nvmf/common.sh@296 -- # x722=() 00:21:49.586 12:49:22 -- nvmf/common.sh@296 -- # local -ga x722 00:21:49.586 12:49:22 -- nvmf/common.sh@297 -- # mlx=() 00:21:49.586 12:49:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:49.586 12:49:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:49.586 12:49:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:49.586 12:49:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:49.586 12:49:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:49.586 12:49:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.586 12:49:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:49.586 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:49.586 12:49:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.586 12:49:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:49.586 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:49.586 12:49:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:49.586 12:49:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.586 12:49:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.586 12:49:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.586 12:49:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.586 12:49:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:49.586 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:49.586 12:49:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.586 12:49:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.586 12:49:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.586 12:49:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.586 12:49:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.586 12:49:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:49.586 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:49.586 12:49:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.586 12:49:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:49.586 12:49:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:49.586 12:49:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:49.586 12:49:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:49.586 12:49:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:49.586 12:49:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:49.586 12:49:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:49.586 12:49:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:49.586 12:49:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:49.586 12:49:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:49.586 12:49:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:49.586 12:49:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:49.586 12:49:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:49.586 12:49:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:49.586 12:49:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:49.586 12:49:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:49.586 12:49:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:49.846 12:49:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:49.846 12:49:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:49.846 12:49:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:49.846 12:49:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:49.846 12:49:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:49.846 12:49:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:49.846 12:49:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:49.846 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:49.846 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:21:49.846 00:21:49.846 --- 10.0.0.2 ping statistics --- 00:21:49.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.846 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:21:49.846 12:49:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:49.846 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:49.846 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:21:49.846 00:21:49.846 --- 10.0.0.1 ping statistics --- 00:21:49.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.846 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:21:49.846 12:49:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:49.846 12:49:22 -- nvmf/common.sh@410 -- # return 0 00:21:49.846 12:49:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:49.847 12:49:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:49.847 12:49:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:49.847 12:49:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:49.847 12:49:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:49.847 12:49:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:49.847 12:49:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:49.847 12:49:22 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:49.847 12:49:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:49.847 12:49:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:49.847 12:49:22 -- common/autotest_common.sh@10 -- # set +x 00:21:49.847 12:49:22 -- nvmf/common.sh@469 -- # nvmfpid=3587580 00:21:49.847 12:49:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:49.847 12:49:22 -- nvmf/common.sh@470 -- # waitforlisten 3587580 00:21:49.847 12:49:22 -- common/autotest_common.sh@829 -- # '[' -z 3587580 ']' 00:21:49.847 12:49:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:49.847 12:49:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:49.847 12:49:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:49.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:49.847 12:49:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:49.847 12:49:22 -- common/autotest_common.sh@10 -- # set +x 00:21:49.847 [2024-11-20 12:49:22.933839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:49.847 [2024-11-20 12:49:22.933935] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:50.107 EAL: No free 2048 kB hugepages reported on node 1 00:21:50.107 [2024-11-20 12:49:23.006737] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:50.107 [2024-11-20 12:49:23.118085] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:50.107 [2024-11-20 12:49:23.118237] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:50.107 [2024-11-20 12:49:23.118254] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:50.107 [2024-11-20 12:49:23.118267] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:50.107 [2024-11-20 12:49:23.118359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:50.107 [2024-11-20 12:49:23.118404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:50.107 [2024-11-20 12:49:23.118463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:50.107 [2024-11-20 12:49:23.118465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:51.046 12:49:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:51.046 12:49:23 -- common/autotest_common.sh@862 -- # return 0 00:21:51.046 12:49:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:51.046 12:49:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:51.046 12:49:23 -- common/autotest_common.sh@10 -- # set +x 00:21:51.046 12:49:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:51.046 12:49:23 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:51.046 12:49:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.046 12:49:23 -- common/autotest_common.sh@10 -- # set +x 00:21:51.046 [2024-11-20 12:49:23.926659] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:51.046 12:49:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.046 12:49:23 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:51.046 12:49:23 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:51.046 12:49:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:51.046 12:49:23 -- common/autotest_common.sh@10 -- # set +x 00:21:51.046 12:49:23 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.046 12:49:23 -- target/shutdown.sh@28 -- # cat 00:21:51.046 12:49:23 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:51.046 12:49:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.046 12:49:23 -- common/autotest_common.sh@10 -- # set +x 00:21:51.046 Malloc1 00:21:51.046 [2024-11-20 12:49:24.006782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:51.046 Malloc2 00:21:51.046 Malloc3 00:21:51.046 Malloc4 00:21:51.306 Malloc5 00:21:51.306 Malloc6 00:21:51.306 Malloc7 00:21:51.306 Malloc8 00:21:51.306 Malloc9 00:21:51.566 Malloc10 00:21:51.566 12:49:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.566 12:49:24 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:51.566 12:49:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:51.566 12:49:24 -- common/autotest_common.sh@10 -- # set +x 00:21:51.566 12:49:24 -- target/shutdown.sh@102 -- # perfpid=3587777 00:21:51.566 12:49:24 -- target/shutdown.sh@103 -- # waitforlisten 3587777 /var/tmp/bdevperf.sock 00:21:51.566 12:49:24 -- common/autotest_common.sh@829 -- # '[' -z 3587777 ']' 00:21:51.566 12:49:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:51.566 12:49:24 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:21:51.566 12:49:24 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:51.566 12:49:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:51.566 12:49:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:51.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:51.566 12:49:24 -- nvmf/common.sh@520 -- # config=() 00:21:51.566 12:49:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:51.566 12:49:24 -- nvmf/common.sh@520 -- # local subsystem config 00:21:51.566 12:49:24 -- common/autotest_common.sh@10 -- # set +x 00:21:51.566 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.566 { 00:21:51.566 "params": { 00:21:51.566 "name": "Nvme$subsystem", 00:21:51.566 "trtype": "$TEST_TRANSPORT", 00:21:51.566 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.566 "adrfam": "ipv4", 00:21:51.566 "trsvcid": "$NVMF_PORT", 00:21:51.566 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.566 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.566 "hdgst": ${hdgst:-false}, 00:21:51.566 "ddgst": ${ddgst:-false} 00:21:51.566 }, 00:21:51.566 "method": "bdev_nvme_attach_controller" 00:21:51.566 } 00:21:51.566 EOF 00:21:51.566 )") 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.566 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.566 { 00:21:51.566 "params": { 00:21:51.566 "name": "Nvme$subsystem", 00:21:51.566 "trtype": "$TEST_TRANSPORT", 00:21:51.566 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.566 "adrfam": "ipv4", 00:21:51.566 "trsvcid": "$NVMF_PORT", 00:21:51.566 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.566 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.566 "hdgst": ${hdgst:-false}, 00:21:51.566 "ddgst": ${ddgst:-false} 00:21:51.566 }, 00:21:51.566 "method": "bdev_nvme_attach_controller" 00:21:51.566 } 00:21:51.566 EOF 00:21:51.566 )") 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.566 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.566 { 00:21:51.566 "params": { 00:21:51.566 "name": "Nvme$subsystem", 00:21:51.566 "trtype": "$TEST_TRANSPORT", 00:21:51.566 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.566 "adrfam": "ipv4", 00:21:51.566 "trsvcid": "$NVMF_PORT", 00:21:51.566 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.566 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.566 "hdgst": ${hdgst:-false}, 00:21:51.566 "ddgst": ${ddgst:-false} 00:21:51.566 }, 00:21:51.566 "method": "bdev_nvme_attach_controller" 00:21:51.566 } 00:21:51.566 EOF 00:21:51.566 )") 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.566 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.566 { 00:21:51.566 "params": { 00:21:51.566 "name": "Nvme$subsystem", 00:21:51.566 "trtype": "$TEST_TRANSPORT", 00:21:51.566 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.566 "adrfam": "ipv4", 00:21:51.566 "trsvcid": "$NVMF_PORT", 00:21:51.566 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.566 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.566 "hdgst": ${hdgst:-false}, 00:21:51.566 "ddgst": ${ddgst:-false} 00:21:51.566 }, 00:21:51.566 "method": "bdev_nvme_attach_controller" 00:21:51.566 } 00:21:51.566 EOF 00:21:51.566 )") 00:21:51.566 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.566 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.567 { 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme$subsystem", 00:21:51.567 "trtype": "$TEST_TRANSPORT", 00:21:51.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "$NVMF_PORT", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.567 "hdgst": ${hdgst:-false}, 00:21:51.567 "ddgst": ${ddgst:-false} 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 } 00:21:51.567 EOF 00:21:51.567 )") 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.567 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.567 { 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme$subsystem", 00:21:51.567 "trtype": "$TEST_TRANSPORT", 00:21:51.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "$NVMF_PORT", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.567 "hdgst": ${hdgst:-false}, 00:21:51.567 "ddgst": ${ddgst:-false} 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 } 00:21:51.567 EOF 00:21:51.567 )") 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.567 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.567 { 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme$subsystem", 00:21:51.567 "trtype": "$TEST_TRANSPORT", 00:21:51.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "$NVMF_PORT", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.567 "hdgst": ${hdgst:-false}, 00:21:51.567 "ddgst": ${ddgst:-false} 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 } 00:21:51.567 EOF 00:21:51.567 )") 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.567 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.567 { 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme$subsystem", 00:21:51.567 "trtype": "$TEST_TRANSPORT", 00:21:51.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "$NVMF_PORT", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.567 "hdgst": ${hdgst:-false}, 00:21:51.567 "ddgst": ${ddgst:-false} 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 } 00:21:51.567 EOF 00:21:51.567 )") 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.567 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.567 { 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme$subsystem", 00:21:51.567 "trtype": "$TEST_TRANSPORT", 00:21:51.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "$NVMF_PORT", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.567 "hdgst": ${hdgst:-false}, 00:21:51.567 "ddgst": ${ddgst:-false} 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 } 00:21:51.567 EOF 00:21:51.567 )") 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.567 12:49:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:51.567 { 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme$subsystem", 00:21:51.567 "trtype": "$TEST_TRANSPORT", 00:21:51.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "$NVMF_PORT", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:51.567 "hdgst": ${hdgst:-false}, 00:21:51.567 "ddgst": ${ddgst:-false} 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 } 00:21:51.567 EOF 00:21:51.567 )") 00:21:51.567 12:49:24 -- nvmf/common.sh@542 -- # cat 00:21:51.567 12:49:24 -- nvmf/common.sh@544 -- # jq . 00:21:51.567 12:49:24 -- nvmf/common.sh@545 -- # IFS=, 00:21:51.567 12:49:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme1", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme2", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme3", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme4", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme5", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme6", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme7", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme8", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme9", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.567 }, 00:21:51.567 "method": "bdev_nvme_attach_controller" 00:21:51.567 },{ 00:21:51.567 "params": { 00:21:51.567 "name": "Nvme10", 00:21:51.567 "trtype": "tcp", 00:21:51.567 "traddr": "10.0.0.2", 00:21:51.567 "adrfam": "ipv4", 00:21:51.567 "trsvcid": "4420", 00:21:51.567 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:51.567 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:51.567 "hdgst": false, 00:21:51.567 "ddgst": false 00:21:51.568 }, 00:21:51.568 "method": "bdev_nvme_attach_controller" 00:21:51.568 }' 00:21:51.568 [2024-11-20 12:49:24.521193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:51.568 [2024-11-20 12:49:24.521270] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3587777 ] 00:21:51.568 EAL: No free 2048 kB hugepages reported on node 1 00:21:51.568 [2024-11-20 12:49:24.583478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:51.826 [2024-11-20 12:49:24.692158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:53.734 Running I/O for 10 seconds... 00:21:53.992 12:49:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:53.992 12:49:26 -- common/autotest_common.sh@862 -- # return 0 00:21:53.992 12:49:26 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:53.992 12:49:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:53.992 12:49:26 -- common/autotest_common.sh@10 -- # set +x 00:21:53.992 12:49:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:53.992 12:49:26 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:21:53.992 12:49:26 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:21:53.992 12:49:26 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:21:53.992 12:49:26 -- target/shutdown.sh@57 -- # local ret=1 00:21:53.992 12:49:26 -- target/shutdown.sh@58 -- # local i 00:21:53.992 12:49:26 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:21:53.992 12:49:26 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:53.992 12:49:26 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:53.992 12:49:26 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:53.992 12:49:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:53.992 12:49:26 -- common/autotest_common.sh@10 -- # set +x 00:21:53.992 12:49:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:53.992 12:49:27 -- target/shutdown.sh@60 -- # read_io_count=167 00:21:53.992 12:49:27 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:21:53.992 12:49:27 -- target/shutdown.sh@64 -- # ret=0 00:21:53.992 12:49:27 -- target/shutdown.sh@65 -- # break 00:21:53.992 12:49:27 -- target/shutdown.sh@69 -- # return 0 00:21:53.992 12:49:27 -- target/shutdown.sh@109 -- # killprocess 3587777 00:21:53.992 12:49:27 -- common/autotest_common.sh@936 -- # '[' -z 3587777 ']' 00:21:53.992 12:49:27 -- common/autotest_common.sh@940 -- # kill -0 3587777 00:21:53.992 12:49:27 -- common/autotest_common.sh@941 -- # uname 00:21:53.992 12:49:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:53.992 12:49:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3587777 00:21:53.992 12:49:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:53.992 12:49:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:53.992 12:49:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3587777' 00:21:53.992 killing process with pid 3587777 00:21:53.992 12:49:27 -- common/autotest_common.sh@955 -- # kill 3587777 00:21:53.992 12:49:27 -- common/autotest_common.sh@960 -- # wait 3587777 00:21:54.251 Received shutdown signal, test time was about 0.674690 seconds 00:21:54.251 00:21:54.251 Latency(us) 00:21:54.251 [2024-11-20T11:49:27.359Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme1n1 : 0.66 410.79 25.67 0.00 0.00 151728.51 18544.26 156121.32 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme2n1 : 0.67 407.55 25.47 0.00 0.00 150662.30 21845.33 131266.18 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme3n1 : 0.66 411.84 25.74 0.00 0.00 147385.15 16117.00 117285.17 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme4n1 : 0.66 409.92 25.62 0.00 0.00 146127.97 22913.33 117285.17 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme5n1 : 0.66 409.09 25.57 0.00 0.00 144657.33 22913.33 117285.17 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme6n1 : 0.67 403.64 25.23 0.00 0.00 144301.63 26602.76 116508.44 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme7n1 : 0.67 406.30 25.39 0.00 0.00 142491.36 20388.98 119615.34 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme8n1 : 0.67 404.47 25.28 0.00 0.00 141373.40 21651.15 121945.51 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme9n1 : 0.63 362.11 22.63 0.00 0.00 155177.67 17185.00 121945.51 00:21:54.251 [2024-11-20T11:49:27.359Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:54.251 Verification LBA range: start 0x0 length 0x400 00:21:54.251 Nvme10n1 : 0.63 359.78 22.49 0.00 0.00 154438.84 16990.81 124275.67 00:21:54.251 [2024-11-20T11:49:27.359Z] =================================================================================================================== 00:21:54.251 [2024-11-20T11:49:27.359Z] Total : 3985.50 249.09 0.00 0.00 147601.25 16117.00 156121.32 00:21:54.511 12:49:27 -- target/shutdown.sh@112 -- # sleep 1 00:21:55.448 12:49:28 -- target/shutdown.sh@113 -- # kill -0 3587580 00:21:55.448 12:49:28 -- target/shutdown.sh@115 -- # stoptarget 00:21:55.448 12:49:28 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:55.448 12:49:28 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:55.448 12:49:28 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:55.448 12:49:28 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:55.448 12:49:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:55.448 12:49:28 -- nvmf/common.sh@116 -- # sync 00:21:55.448 12:49:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:55.448 12:49:28 -- nvmf/common.sh@119 -- # set +e 00:21:55.448 12:49:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:55.448 12:49:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:55.448 rmmod nvme_tcp 00:21:55.448 rmmod nvme_fabrics 00:21:55.448 rmmod nvme_keyring 00:21:55.448 12:49:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:55.448 12:49:28 -- nvmf/common.sh@123 -- # set -e 00:21:55.448 12:49:28 -- nvmf/common.sh@124 -- # return 0 00:21:55.448 12:49:28 -- nvmf/common.sh@477 -- # '[' -n 3587580 ']' 00:21:55.448 12:49:28 -- nvmf/common.sh@478 -- # killprocess 3587580 00:21:55.448 12:49:28 -- common/autotest_common.sh@936 -- # '[' -z 3587580 ']' 00:21:55.448 12:49:28 -- common/autotest_common.sh@940 -- # kill -0 3587580 00:21:55.448 12:49:28 -- common/autotest_common.sh@941 -- # uname 00:21:55.448 12:49:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:55.448 12:49:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3587580 00:21:55.448 12:49:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:55.448 12:49:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:55.448 12:49:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3587580' 00:21:55.448 killing process with pid 3587580 00:21:55.448 12:49:28 -- common/autotest_common.sh@955 -- # kill 3587580 00:21:55.448 12:49:28 -- common/autotest_common.sh@960 -- # wait 3587580 00:21:56.015 12:49:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:56.015 12:49:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:56.015 12:49:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:56.015 12:49:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:56.015 12:49:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:56.015 12:49:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:56.015 12:49:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:56.015 12:49:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:58.560 12:49:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:58.560 00:21:58.560 real 0m8.487s 00:21:58.560 user 0m26.601s 00:21:58.560 sys 0m1.513s 00:21:58.560 12:49:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:58.560 12:49:31 -- common/autotest_common.sh@10 -- # set +x 00:21:58.560 ************************************ 00:21:58.560 END TEST nvmf_shutdown_tc2 00:21:58.560 ************************************ 00:21:58.560 12:49:31 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:21:58.560 12:49:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:58.560 12:49:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:58.560 12:49:31 -- common/autotest_common.sh@10 -- # set +x 00:21:58.560 ************************************ 00:21:58.560 START TEST nvmf_shutdown_tc3 00:21:58.560 ************************************ 00:21:58.560 12:49:31 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:21:58.560 12:49:31 -- target/shutdown.sh@120 -- # starttarget 00:21:58.560 12:49:31 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:58.560 12:49:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:58.560 12:49:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:58.560 12:49:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:58.560 12:49:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:58.560 12:49:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:58.560 12:49:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:58.560 12:49:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:58.560 12:49:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:58.560 12:49:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:58.560 12:49:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:58.560 12:49:31 -- common/autotest_common.sh@10 -- # set +x 00:21:58.560 12:49:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:58.560 12:49:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:58.560 12:49:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:58.560 12:49:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:58.560 12:49:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:58.560 12:49:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:58.560 12:49:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:58.560 12:49:31 -- nvmf/common.sh@294 -- # net_devs=() 00:21:58.560 12:49:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:58.560 12:49:31 -- nvmf/common.sh@295 -- # e810=() 00:21:58.560 12:49:31 -- nvmf/common.sh@295 -- # local -ga e810 00:21:58.560 12:49:31 -- nvmf/common.sh@296 -- # x722=() 00:21:58.560 12:49:31 -- nvmf/common.sh@296 -- # local -ga x722 00:21:58.560 12:49:31 -- nvmf/common.sh@297 -- # mlx=() 00:21:58.560 12:49:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:58.560 12:49:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:58.560 12:49:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:58.560 12:49:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:58.560 12:49:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:58.560 12:49:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:58.560 12:49:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:58.560 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:58.560 12:49:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:58.560 12:49:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:58.560 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:58.560 12:49:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:58.560 12:49:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:58.561 12:49:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:58.561 12:49:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:58.561 12:49:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:58.561 12:49:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:58.561 12:49:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:58.561 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:58.561 12:49:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:58.561 12:49:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:58.561 12:49:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:58.561 12:49:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:58.561 12:49:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:58.561 12:49:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:58.561 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:58.561 12:49:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:58.561 12:49:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:58.561 12:49:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:58.561 12:49:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:58.561 12:49:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:58.561 12:49:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:58.561 12:49:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:58.561 12:49:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:58.561 12:49:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:58.561 12:49:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:58.561 12:49:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:58.561 12:49:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:58.561 12:49:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:58.561 12:49:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:58.561 12:49:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:58.561 12:49:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:58.561 12:49:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:58.561 12:49:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:58.561 12:49:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:58.561 12:49:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:58.561 12:49:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:58.561 12:49:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:58.561 12:49:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:58.561 12:49:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:58.561 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:58.561 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:21:58.561 00:21:58.561 --- 10.0.0.2 ping statistics --- 00:21:58.561 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:58.561 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:21:58.561 12:49:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:58.561 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:58.561 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:21:58.561 00:21:58.561 --- 10.0.0.1 ping statistics --- 00:21:58.561 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:58.561 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:21:58.561 12:49:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:58.561 12:49:31 -- nvmf/common.sh@410 -- # return 0 00:21:58.561 12:49:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:58.561 12:49:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:58.561 12:49:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:58.561 12:49:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:58.561 12:49:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:58.561 12:49:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:58.561 12:49:31 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:58.561 12:49:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:58.561 12:49:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:58.561 12:49:31 -- common/autotest_common.sh@10 -- # set +x 00:21:58.561 12:49:31 -- nvmf/common.sh@469 -- # nvmfpid=3588708 00:21:58.561 12:49:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:58.561 12:49:31 -- nvmf/common.sh@470 -- # waitforlisten 3588708 00:21:58.561 12:49:31 -- common/autotest_common.sh@829 -- # '[' -z 3588708 ']' 00:21:58.561 12:49:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:58.561 12:49:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:58.561 12:49:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:58.561 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:58.561 12:49:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:58.561 12:49:31 -- common/autotest_common.sh@10 -- # set +x 00:21:58.561 [2024-11-20 12:49:31.348349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:58.561 [2024-11-20 12:49:31.348432] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:58.561 EAL: No free 2048 kB hugepages reported on node 1 00:21:58.561 [2024-11-20 12:49:31.417786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:58.561 [2024-11-20 12:49:31.532557] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:58.561 [2024-11-20 12:49:31.532723] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:58.561 [2024-11-20 12:49:31.532742] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:58.561 [2024-11-20 12:49:31.532756] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:58.561 [2024-11-20 12:49:31.532862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:58.561 [2024-11-20 12:49:31.532961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:58.561 [2024-11-20 12:49:31.533028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:58.561 [2024-11-20 12:49:31.533031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:59.497 12:49:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:59.497 12:49:32 -- common/autotest_common.sh@862 -- # return 0 00:21:59.497 12:49:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:59.497 12:49:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:59.497 12:49:32 -- common/autotest_common.sh@10 -- # set +x 00:21:59.497 12:49:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:59.497 12:49:32 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:59.497 12:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.497 12:49:32 -- common/autotest_common.sh@10 -- # set +x 00:21:59.497 [2024-11-20 12:49:32.312506] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:59.497 12:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.497 12:49:32 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:59.497 12:49:32 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:59.497 12:49:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:59.497 12:49:32 -- common/autotest_common.sh@10 -- # set +x 00:21:59.497 12:49:32 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:59.497 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.497 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.497 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.497 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.497 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.497 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.497 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.497 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.497 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.498 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.498 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.498 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.498 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.498 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.498 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.498 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.498 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.498 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.498 12:49:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.498 12:49:32 -- target/shutdown.sh@28 -- # cat 00:21:59.498 12:49:32 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:59.498 12:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.498 12:49:32 -- common/autotest_common.sh@10 -- # set +x 00:21:59.498 Malloc1 00:21:59.498 [2024-11-20 12:49:32.389852] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:59.498 Malloc2 00:21:59.498 Malloc3 00:21:59.498 Malloc4 00:21:59.498 Malloc5 00:21:59.756 Malloc6 00:21:59.756 Malloc7 00:21:59.756 Malloc8 00:21:59.756 Malloc9 00:21:59.756 Malloc10 00:21:59.756 12:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.756 12:49:32 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:59.756 12:49:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:59.756 12:49:32 -- common/autotest_common.sh@10 -- # set +x 00:21:59.756 12:49:32 -- target/shutdown.sh@124 -- # perfpid=3588902 00:21:59.756 12:49:32 -- target/shutdown.sh@125 -- # waitforlisten 3588902 /var/tmp/bdevperf.sock 00:21:59.757 12:49:32 -- common/autotest_common.sh@829 -- # '[' -z 3588902 ']' 00:21:59.757 12:49:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:59.757 12:49:32 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:59.757 12:49:32 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:21:59.757 12:49:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:59.757 12:49:32 -- nvmf/common.sh@520 -- # config=() 00:21:59.757 12:49:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:59.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:59.757 12:49:32 -- nvmf/common.sh@520 -- # local subsystem config 00:21:59.757 12:49:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:59.757 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.757 12:49:32 -- common/autotest_common.sh@10 -- # set +x 00:21:59.757 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.757 { 00:21:59.757 "params": { 00:21:59.757 "name": "Nvme$subsystem", 00:21:59.757 "trtype": "$TEST_TRANSPORT", 00:21:59.757 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.757 "adrfam": "ipv4", 00:21:59.757 "trsvcid": "$NVMF_PORT", 00:21:59.757 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.757 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.757 "hdgst": ${hdgst:-false}, 00:21:59.757 "ddgst": ${ddgst:-false} 00:21:59.757 }, 00:21:59.757 "method": "bdev_nvme_attach_controller" 00:21:59.757 } 00:21:59.757 EOF 00:21:59.757 )") 00:21:59.757 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.016 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.016 { 00:22:00.016 "params": { 00:22:00.016 "name": "Nvme$subsystem", 00:22:00.016 "trtype": "$TEST_TRANSPORT", 00:22:00.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.016 "adrfam": "ipv4", 00:22:00.016 "trsvcid": "$NVMF_PORT", 00:22:00.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.016 "hdgst": ${hdgst:-false}, 00:22:00.016 "ddgst": ${ddgst:-false} 00:22:00.016 }, 00:22:00.016 "method": "bdev_nvme_attach_controller" 00:22:00.016 } 00:22:00.016 EOF 00:22:00.016 )") 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.016 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.016 { 00:22:00.016 "params": { 00:22:00.016 "name": "Nvme$subsystem", 00:22:00.016 "trtype": "$TEST_TRANSPORT", 00:22:00.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.016 "adrfam": "ipv4", 00:22:00.016 "trsvcid": "$NVMF_PORT", 00:22:00.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.016 "hdgst": ${hdgst:-false}, 00:22:00.016 "ddgst": ${ddgst:-false} 00:22:00.016 }, 00:22:00.016 "method": "bdev_nvme_attach_controller" 00:22:00.016 } 00:22:00.016 EOF 00:22:00.016 )") 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.016 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.016 { 00:22:00.016 "params": { 00:22:00.016 "name": "Nvme$subsystem", 00:22:00.016 "trtype": "$TEST_TRANSPORT", 00:22:00.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.016 "adrfam": "ipv4", 00:22:00.016 "trsvcid": "$NVMF_PORT", 00:22:00.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.016 "hdgst": ${hdgst:-false}, 00:22:00.016 "ddgst": ${ddgst:-false} 00:22:00.016 }, 00:22:00.016 "method": "bdev_nvme_attach_controller" 00:22:00.016 } 00:22:00.016 EOF 00:22:00.016 )") 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.016 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.016 { 00:22:00.016 "params": { 00:22:00.016 "name": "Nvme$subsystem", 00:22:00.016 "trtype": "$TEST_TRANSPORT", 00:22:00.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.016 "adrfam": "ipv4", 00:22:00.016 "trsvcid": "$NVMF_PORT", 00:22:00.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.016 "hdgst": ${hdgst:-false}, 00:22:00.016 "ddgst": ${ddgst:-false} 00:22:00.016 }, 00:22:00.016 "method": "bdev_nvme_attach_controller" 00:22:00.016 } 00:22:00.016 EOF 00:22:00.016 )") 00:22:00.016 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.016 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.017 { 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme$subsystem", 00:22:00.017 "trtype": "$TEST_TRANSPORT", 00:22:00.017 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "$NVMF_PORT", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.017 "hdgst": ${hdgst:-false}, 00:22:00.017 "ddgst": ${ddgst:-false} 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 } 00:22:00.017 EOF 00:22:00.017 )") 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.017 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.017 { 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme$subsystem", 00:22:00.017 "trtype": "$TEST_TRANSPORT", 00:22:00.017 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "$NVMF_PORT", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.017 "hdgst": ${hdgst:-false}, 00:22:00.017 "ddgst": ${ddgst:-false} 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 } 00:22:00.017 EOF 00:22:00.017 )") 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.017 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.017 { 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme$subsystem", 00:22:00.017 "trtype": "$TEST_TRANSPORT", 00:22:00.017 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "$NVMF_PORT", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.017 "hdgst": ${hdgst:-false}, 00:22:00.017 "ddgst": ${ddgst:-false} 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 } 00:22:00.017 EOF 00:22:00.017 )") 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.017 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.017 { 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme$subsystem", 00:22:00.017 "trtype": "$TEST_TRANSPORT", 00:22:00.017 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "$NVMF_PORT", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.017 "hdgst": ${hdgst:-false}, 00:22:00.017 "ddgst": ${ddgst:-false} 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 } 00:22:00.017 EOF 00:22:00.017 )") 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.017 12:49:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.017 { 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme$subsystem", 00:22:00.017 "trtype": "$TEST_TRANSPORT", 00:22:00.017 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "$NVMF_PORT", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.017 "hdgst": ${hdgst:-false}, 00:22:00.017 "ddgst": ${ddgst:-false} 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 } 00:22:00.017 EOF 00:22:00.017 )") 00:22:00.017 12:49:32 -- nvmf/common.sh@542 -- # cat 00:22:00.017 12:49:32 -- nvmf/common.sh@544 -- # jq . 00:22:00.017 12:49:32 -- nvmf/common.sh@545 -- # IFS=, 00:22:00.017 12:49:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme1", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 },{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme2", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 },{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme3", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 },{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme4", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 },{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme5", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 },{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme6", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.017 "method": "bdev_nvme_attach_controller" 00:22:00.017 },{ 00:22:00.017 "params": { 00:22:00.017 "name": "Nvme7", 00:22:00.017 "trtype": "tcp", 00:22:00.017 "traddr": "10.0.0.2", 00:22:00.017 "adrfam": "ipv4", 00:22:00.017 "trsvcid": "4420", 00:22:00.017 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:00.017 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:00.017 "hdgst": false, 00:22:00.017 "ddgst": false 00:22:00.017 }, 00:22:00.018 "method": "bdev_nvme_attach_controller" 00:22:00.018 },{ 00:22:00.018 "params": { 00:22:00.018 "name": "Nvme8", 00:22:00.018 "trtype": "tcp", 00:22:00.018 "traddr": "10.0.0.2", 00:22:00.018 "adrfam": "ipv4", 00:22:00.018 "trsvcid": "4420", 00:22:00.018 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:00.018 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:00.018 "hdgst": false, 00:22:00.018 "ddgst": false 00:22:00.018 }, 00:22:00.018 "method": "bdev_nvme_attach_controller" 00:22:00.018 },{ 00:22:00.018 "params": { 00:22:00.018 "name": "Nvme9", 00:22:00.018 "trtype": "tcp", 00:22:00.018 "traddr": "10.0.0.2", 00:22:00.018 "adrfam": "ipv4", 00:22:00.018 "trsvcid": "4420", 00:22:00.018 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:00.018 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:00.018 "hdgst": false, 00:22:00.018 "ddgst": false 00:22:00.018 }, 00:22:00.018 "method": "bdev_nvme_attach_controller" 00:22:00.018 },{ 00:22:00.018 "params": { 00:22:00.018 "name": "Nvme10", 00:22:00.018 "trtype": "tcp", 00:22:00.018 "traddr": "10.0.0.2", 00:22:00.018 "adrfam": "ipv4", 00:22:00.018 "trsvcid": "4420", 00:22:00.018 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:00.018 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:00.018 "hdgst": false, 00:22:00.018 "ddgst": false 00:22:00.018 }, 00:22:00.018 "method": "bdev_nvme_attach_controller" 00:22:00.018 }' 00:22:00.018 [2024-11-20 12:49:32.898954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:00.018 [2024-11-20 12:49:32.899026] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3588902 ] 00:22:00.018 EAL: No free 2048 kB hugepages reported on node 1 00:22:00.018 [2024-11-20 12:49:32.962567] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:00.018 [2024-11-20 12:49:33.072603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:01.391 Running I/O for 10 seconds... 00:22:01.650 12:49:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:01.650 12:49:34 -- common/autotest_common.sh@862 -- # return 0 00:22:01.650 12:49:34 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:01.650 12:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.650 12:49:34 -- common/autotest_common.sh@10 -- # set +x 00:22:01.650 12:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.650 12:49:34 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:01.650 12:49:34 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:01.650 12:49:34 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:01.650 12:49:34 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:01.650 12:49:34 -- target/shutdown.sh@57 -- # local ret=1 00:22:01.650 12:49:34 -- target/shutdown.sh@58 -- # local i 00:22:01.650 12:49:34 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:01.650 12:49:34 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:01.650 12:49:34 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:01.650 12:49:34 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:01.650 12:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.650 12:49:34 -- common/autotest_common.sh@10 -- # set +x 00:22:01.650 12:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.650 12:49:34 -- target/shutdown.sh@60 -- # read_io_count=42 00:22:01.650 12:49:34 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:22:01.650 12:49:34 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:01.909 12:49:34 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:01.909 12:49:34 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:01.909 12:49:34 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:01.909 12:49:34 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:01.909 12:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.909 12:49:34 -- common/autotest_common.sh@10 -- # set +x 00:22:01.909 12:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.909 12:49:34 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:01.909 12:49:34 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:01.909 12:49:34 -- target/shutdown.sh@64 -- # ret=0 00:22:01.909 12:49:34 -- target/shutdown.sh@65 -- # break 00:22:01.909 12:49:34 -- target/shutdown.sh@69 -- # return 0 00:22:01.909 12:49:34 -- target/shutdown.sh@134 -- # killprocess 3588708 00:22:01.909 12:49:34 -- common/autotest_common.sh@936 -- # '[' -z 3588708 ']' 00:22:01.909 12:49:34 -- common/autotest_common.sh@940 -- # kill -0 3588708 00:22:01.909 12:49:34 -- common/autotest_common.sh@941 -- # uname 00:22:01.909 12:49:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:01.909 12:49:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3588708 00:22:02.181 12:49:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:02.181 12:49:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:02.181 12:49:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3588708' 00:22:02.181 killing process with pid 3588708 00:22:02.181 12:49:35 -- common/autotest_common.sh@955 -- # kill 3588708 00:22:02.181 12:49:35 -- common/autotest_common.sh@960 -- # wait 3588708 00:22:02.181 [2024-11-20 12:49:35.031746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.031989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.032001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.032014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.032026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.032039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.032051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.181 [2024-11-20 12:49:35.032076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.032622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b2e0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.033989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.182 [2024-11-20 12:49:35.034384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.034654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3dcd0 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.041990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.183 [2024-11-20 12:49:35.042181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.184 [2024-11-20 12:49:35.042193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3b790 is same with the state(5) to be set 00:22:02.184 [2024-11-20 12:49:35.042835] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.042875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.042894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.042908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.042921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.042934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.042948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.042961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.042975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x687f70 is same with the state(5) to be set 00:22:02.184 [2024-11-20 12:49:35.043026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.043047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.043076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.043093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.043106] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.043119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.043132] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.184 [2024-11-20 12:49:35.043144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.043157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6e0590 is same with the state(5) to be set 00:22:02.184 [2024-11-20 12:49:35.046670] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.184 [2024-11-20 12:49:35.046753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.046982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.046997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.184 [2024-11-20 12:49:35.047659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.184 [2024-11-20 12:49:35.047675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.047980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.047993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 12:49:35.048697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 he state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.185 [2024-11-20 12:49:35.048728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.185 [2024-11-20 12:49:35.048741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8cc260 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.185 [2024-11-20 12:49:35.048804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048830] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8cc260 was disconnected and freed. reset controller. 00:22:02.186 [2024-11-20 12:49:35.048840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048901] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.186 [2024-11-20 12:49:35.048912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.048989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.049503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3bc40 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controlle[2024-11-20 12:49:35.051306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with tr 00:22:02.186 he state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x687f70 (9): Bad file descriptor 00:22:02.186 [2024-11-20 12:49:35.051368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.186 [2024-11-20 12:49:35.051525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.051997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.052262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c0d0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.053206] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053249] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053275] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x84e600 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.053387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053422] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053448] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053474] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6aa1b0 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.053526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6e0590 (9): Bad file descriptor 00:22:02.187 [2024-11-20 12:49:35.053595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053682] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.187 [2024-11-20 12:49:35.053694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.187 [2024-11-20 12:49:35.053706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6b3690 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.053812] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.187 [2024-11-20 12:49:35.053941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.053971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.053992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.054005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.187 [2024-11-20 12:49:35.054022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.054793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3c580 is same with the state(5) to be set 00:22:02.188 [2024-11-20 12:49:35.056435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.188 [2024-11-20 12:49:35.056797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.188 [2024-11-20 12:49:35.056812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.056826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.056842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.056856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.056871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.056884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.056900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.056913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.056928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.056942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.056967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.056980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.056995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.057009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.057024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.189 [2024-11-20 12:49:35.057024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.189 [2024-11-20 12:49:35.057053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with t[2024-11-20 12:49:35.057055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8d8e00 is same with the state(5) to be set 00:22:02.189 he state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057139] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8d8e00 was disconnected and freed. reset controller. 00:22:02.189 [2024-11-20 12:49:35.057152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.057823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3cee0 is same with the state(5) to be set 00:22:02.189 [2024-11-20 12:49:35.058521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:02.189 [2024-11-20 12:49:35.058582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8290a0 (9): Bad file descriptor 00:22:02.189 [2024-11-20 12:49:35.058679] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.190 [2024-11-20 12:49:35.059552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with t[2024-11-20 12:49:35.059638] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.190 he state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with t[2024-11-20 12:49:35.059942] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.190 he state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.059987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.060514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d370 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.061414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.190 [2024-11-20 12:49:35.061438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.190 [2024-11-20 12:49:35.061450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with t[2024-11-20 12:49:35.061460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128he state(5) to be set 00:22:02.190 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.190 [2024-11-20 12:49:35.061481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.190 [2024-11-20 12:49:35.061483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.061498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with t[2024-11-20 12:49:35.061497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:12he state(5) to be set 00:22:02.190 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.190 [2024-11-20 12:49:35.061513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.190 [2024-11-20 12:49:35.061521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with t[2024-11-20 12:49:35.061538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128he state(5) to be set 00:22:02.191 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:12[2024-11-20 12:49:35.061634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 he state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with t[2024-11-20 12:49:35.061646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:02.191 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with the state(5) to be set 00:22:02.191 [2024-11-20 12:49:35.061696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc3d820 is same with t[2024-11-20 12:49:35.061695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:12he state(5) to be set 00:22:02.191 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.061973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.061987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.191 [2024-11-20 12:49:35.062530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.191 [2024-11-20 12:49:35.062545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.062977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.062993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.192 [2024-11-20 12:49:35.063419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8db9c0 is same with the state(5) to be set 00:22:02.192 [2024-11-20 12:49:35.063503] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8db9c0 was disconnected and freed. reset controller. 00:22:02.192 [2024-11-20 12:49:35.063643] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:02.192 [2024-11-20 12:49:35.063666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x687f70 is same with the state(5) to be set 00:22:02.192 [2024-11-20 12:49:35.063700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x687f70 (9): Bad file descriptor 00:22:02.192 [2024-11-20 12:49:35.063755] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x838a60 is same with the state(5) to be set 00:22:02.192 [2024-11-20 12:49:35.063921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.063981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.063994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.192 [2024-11-20 12:49:35.064008] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.192 [2024-11-20 12:49:35.064030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d5490 is same with the state(5) to be set 00:22:02.193 [2024-11-20 12:49:35.064093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x84e600 (9): Bad file descriptor 00:22:02.193 [2024-11-20 12:49:35.064124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6aa1b0 (9): Bad file descriptor 00:22:02.193 [2024-11-20 12:49:35.064175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064210] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064237] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064264] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83dc70 is same with the state(5) to be set 00:22:02.193 [2024-11-20 12:49:35.064311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6b3690 (9): Bad file descriptor 00:22:02.193 [2024-11-20 12:49:35.064359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064403] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064435] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064462] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:02.193 [2024-11-20 12:49:35.064474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.064487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83e150 is same with the state(5) to be set 00:22:02.193 [2024-11-20 12:49:35.065736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:02.193 [2024-11-20 12:49:35.065768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83dc70 (9): Bad file descriptor 00:22:02.193 [2024-11-20 12:49:35.065790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8290a0 (9): Bad file descriptor 00:22:02.193 [2024-11-20 12:49:35.065942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.065965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.065986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.193 [2024-11-20 12:49:35.066778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.193 [2024-11-20 12:49:35.066791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.066979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.066996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.194 [2024-11-20 12:49:35.067913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.194 [2024-11-20 12:49:35.067928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8de580 is same with the state(5) to be set 00:22:02.194 [2024-11-20 12:49:35.069562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:02.194 [2024-11-20 12:49:35.069618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:02.194 [2024-11-20 12:49:35.069636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:02.194 [2024-11-20 12:49:35.069653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:02.194 [2024-11-20 12:49:35.069675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:02.195 [2024-11-20 12:49:35.069690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:02.195 [2024-11-20 12:49:35.069703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:02.195 [2024-11-20 12:49:35.069749] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.195 [2024-11-20 12:49:35.070212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.195 [2024-11-20 12:49:35.070237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.195 [2024-11-20 12:49:35.070400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.195 [2024-11-20 12:49:35.070508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.195 [2024-11-20 12:49:35.070534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x83dc70 with addr=10.0.0.2, port=4420 00:22:02.195 [2024-11-20 12:49:35.070551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83dc70 is same with the state(5) to be set 00:22:02.195 [2024-11-20 12:49:35.070641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.195 [2024-11-20 12:49:35.070743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.195 [2024-11-20 12:49:35.070767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6e0590 with addr=10.0.0.2, port=4420 00:22:02.195 [2024-11-20 12:49:35.070789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6e0590 is same with the state(5) to be set 00:22:02.195 [2024-11-20 12:49:35.070896] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:02.195 [2024-11-20 12:49:35.071215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83dc70 (9): Bad file descriptor 00:22:02.195 [2024-11-20 12:49:35.071245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6e0590 (9): Bad file descriptor 00:22:02.195 [2024-11-20 12:49:35.071344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:02.195 [2024-11-20 12:49:35.071378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:02.195 [2024-11-20 12:49:35.071393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:02.195 [2024-11-20 12:49:35.071411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:02.195 [2024-11-20 12:49:35.071437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:02.195 [2024-11-20 12:49:35.071450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:02.195 [2024-11-20 12:49:35.071511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.195 [2024-11-20 12:49:35.071530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.195 [2024-11-20 12:49:35.073630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x838a60 (9): Bad file descriptor 00:22:02.195 [2024-11-20 12:49:35.073671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6d5490 (9): Bad file descriptor 00:22:02.195 [2024-11-20 12:49:35.073722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83e150 (9): Bad file descriptor 00:22:02.195 [2024-11-20 12:49:35.073857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.073882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.073912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.073928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.073946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.073961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.073977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.073991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.195 [2024-11-20 12:49:35.074611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.195 [2024-11-20 12:49:35.074627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.074973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.074989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.196 [2024-11-20 12:49:35.075825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.196 [2024-11-20 12:49:35.075839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.075855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.075869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.075883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x678550 is same with the state(5) to be set 00:22:02.197 [2024-11-20 12:49:35.077146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.077976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.077992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.197 [2024-11-20 12:49:35.078289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.197 [2024-11-20 12:49:35.078305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.078984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.078999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.079013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.079029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.079042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.079065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.079086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.079103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.079116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.079130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8141a0 is same with the state(5) to be set 00:22:02.198 [2024-11-20 12:49:35.080349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.198 [2024-11-20 12:49:35.080730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.198 [2024-11-20 12:49:35.080744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.080971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.080986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.199 [2024-11-20 12:49:35.081788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.199 [2024-11-20 12:49:35.081803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.081833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.081862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.081891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.081921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.081949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.081982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.081996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.082307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.082322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8156f0 is same with the state(5) to be set 00:22:02.200 [2024-11-20 12:49:35.083554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:02.200 [2024-11-20 12:49:35.083590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:02.200 [2024-11-20 12:49:35.083609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:02.200 [2024-11-20 12:49:35.083627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:02.200 [2024-11-20 12:49:35.084018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x687f70 with addr=10.0.0.2, port=4420 00:22:02.200 [2024-11-20 12:49:35.084206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x687f70 is same with the state(5) to be set 00:22:02.200 [2024-11-20 12:49:35.084296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x84e600 with addr=10.0.0.2, port=4420 00:22:02.200 [2024-11-20 12:49:35.084442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x84e600 is same with the state(5) to be set 00:22:02.200 [2024-11-20 12:49:35.084549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6aa1b0 with addr=10.0.0.2, port=4420 00:22:02.200 [2024-11-20 12:49:35.084690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6aa1b0 is same with the state(5) to be set 00:22:02.200 [2024-11-20 12:49:35.084775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.200 [2024-11-20 12:49:35.084892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6b3690 with addr=10.0.0.2, port=4420 00:22:02.200 [2024-11-20 12:49:35.084908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6b3690 is same with the state(5) to be set 00:22:02.200 [2024-11-20 12:49:35.085785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:02.200 [2024-11-20 12:49:35.085812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:02.200 [2024-11-20 12:49:35.085830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:02.200 [2024-11-20 12:49:35.085887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x687f70 (9): Bad file descriptor 00:22:02.200 [2024-11-20 12:49:35.085911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x84e600 (9): Bad file descriptor 00:22:02.200 [2024-11-20 12:49:35.085929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6aa1b0 (9): Bad file descriptor 00:22:02.200 [2024-11-20 12:49:35.085946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6b3690 (9): Bad file descriptor 00:22:02.200 [2024-11-20 12:49:35.086029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.200 [2024-11-20 12:49:35.086396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.200 [2024-11-20 12:49:35.086412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.086979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.086993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.201 [2024-11-20 12:49:35.087605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.201 [2024-11-20 12:49:35.087618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.087984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.087997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.088012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8d7950 is same with the state(5) to be set 00:22:02.202 [2024-11-20 12:49:35.089255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.089976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.089992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.090005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.202 [2024-11-20 12:49:35.090020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.202 [2024-11-20 12:49:35.090037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.090979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.090994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.203 [2024-11-20 12:49:35.091198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.203 [2024-11-20 12:49:35.091212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8da3e0 is same with the state(5) to be set 00:22:02.204 [2024-11-20 12:49:35.092423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.092983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.092998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:02.204 [2024-11-20 12:49:35.093011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:02.204 [2024-11-20 12:49:35.093025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8dcfa0 is same with the state(5) to be set 00:22:02.204 [2024-11-20 12:49:35.094438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:02.204 [2024-11-20 12:49:35.094470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:02.204 task offset: 29184 on job bdev=Nvme1n1 fails 00:22:02.204 00:22:02.204 Latency(us) 00:22:02.204 [2024-11-20T11:49:35.312Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme1n1 ended in about 0.59 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme1n1 : 0.59 352.46 22.03 108.45 0.00 137694.85 52428.80 118838.61 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme2n1 ended in about 0.62 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme2n1 : 0.62 266.08 16.63 103.84 0.00 169533.41 100197.26 138256.69 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme3n1 ended in about 0.62 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme3n1 : 0.62 335.72 20.98 103.30 0.00 141067.31 73788.68 117285.17 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme4n1 ended in about 0.62 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme4n1 : 0.62 334.01 20.88 102.77 0.00 140081.42 68351.62 116508.44 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme5n1 ended in about 0.63 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme5n1 : 0.63 330.97 20.69 101.84 0.00 139688.06 63302.92 116508.44 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme6n1 ended in about 0.60 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme6n1 : 0.60 347.97 21.75 33.46 0.00 155474.37 2548.62 132819.63 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme7n1 ended in about 0.63 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme7n1 : 0.63 329.32 20.58 101.33 0.00 136860.30 56312.41 117285.17 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme8n1 ended in about 0.60 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme8n1 : 0.60 343.81 21.49 105.79 0.00 128916.56 22330.79 111848.11 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme9n1 ended in about 0.63 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme9n1 : 0.63 328.46 20.53 31.58 0.00 152595.40 36894.34 121168.78 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:02.204 [2024-11-20T11:49:35.312Z] Job: Nvme10n1 ended in about 0.61 seconds with error 00:22:02.204 Verification LBA range: start 0x0 length 0x400 00:22:02.204 Nvme10n1 : 0.61 269.56 16.85 105.19 0.00 150832.45 87381.33 123498.95 00:22:02.205 [2024-11-20T11:49:35.313Z] =================================================================================================================== 00:22:02.205 [2024-11-20T11:49:35.313Z] Total : 3238.34 202.40 897.54 0.00 144455.67 2548.62 138256.69 00:22:02.205 [2024-11-20 12:49:35.119829] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:02.205 [2024-11-20 12:49:35.119912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:02.205 [2024-11-20 12:49:35.120239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.120365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.120392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8290a0 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.120412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8290a0 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.120494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.120592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.120618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6e0590 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.120634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6e0590 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.120768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.120861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.120898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x83dc70 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.120914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83dc70 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.120929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.120942] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.120959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:02.205 [2024-11-20 12:49:35.120986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.121000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.121013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:02.205 [2024-11-20 12:49:35.121029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.121043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.121058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:02.205 [2024-11-20 12:49:35.121084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.121101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.121114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:02.205 [2024-11-20 12:49:35.121168] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.121194] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.121213] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.121231] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.121383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.121406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.121419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.121430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.121567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.121666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.121692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x83e150 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.121709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83e150 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.121811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.121908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.121933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x838a60 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.121948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x838a60 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.122030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.122146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.122171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6d5490 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.122186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d5490 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.122212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8290a0 (9): Bad file descriptor 00:22:02.205 [2024-11-20 12:49:35.122235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6e0590 (9): Bad file descriptor 00:22:02.205 [2024-11-20 12:49:35.122252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83dc70 (9): Bad file descriptor 00:22:02.205 [2024-11-20 12:49:35.122271] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.122290] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.122308] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:02.205 [2024-11-20 12:49:35.123224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83e150 (9): Bad file descriptor 00:22:02.205 [2024-11-20 12:49:35.123254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x838a60 (9): Bad file descriptor 00:22:02.205 [2024-11-20 12:49:35.123273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6d5490 (9): Bad file descriptor 00:22:02.205 [2024-11-20 12:49:35.123289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.123302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.123314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:02.205 [2024-11-20 12:49:35.123331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.123345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.123358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:02.205 [2024-11-20 12:49:35.123374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.123387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.123399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:02.205 [2024-11-20 12:49:35.123472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:02.205 [2024-11-20 12:49:35.123496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:02.205 [2024-11-20 12:49:35.123513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:02.205 [2024-11-20 12:49:35.123528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:02.205 [2024-11-20 12:49:35.123543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.123555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.123567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.123604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.123620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.123638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:02.205 [2024-11-20 12:49:35.123656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.123669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.123683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:02.205 [2024-11-20 12:49:35.123698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:02.205 [2024-11-20 12:49:35.123712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:02.205 [2024-11-20 12:49:35.123724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:02.205 [2024-11-20 12:49:35.123784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.123804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.123816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.205 [2024-11-20 12:49:35.123936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.124032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.124063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6b3690 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.124115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6b3690 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.124215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.124324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.205 [2024-11-20 12:49:35.124348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6aa1b0 with addr=10.0.0.2, port=4420 00:22:02.205 [2024-11-20 12:49:35.124362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6aa1b0 is same with the state(5) to be set 00:22:02.205 [2024-11-20 12:49:35.124475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.206 [2024-11-20 12:49:35.124567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.206 [2024-11-20 12:49:35.124592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x84e600 with addr=10.0.0.2, port=4420 00:22:02.206 [2024-11-20 12:49:35.124607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x84e600 is same with the state(5) to be set 00:22:02.206 [2024-11-20 12:49:35.124691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.206 [2024-11-20 12:49:35.124783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:02.206 [2024-11-20 12:49:35.124808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x687f70 with addr=10.0.0.2, port=4420 00:22:02.206 [2024-11-20 12:49:35.124823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x687f70 is same with the state(5) to be set 00:22:02.206 [2024-11-20 12:49:35.124874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6b3690 (9): Bad file descriptor 00:22:02.206 [2024-11-20 12:49:35.124899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6aa1b0 (9): Bad file descriptor 00:22:02.206 [2024-11-20 12:49:35.124917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x84e600 (9): Bad file descriptor 00:22:02.206 [2024-11-20 12:49:35.124934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x687f70 (9): Bad file descriptor 00:22:02.206 [2024-11-20 12:49:35.124975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:02.206 [2024-11-20 12:49:35.124998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:02.206 [2024-11-20 12:49:35.125013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:02.206 [2024-11-20 12:49:35.125029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:02.206 [2024-11-20 12:49:35.125042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:02.206 [2024-11-20 12:49:35.125055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:02.206 [2024-11-20 12:49:35.125079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:02.206 [2024-11-20 12:49:35.125095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:02.206 [2024-11-20 12:49:35.125108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:02.206 [2024-11-20 12:49:35.125123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:02.206 [2024-11-20 12:49:35.125136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:02.206 [2024-11-20 12:49:35.125148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:02.206 [2024-11-20 12:49:35.125185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.206 [2024-11-20 12:49:35.125204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.206 [2024-11-20 12:49:35.125216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.206 [2024-11-20 12:49:35.125227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:02.773 12:49:35 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:02.773 12:49:35 -- target/shutdown.sh@138 -- # sleep 1 00:22:03.715 12:49:36 -- target/shutdown.sh@141 -- # kill -9 3588902 00:22:03.715 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3588902) - No such process 00:22:03.715 12:49:36 -- target/shutdown.sh@141 -- # true 00:22:03.715 12:49:36 -- target/shutdown.sh@143 -- # stoptarget 00:22:03.715 12:49:36 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:03.715 12:49:36 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:03.715 12:49:36 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:03.715 12:49:36 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:03.715 12:49:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:03.715 12:49:36 -- nvmf/common.sh@116 -- # sync 00:22:03.715 12:49:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:03.715 12:49:36 -- nvmf/common.sh@119 -- # set +e 00:22:03.715 12:49:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:03.715 12:49:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:03.715 rmmod nvme_tcp 00:22:03.715 rmmod nvme_fabrics 00:22:03.715 rmmod nvme_keyring 00:22:03.715 12:49:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:03.715 12:49:36 -- nvmf/common.sh@123 -- # set -e 00:22:03.715 12:49:36 -- nvmf/common.sh@124 -- # return 0 00:22:03.715 12:49:36 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:03.715 12:49:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:03.715 12:49:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:03.715 12:49:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:03.715 12:49:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:03.715 12:49:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:03.715 12:49:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:03.715 12:49:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:03.715 12:49:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:05.620 12:49:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:05.620 00:22:05.620 real 0m7.579s 00:22:05.620 user 0m18.598s 00:22:05.620 sys 0m1.351s 00:22:05.620 12:49:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:05.620 12:49:38 -- common/autotest_common.sh@10 -- # set +x 00:22:05.620 ************************************ 00:22:05.620 END TEST nvmf_shutdown_tc3 00:22:05.620 ************************************ 00:22:05.879 12:49:38 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:05.879 00:22:05.879 real 0m28.772s 00:22:05.879 user 1m22.081s 00:22:05.879 sys 0m6.312s 00:22:05.879 12:49:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:05.879 12:49:38 -- common/autotest_common.sh@10 -- # set +x 00:22:05.879 ************************************ 00:22:05.879 END TEST nvmf_shutdown 00:22:05.879 ************************************ 00:22:05.879 12:49:38 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:05.879 12:49:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:05.879 12:49:38 -- common/autotest_common.sh@10 -- # set +x 00:22:05.879 12:49:38 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:05.879 12:49:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:05.879 12:49:38 -- common/autotest_common.sh@10 -- # set +x 00:22:05.879 12:49:38 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:05.879 12:49:38 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:05.879 12:49:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:05.879 12:49:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:05.879 12:49:38 -- common/autotest_common.sh@10 -- # set +x 00:22:05.879 ************************************ 00:22:05.879 START TEST nvmf_multicontroller 00:22:05.879 ************************************ 00:22:05.879 12:49:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:05.879 * Looking for test storage... 00:22:05.879 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:05.879 12:49:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:05.879 12:49:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:05.879 12:49:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:05.879 12:49:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:05.879 12:49:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:05.879 12:49:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:05.879 12:49:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:05.879 12:49:38 -- scripts/common.sh@335 -- # IFS=.-: 00:22:05.879 12:49:38 -- scripts/common.sh@335 -- # read -ra ver1 00:22:05.879 12:49:38 -- scripts/common.sh@336 -- # IFS=.-: 00:22:05.879 12:49:38 -- scripts/common.sh@336 -- # read -ra ver2 00:22:05.879 12:49:38 -- scripts/common.sh@337 -- # local 'op=<' 00:22:05.879 12:49:38 -- scripts/common.sh@339 -- # ver1_l=2 00:22:05.879 12:49:38 -- scripts/common.sh@340 -- # ver2_l=1 00:22:05.879 12:49:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:05.879 12:49:38 -- scripts/common.sh@343 -- # case "$op" in 00:22:05.879 12:49:38 -- scripts/common.sh@344 -- # : 1 00:22:05.879 12:49:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:05.880 12:49:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:05.880 12:49:38 -- scripts/common.sh@364 -- # decimal 1 00:22:05.880 12:49:38 -- scripts/common.sh@352 -- # local d=1 00:22:05.880 12:49:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:05.880 12:49:38 -- scripts/common.sh@354 -- # echo 1 00:22:05.880 12:49:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:05.880 12:49:38 -- scripts/common.sh@365 -- # decimal 2 00:22:05.880 12:49:38 -- scripts/common.sh@352 -- # local d=2 00:22:05.880 12:49:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:05.880 12:49:38 -- scripts/common.sh@354 -- # echo 2 00:22:05.880 12:49:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:05.880 12:49:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:05.880 12:49:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:05.880 12:49:38 -- scripts/common.sh@367 -- # return 0 00:22:05.880 12:49:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:05.880 12:49:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:05.880 --rc genhtml_branch_coverage=1 00:22:05.880 --rc genhtml_function_coverage=1 00:22:05.880 --rc genhtml_legend=1 00:22:05.880 --rc geninfo_all_blocks=1 00:22:05.880 --rc geninfo_unexecuted_blocks=1 00:22:05.880 00:22:05.880 ' 00:22:05.880 12:49:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:05.880 --rc genhtml_branch_coverage=1 00:22:05.880 --rc genhtml_function_coverage=1 00:22:05.880 --rc genhtml_legend=1 00:22:05.880 --rc geninfo_all_blocks=1 00:22:05.880 --rc geninfo_unexecuted_blocks=1 00:22:05.880 00:22:05.880 ' 00:22:05.880 12:49:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:05.880 --rc genhtml_branch_coverage=1 00:22:05.880 --rc genhtml_function_coverage=1 00:22:05.880 --rc genhtml_legend=1 00:22:05.880 --rc geninfo_all_blocks=1 00:22:05.880 --rc geninfo_unexecuted_blocks=1 00:22:05.880 00:22:05.880 ' 00:22:05.880 12:49:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:05.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:05.880 --rc genhtml_branch_coverage=1 00:22:05.880 --rc genhtml_function_coverage=1 00:22:05.880 --rc genhtml_legend=1 00:22:05.880 --rc geninfo_all_blocks=1 00:22:05.880 --rc geninfo_unexecuted_blocks=1 00:22:05.880 00:22:05.880 ' 00:22:05.880 12:49:38 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:05.880 12:49:38 -- nvmf/common.sh@7 -- # uname -s 00:22:05.880 12:49:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:05.880 12:49:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:05.880 12:49:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:05.880 12:49:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:05.880 12:49:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:05.880 12:49:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:05.880 12:49:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:05.880 12:49:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:05.880 12:49:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:05.880 12:49:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:05.880 12:49:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:05.880 12:49:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:05.880 12:49:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:05.880 12:49:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:05.880 12:49:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:05.880 12:49:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:05.880 12:49:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:05.880 12:49:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:05.880 12:49:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:05.880 12:49:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:05.880 12:49:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:05.880 12:49:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:05.880 12:49:38 -- paths/export.sh@5 -- # export PATH 00:22:05.880 12:49:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:05.880 12:49:38 -- nvmf/common.sh@46 -- # : 0 00:22:05.880 12:49:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:05.880 12:49:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:05.880 12:49:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:05.880 12:49:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:05.880 12:49:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:05.880 12:49:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:05.880 12:49:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:05.880 12:49:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:05.880 12:49:38 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:05.880 12:49:38 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:05.880 12:49:38 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:05.880 12:49:38 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:05.880 12:49:38 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:05.880 12:49:38 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:05.880 12:49:38 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:05.880 12:49:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:05.880 12:49:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:05.880 12:49:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:05.880 12:49:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:05.880 12:49:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:05.880 12:49:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:05.880 12:49:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:05.880 12:49:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:05.880 12:49:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:05.880 12:49:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:05.880 12:49:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:05.880 12:49:38 -- common/autotest_common.sh@10 -- # set +x 00:22:08.415 12:49:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:08.415 12:49:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:08.415 12:49:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:08.415 12:49:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:08.415 12:49:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:08.415 12:49:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:08.415 12:49:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:08.415 12:49:40 -- nvmf/common.sh@294 -- # net_devs=() 00:22:08.415 12:49:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:08.415 12:49:40 -- nvmf/common.sh@295 -- # e810=() 00:22:08.415 12:49:40 -- nvmf/common.sh@295 -- # local -ga e810 00:22:08.415 12:49:40 -- nvmf/common.sh@296 -- # x722=() 00:22:08.415 12:49:40 -- nvmf/common.sh@296 -- # local -ga x722 00:22:08.415 12:49:40 -- nvmf/common.sh@297 -- # mlx=() 00:22:08.415 12:49:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:08.415 12:49:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:08.415 12:49:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:08.415 12:49:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:08.415 12:49:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:08.415 12:49:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:08.415 12:49:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:08.415 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:08.415 12:49:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:08.415 12:49:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:08.415 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:08.415 12:49:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:08.415 12:49:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:08.415 12:49:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:08.415 12:49:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:08.415 12:49:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:08.415 12:49:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:08.415 12:49:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:08.416 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:08.416 12:49:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:08.416 12:49:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:08.416 12:49:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:08.416 12:49:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:08.416 12:49:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:08.416 12:49:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:08.416 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:08.416 12:49:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:08.416 12:49:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:08.416 12:49:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:08.416 12:49:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:08.416 12:49:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:08.416 12:49:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:08.416 12:49:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:08.416 12:49:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:08.416 12:49:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:08.416 12:49:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:08.416 12:49:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:08.416 12:49:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:08.416 12:49:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:08.416 12:49:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:08.416 12:49:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:08.416 12:49:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:08.416 12:49:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:08.416 12:49:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:08.416 12:49:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:08.416 12:49:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:08.416 12:49:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:08.416 12:49:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:08.416 12:49:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:08.416 12:49:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:08.416 12:49:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:08.416 12:49:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:08.416 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:08.416 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:22:08.416 00:22:08.416 --- 10.0.0.2 ping statistics --- 00:22:08.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:08.416 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:22:08.416 12:49:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:08.416 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:08.416 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:22:08.416 00:22:08.416 --- 10.0.0.1 ping statistics --- 00:22:08.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:08.416 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:22:08.416 12:49:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:08.416 12:49:41 -- nvmf/common.sh@410 -- # return 0 00:22:08.416 12:49:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:08.416 12:49:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:08.416 12:49:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:08.416 12:49:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:08.416 12:49:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:08.416 12:49:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:08.416 12:49:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:08.416 12:49:41 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:08.416 12:49:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:08.416 12:49:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:08.416 12:49:41 -- common/autotest_common.sh@10 -- # set +x 00:22:08.416 12:49:41 -- nvmf/common.sh@469 -- # nvmfpid=3591447 00:22:08.416 12:49:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:08.416 12:49:41 -- nvmf/common.sh@470 -- # waitforlisten 3591447 00:22:08.416 12:49:41 -- common/autotest_common.sh@829 -- # '[' -z 3591447 ']' 00:22:08.416 12:49:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:08.416 12:49:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:08.416 12:49:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:08.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:08.416 12:49:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:08.416 12:49:41 -- common/autotest_common.sh@10 -- # set +x 00:22:08.416 [2024-11-20 12:49:41.129406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:08.416 [2024-11-20 12:49:41.129510] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:08.416 EAL: No free 2048 kB hugepages reported on node 1 00:22:08.416 [2024-11-20 12:49:41.194545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:08.416 [2024-11-20 12:49:41.304994] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:08.416 [2024-11-20 12:49:41.305169] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:08.416 [2024-11-20 12:49:41.305188] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:08.416 [2024-11-20 12:49:41.305201] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:08.416 [2024-11-20 12:49:41.305307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:08.416 [2024-11-20 12:49:41.305361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:08.416 [2024-11-20 12:49:41.305364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:09.352 12:49:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:09.352 12:49:42 -- common/autotest_common.sh@862 -- # return 0 00:22:09.352 12:49:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:09.352 12:49:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:09.352 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:09.353 12:49:42 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 [2024-11-20 12:49:42.156538] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 Malloc0 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 [2024-11-20 12:49:42.220633] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 [2024-11-20 12:49:42.228529] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 Malloc1 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:09.353 12:49:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:09.353 12:49:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:09.353 12:49:42 -- host/multicontroller.sh@44 -- # bdevperf_pid=3591613 00:22:09.353 12:49:42 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:09.353 12:49:42 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:09.353 12:49:42 -- host/multicontroller.sh@47 -- # waitforlisten 3591613 /var/tmp/bdevperf.sock 00:22:09.353 12:49:42 -- common/autotest_common.sh@829 -- # '[' -z 3591613 ']' 00:22:09.353 12:49:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:09.353 12:49:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:09.353 12:49:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:09.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:09.353 12:49:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:09.353 12:49:42 -- common/autotest_common.sh@10 -- # set +x 00:22:10.290 12:49:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:10.290 12:49:43 -- common/autotest_common.sh@862 -- # return 0 00:22:10.290 12:49:43 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:10.290 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.290 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.551 NVMe0n1 00:22:10.551 12:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.551 12:49:43 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:10.551 12:49:43 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:10.551 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.551 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.551 12:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.551 1 00:22:10.551 12:49:43 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:10.551 12:49:43 -- common/autotest_common.sh@650 -- # local es=0 00:22:10.551 12:49:43 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:10.551 12:49:43 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:10.551 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.551 12:49:43 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:10.551 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.551 12:49:43 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:10.551 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.551 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.551 request: 00:22:10.551 { 00:22:10.551 "name": "NVMe0", 00:22:10.551 "trtype": "tcp", 00:22:10.551 "traddr": "10.0.0.2", 00:22:10.551 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:10.551 "hostaddr": "10.0.0.2", 00:22:10.551 "hostsvcid": "60000", 00:22:10.551 "adrfam": "ipv4", 00:22:10.551 "trsvcid": "4420", 00:22:10.551 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:10.551 "method": "bdev_nvme_attach_controller", 00:22:10.551 "req_id": 1 00:22:10.551 } 00:22:10.551 Got JSON-RPC error response 00:22:10.551 response: 00:22:10.551 { 00:22:10.551 "code": -114, 00:22:10.551 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:10.551 } 00:22:10.551 12:49:43 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:10.551 12:49:43 -- common/autotest_common.sh@653 -- # es=1 00:22:10.551 12:49:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:10.551 12:49:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:10.551 12:49:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:10.551 12:49:43 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:10.551 12:49:43 -- common/autotest_common.sh@650 -- # local es=0 00:22:10.551 12:49:43 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:10.551 12:49:43 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:10.551 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.551 12:49:43 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:10.551 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.551 12:49:43 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:10.551 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.551 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.551 request: 00:22:10.551 { 00:22:10.551 "name": "NVMe0", 00:22:10.551 "trtype": "tcp", 00:22:10.551 "traddr": "10.0.0.2", 00:22:10.551 "hostaddr": "10.0.0.2", 00:22:10.551 "hostsvcid": "60000", 00:22:10.551 "adrfam": "ipv4", 00:22:10.551 "trsvcid": "4420", 00:22:10.551 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:10.551 "method": "bdev_nvme_attach_controller", 00:22:10.551 "req_id": 1 00:22:10.551 } 00:22:10.551 Got JSON-RPC error response 00:22:10.551 response: 00:22:10.551 { 00:22:10.551 "code": -114, 00:22:10.551 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:10.551 } 00:22:10.551 12:49:43 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:10.551 12:49:43 -- common/autotest_common.sh@653 -- # es=1 00:22:10.551 12:49:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:10.551 12:49:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:10.551 12:49:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:10.551 12:49:43 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:10.551 12:49:43 -- common/autotest_common.sh@650 -- # local es=0 00:22:10.552 12:49:43 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:10.552 12:49:43 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:10.552 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.552 12:49:43 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:10.552 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.552 12:49:43 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:10.552 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.552 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.552 request: 00:22:10.552 { 00:22:10.552 "name": "NVMe0", 00:22:10.552 "trtype": "tcp", 00:22:10.552 "traddr": "10.0.0.2", 00:22:10.552 "hostaddr": "10.0.0.2", 00:22:10.552 "hostsvcid": "60000", 00:22:10.552 "adrfam": "ipv4", 00:22:10.552 "trsvcid": "4420", 00:22:10.552 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:10.552 "multipath": "disable", 00:22:10.552 "method": "bdev_nvme_attach_controller", 00:22:10.552 "req_id": 1 00:22:10.552 } 00:22:10.552 Got JSON-RPC error response 00:22:10.552 response: 00:22:10.552 { 00:22:10.552 "code": -114, 00:22:10.552 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:10.552 } 00:22:10.552 12:49:43 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:10.552 12:49:43 -- common/autotest_common.sh@653 -- # es=1 00:22:10.552 12:49:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:10.552 12:49:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:10.552 12:49:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:10.552 12:49:43 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:10.552 12:49:43 -- common/autotest_common.sh@650 -- # local es=0 00:22:10.552 12:49:43 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:10.552 12:49:43 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:10.552 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.552 12:49:43 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:10.552 12:49:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:10.552 12:49:43 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:10.552 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.552 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.552 request: 00:22:10.552 { 00:22:10.552 "name": "NVMe0", 00:22:10.552 "trtype": "tcp", 00:22:10.552 "traddr": "10.0.0.2", 00:22:10.552 "hostaddr": "10.0.0.2", 00:22:10.552 "hostsvcid": "60000", 00:22:10.552 "adrfam": "ipv4", 00:22:10.552 "trsvcid": "4420", 00:22:10.552 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:10.552 "multipath": "failover", 00:22:10.552 "method": "bdev_nvme_attach_controller", 00:22:10.552 "req_id": 1 00:22:10.552 } 00:22:10.552 Got JSON-RPC error response 00:22:10.552 response: 00:22:10.552 { 00:22:10.552 "code": -114, 00:22:10.552 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:10.552 } 00:22:10.552 12:49:43 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:10.552 12:49:43 -- common/autotest_common.sh@653 -- # es=1 00:22:10.552 12:49:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:10.552 12:49:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:10.552 12:49:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:10.552 12:49:43 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:10.552 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.552 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.811 00:22:10.812 12:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.812 12:49:43 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:10.812 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.812 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:10.812 12:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.812 12:49:43 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:10.812 12:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.812 12:49:43 -- common/autotest_common.sh@10 -- # set +x 00:22:11.070 00:22:11.070 12:49:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:11.070 12:49:44 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:11.070 12:49:44 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:11.070 12:49:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:11.070 12:49:44 -- common/autotest_common.sh@10 -- # set +x 00:22:11.070 12:49:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:11.070 12:49:44 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:11.070 12:49:44 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:12.448 0 00:22:12.448 12:49:45 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:12.448 12:49:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.448 12:49:45 -- common/autotest_common.sh@10 -- # set +x 00:22:12.448 12:49:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.448 12:49:45 -- host/multicontroller.sh@100 -- # killprocess 3591613 00:22:12.448 12:49:45 -- common/autotest_common.sh@936 -- # '[' -z 3591613 ']' 00:22:12.448 12:49:45 -- common/autotest_common.sh@940 -- # kill -0 3591613 00:22:12.448 12:49:45 -- common/autotest_common.sh@941 -- # uname 00:22:12.448 12:49:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:12.448 12:49:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3591613 00:22:12.448 12:49:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:12.448 12:49:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:12.448 12:49:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3591613' 00:22:12.448 killing process with pid 3591613 00:22:12.448 12:49:45 -- common/autotest_common.sh@955 -- # kill 3591613 00:22:12.448 12:49:45 -- common/autotest_common.sh@960 -- # wait 3591613 00:22:12.448 12:49:45 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:12.448 12:49:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.448 12:49:45 -- common/autotest_common.sh@10 -- # set +x 00:22:12.448 12:49:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.448 12:49:45 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:12.448 12:49:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.448 12:49:45 -- common/autotest_common.sh@10 -- # set +x 00:22:12.448 12:49:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.448 12:49:45 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:12.448 12:49:45 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:12.448 12:49:45 -- common/autotest_common.sh@1607 -- # read -r file 00:22:12.448 12:49:45 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:12.448 12:49:45 -- common/autotest_common.sh@1606 -- # sort -u 00:22:12.448 12:49:45 -- common/autotest_common.sh@1608 -- # cat 00:22:12.448 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:12.448 [2024-11-20 12:49:42.320324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:12.448 [2024-11-20 12:49:42.320417] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3591613 ] 00:22:12.448 EAL: No free 2048 kB hugepages reported on node 1 00:22:12.448 [2024-11-20 12:49:42.378891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:12.448 [2024-11-20 12:49:42.486000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:12.448 [2024-11-20 12:49:44.029635] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 38b89a64-29a0-49f4-8ff3-bdb5799704a7 already exists 00:22:12.448 [2024-11-20 12:49:44.029674] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:38b89a64-29a0-49f4-8ff3-bdb5799704a7 alias for bdev NVMe1n1 00:22:12.448 [2024-11-20 12:49:44.029708] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:12.448 Running I/O for 1 seconds... 00:22:12.448 00:22:12.448 Latency(us) 00:22:12.448 [2024-11-20T11:49:45.556Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:12.448 [2024-11-20T11:49:45.556Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:12.448 NVMe0n1 : 1.00 19954.43 77.95 0.00 0.00 6405.62 2463.67 11553.75 00:22:12.448 [2024-11-20T11:49:45.556Z] =================================================================================================================== 00:22:12.448 [2024-11-20T11:49:45.556Z] Total : 19954.43 77.95 0.00 0.00 6405.62 2463.67 11553.75 00:22:12.448 Received shutdown signal, test time was about 1.000000 seconds 00:22:12.448 00:22:12.448 Latency(us) 00:22:12.448 [2024-11-20T11:49:45.557Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:12.449 [2024-11-20T11:49:45.557Z] =================================================================================================================== 00:22:12.449 [2024-11-20T11:49:45.557Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:12.449 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:12.449 12:49:45 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:12.449 12:49:45 -- common/autotest_common.sh@1607 -- # read -r file 00:22:12.449 12:49:45 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:12.449 12:49:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:12.449 12:49:45 -- nvmf/common.sh@116 -- # sync 00:22:12.449 12:49:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:12.449 12:49:45 -- nvmf/common.sh@119 -- # set +e 00:22:12.449 12:49:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:12.449 12:49:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:12.449 rmmod nvme_tcp 00:22:12.449 rmmod nvme_fabrics 00:22:12.449 rmmod nvme_keyring 00:22:12.707 12:49:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:12.707 12:49:45 -- nvmf/common.sh@123 -- # set -e 00:22:12.707 12:49:45 -- nvmf/common.sh@124 -- # return 0 00:22:12.707 12:49:45 -- nvmf/common.sh@477 -- # '[' -n 3591447 ']' 00:22:12.707 12:49:45 -- nvmf/common.sh@478 -- # killprocess 3591447 00:22:12.707 12:49:45 -- common/autotest_common.sh@936 -- # '[' -z 3591447 ']' 00:22:12.707 12:49:45 -- common/autotest_common.sh@940 -- # kill -0 3591447 00:22:12.707 12:49:45 -- common/autotest_common.sh@941 -- # uname 00:22:12.707 12:49:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:12.707 12:49:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3591447 00:22:12.707 12:49:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:12.707 12:49:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:12.707 12:49:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3591447' 00:22:12.707 killing process with pid 3591447 00:22:12.707 12:49:45 -- common/autotest_common.sh@955 -- # kill 3591447 00:22:12.707 12:49:45 -- common/autotest_common.sh@960 -- # wait 3591447 00:22:12.965 12:49:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:12.965 12:49:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:12.965 12:49:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:12.965 12:49:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:12.965 12:49:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:12.965 12:49:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:12.965 12:49:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:12.965 12:49:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:14.870 12:49:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:14.870 00:22:14.870 real 0m9.146s 00:22:14.870 user 0m18.105s 00:22:14.870 sys 0m2.347s 00:22:14.870 12:49:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:14.870 12:49:47 -- common/autotest_common.sh@10 -- # set +x 00:22:14.870 ************************************ 00:22:14.870 END TEST nvmf_multicontroller 00:22:14.870 ************************************ 00:22:14.870 12:49:47 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:14.870 12:49:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:14.870 12:49:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:14.870 12:49:47 -- common/autotest_common.sh@10 -- # set +x 00:22:14.870 ************************************ 00:22:14.870 START TEST nvmf_aer 00:22:14.870 ************************************ 00:22:14.870 12:49:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:15.129 * Looking for test storage... 00:22:15.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:15.129 12:49:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:15.129 12:49:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:15.129 12:49:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:15.129 12:49:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:15.129 12:49:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:15.129 12:49:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:15.129 12:49:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:15.129 12:49:48 -- scripts/common.sh@335 -- # IFS=.-: 00:22:15.129 12:49:48 -- scripts/common.sh@335 -- # read -ra ver1 00:22:15.129 12:49:48 -- scripts/common.sh@336 -- # IFS=.-: 00:22:15.129 12:49:48 -- scripts/common.sh@336 -- # read -ra ver2 00:22:15.129 12:49:48 -- scripts/common.sh@337 -- # local 'op=<' 00:22:15.129 12:49:48 -- scripts/common.sh@339 -- # ver1_l=2 00:22:15.129 12:49:48 -- scripts/common.sh@340 -- # ver2_l=1 00:22:15.129 12:49:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:15.129 12:49:48 -- scripts/common.sh@343 -- # case "$op" in 00:22:15.129 12:49:48 -- scripts/common.sh@344 -- # : 1 00:22:15.129 12:49:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:15.129 12:49:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:15.129 12:49:48 -- scripts/common.sh@364 -- # decimal 1 00:22:15.129 12:49:48 -- scripts/common.sh@352 -- # local d=1 00:22:15.129 12:49:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:15.129 12:49:48 -- scripts/common.sh@354 -- # echo 1 00:22:15.129 12:49:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:15.129 12:49:48 -- scripts/common.sh@365 -- # decimal 2 00:22:15.129 12:49:48 -- scripts/common.sh@352 -- # local d=2 00:22:15.129 12:49:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:15.129 12:49:48 -- scripts/common.sh@354 -- # echo 2 00:22:15.129 12:49:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:15.129 12:49:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:15.129 12:49:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:15.129 12:49:48 -- scripts/common.sh@367 -- # return 0 00:22:15.129 12:49:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:15.129 12:49:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:15.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.129 --rc genhtml_branch_coverage=1 00:22:15.129 --rc genhtml_function_coverage=1 00:22:15.129 --rc genhtml_legend=1 00:22:15.129 --rc geninfo_all_blocks=1 00:22:15.129 --rc geninfo_unexecuted_blocks=1 00:22:15.129 00:22:15.129 ' 00:22:15.129 12:49:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:15.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.129 --rc genhtml_branch_coverage=1 00:22:15.129 --rc genhtml_function_coverage=1 00:22:15.129 --rc genhtml_legend=1 00:22:15.129 --rc geninfo_all_blocks=1 00:22:15.129 --rc geninfo_unexecuted_blocks=1 00:22:15.129 00:22:15.129 ' 00:22:15.129 12:49:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:15.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.129 --rc genhtml_branch_coverage=1 00:22:15.129 --rc genhtml_function_coverage=1 00:22:15.129 --rc genhtml_legend=1 00:22:15.129 --rc geninfo_all_blocks=1 00:22:15.129 --rc geninfo_unexecuted_blocks=1 00:22:15.129 00:22:15.129 ' 00:22:15.130 12:49:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:15.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.130 --rc genhtml_branch_coverage=1 00:22:15.130 --rc genhtml_function_coverage=1 00:22:15.130 --rc genhtml_legend=1 00:22:15.130 --rc geninfo_all_blocks=1 00:22:15.130 --rc geninfo_unexecuted_blocks=1 00:22:15.130 00:22:15.130 ' 00:22:15.130 12:49:48 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:15.130 12:49:48 -- nvmf/common.sh@7 -- # uname -s 00:22:15.130 12:49:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:15.130 12:49:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:15.130 12:49:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:15.130 12:49:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:15.130 12:49:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:15.130 12:49:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:15.130 12:49:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:15.130 12:49:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:15.130 12:49:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:15.130 12:49:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:15.130 12:49:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.130 12:49:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.130 12:49:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:15.130 12:49:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:15.130 12:49:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:15.130 12:49:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:15.130 12:49:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:15.130 12:49:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:15.130 12:49:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:15.130 12:49:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.130 12:49:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.130 12:49:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.130 12:49:48 -- paths/export.sh@5 -- # export PATH 00:22:15.130 12:49:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.130 12:49:48 -- nvmf/common.sh@46 -- # : 0 00:22:15.130 12:49:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:15.130 12:49:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:15.130 12:49:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:15.130 12:49:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:15.130 12:49:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:15.130 12:49:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:15.130 12:49:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:15.130 12:49:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:15.130 12:49:48 -- host/aer.sh@11 -- # nvmftestinit 00:22:15.130 12:49:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:15.130 12:49:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:15.130 12:49:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:15.130 12:49:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:15.130 12:49:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:15.130 12:49:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.130 12:49:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.130 12:49:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.130 12:49:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:15.130 12:49:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:15.130 12:49:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:15.130 12:49:48 -- common/autotest_common.sh@10 -- # set +x 00:22:17.663 12:49:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.663 12:49:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.663 12:49:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.663 12:49:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.663 12:49:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.663 12:49:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.663 12:49:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.663 12:49:50 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.663 12:49:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.663 12:49:50 -- nvmf/common.sh@295 -- # e810=() 00:22:17.663 12:49:50 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.663 12:49:50 -- nvmf/common.sh@296 -- # x722=() 00:22:17.663 12:49:50 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.663 12:49:50 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.663 12:49:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.663 12:49:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.663 12:49:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.663 12:49:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.663 12:49:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.663 12:49:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.663 12:49:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.663 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.663 12:49:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.663 12:49:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.663 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.663 12:49:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.663 12:49:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.663 12:49:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.663 12:49:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.663 12:49:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.663 12:49:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.663 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.663 12:49:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.663 12:49:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.663 12:49:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.663 12:49:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.663 12:49:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.663 12:49:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.663 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.663 12:49:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.663 12:49:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.663 12:49:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.663 12:49:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.663 12:49:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.663 12:49:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.663 12:49:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.663 12:49:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.663 12:49:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.663 12:49:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.663 12:49:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.663 12:49:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.663 12:49:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.663 12:49:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.663 12:49:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.663 12:49:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.663 12:49:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.663 12:49:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.663 12:49:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.663 12:49:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.663 12:49:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.663 12:49:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.663 12:49:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.663 12:49:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.663 12:49:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.663 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.663 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:22:17.663 00:22:17.663 --- 10.0.0.2 ping statistics --- 00:22:17.663 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.663 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:22:17.663 12:49:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.663 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.663 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:22:17.663 00:22:17.663 --- 10.0.0.1 ping statistics --- 00:22:17.663 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.664 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:22:17.664 12:49:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.664 12:49:50 -- nvmf/common.sh@410 -- # return 0 00:22:17.664 12:49:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.664 12:49:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.664 12:49:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.664 12:49:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.664 12:49:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.664 12:49:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.664 12:49:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.664 12:49:50 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:17.664 12:49:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.664 12:49:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.664 12:49:50 -- common/autotest_common.sh@10 -- # set +x 00:22:17.664 12:49:50 -- nvmf/common.sh@469 -- # nvmfpid=3593985 00:22:17.664 12:49:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:17.664 12:49:50 -- nvmf/common.sh@470 -- # waitforlisten 3593985 00:22:17.664 12:49:50 -- common/autotest_common.sh@829 -- # '[' -z 3593985 ']' 00:22:17.664 12:49:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.664 12:49:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.664 12:49:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.664 12:49:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.664 12:49:50 -- common/autotest_common.sh@10 -- # set +x 00:22:17.664 [2024-11-20 12:49:50.406212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:17.664 [2024-11-20 12:49:50.406297] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.664 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.664 [2024-11-20 12:49:50.475439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:17.664 [2024-11-20 12:49:50.587880] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:17.664 [2024-11-20 12:49:50.588042] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:17.664 [2024-11-20 12:49:50.588059] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:17.664 [2024-11-20 12:49:50.588077] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:17.664 [2024-11-20 12:49:50.588136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:17.664 [2024-11-20 12:49:50.588198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:17.664 [2024-11-20 12:49:50.588263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:17.664 [2024-11-20 12:49:50.588266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:18.651 12:49:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:18.651 12:49:51 -- common/autotest_common.sh@862 -- # return 0 00:22:18.651 12:49:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.651 12:49:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.651 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.651 12:49:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:18.651 12:49:51 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:18.651 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.651 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.651 [2024-11-20 12:49:51.409695] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:18.651 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.651 12:49:51 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:18.651 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.651 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.651 Malloc0 00:22:18.651 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.651 12:49:51 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:18.651 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.651 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.651 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.651 12:49:51 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:18.651 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.651 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.652 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.652 12:49:51 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:18.652 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.652 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.652 [2024-11-20 12:49:51.460847] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.652 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.652 12:49:51 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:18.652 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.652 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.652 [2024-11-20 12:49:51.468570] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:18.652 [ 00:22:18.652 { 00:22:18.652 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:18.652 "subtype": "Discovery", 00:22:18.652 "listen_addresses": [], 00:22:18.652 "allow_any_host": true, 00:22:18.652 "hosts": [] 00:22:18.652 }, 00:22:18.652 { 00:22:18.652 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:18.652 "subtype": "NVMe", 00:22:18.652 "listen_addresses": [ 00:22:18.652 { 00:22:18.652 "transport": "TCP", 00:22:18.652 "trtype": "TCP", 00:22:18.652 "adrfam": "IPv4", 00:22:18.652 "traddr": "10.0.0.2", 00:22:18.652 "trsvcid": "4420" 00:22:18.652 } 00:22:18.652 ], 00:22:18.652 "allow_any_host": true, 00:22:18.652 "hosts": [], 00:22:18.652 "serial_number": "SPDK00000000000001", 00:22:18.652 "model_number": "SPDK bdev Controller", 00:22:18.652 "max_namespaces": 2, 00:22:18.652 "min_cntlid": 1, 00:22:18.652 "max_cntlid": 65519, 00:22:18.652 "namespaces": [ 00:22:18.652 { 00:22:18.652 "nsid": 1, 00:22:18.652 "bdev_name": "Malloc0", 00:22:18.652 "name": "Malloc0", 00:22:18.652 "nguid": "E980083641604F118A4DC87C5C144D17", 00:22:18.652 "uuid": "e9800836-4160-4f11-8a4d-c87c5c144d17" 00:22:18.652 } 00:22:18.652 ] 00:22:18.652 } 00:22:18.652 ] 00:22:18.652 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.652 12:49:51 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:18.652 12:49:51 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:18.652 12:49:51 -- host/aer.sh@33 -- # aerpid=3594149 00:22:18.652 12:49:51 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:18.652 12:49:51 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:18.652 12:49:51 -- common/autotest_common.sh@1254 -- # local i=0 00:22:18.652 12:49:51 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:18.652 12:49:51 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:18.652 12:49:51 -- common/autotest_common.sh@1257 -- # i=1 00:22:18.652 12:49:51 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:18.652 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.652 12:49:51 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:18.652 12:49:51 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:18.652 12:49:51 -- common/autotest_common.sh@1257 -- # i=2 00:22:18.652 12:49:51 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:18.652 12:49:51 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:18.652 12:49:51 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:18.652 12:49:51 -- common/autotest_common.sh@1265 -- # return 0 00:22:18.652 12:49:51 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:18.652 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.652 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.652 Malloc1 00:22:18.652 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.652 12:49:51 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:18.652 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.652 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.652 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.652 12:49:51 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:18.652 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.941 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.941 Asynchronous Event Request test 00:22:18.941 Attaching to 10.0.0.2 00:22:18.941 Attached to 10.0.0.2 00:22:18.941 Registering asynchronous event callbacks... 00:22:18.941 Starting namespace attribute notice tests for all controllers... 00:22:18.941 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:18.941 aer_cb - Changed Namespace 00:22:18.941 Cleaning up... 00:22:18.941 [ 00:22:18.941 { 00:22:18.941 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:18.941 "subtype": "Discovery", 00:22:18.941 "listen_addresses": [], 00:22:18.941 "allow_any_host": true, 00:22:18.941 "hosts": [] 00:22:18.941 }, 00:22:18.941 { 00:22:18.941 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:18.941 "subtype": "NVMe", 00:22:18.941 "listen_addresses": [ 00:22:18.941 { 00:22:18.941 "transport": "TCP", 00:22:18.941 "trtype": "TCP", 00:22:18.941 "adrfam": "IPv4", 00:22:18.941 "traddr": "10.0.0.2", 00:22:18.941 "trsvcid": "4420" 00:22:18.941 } 00:22:18.941 ], 00:22:18.941 "allow_any_host": true, 00:22:18.941 "hosts": [], 00:22:18.941 "serial_number": "SPDK00000000000001", 00:22:18.941 "model_number": "SPDK bdev Controller", 00:22:18.941 "max_namespaces": 2, 00:22:18.941 "min_cntlid": 1, 00:22:18.941 "max_cntlid": 65519, 00:22:18.941 "namespaces": [ 00:22:18.941 { 00:22:18.941 "nsid": 1, 00:22:18.941 "bdev_name": "Malloc0", 00:22:18.941 "name": "Malloc0", 00:22:18.941 "nguid": "E980083641604F118A4DC87C5C144D17", 00:22:18.941 "uuid": "e9800836-4160-4f11-8a4d-c87c5c144d17" 00:22:18.941 }, 00:22:18.941 { 00:22:18.941 "nsid": 2, 00:22:18.941 "bdev_name": "Malloc1", 00:22:18.941 "name": "Malloc1", 00:22:18.941 "nguid": "73997368AEA34B36B095348BCEECF9BA", 00:22:18.941 "uuid": "73997368-aea3-4b36-b095-348bceecf9ba" 00:22:18.941 } 00:22:18.941 ] 00:22:18.941 } 00:22:18.941 ] 00:22:18.941 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.941 12:49:51 -- host/aer.sh@43 -- # wait 3594149 00:22:18.941 12:49:51 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:18.941 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.941 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.941 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.941 12:49:51 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:18.941 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.941 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.941 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.941 12:49:51 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:18.941 12:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.941 12:49:51 -- common/autotest_common.sh@10 -- # set +x 00:22:18.941 12:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.941 12:49:51 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:18.941 12:49:51 -- host/aer.sh@51 -- # nvmftestfini 00:22:18.941 12:49:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:18.941 12:49:51 -- nvmf/common.sh@116 -- # sync 00:22:18.941 12:49:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:18.941 12:49:51 -- nvmf/common.sh@119 -- # set +e 00:22:18.941 12:49:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:18.941 12:49:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:18.941 rmmod nvme_tcp 00:22:18.941 rmmod nvme_fabrics 00:22:18.941 rmmod nvme_keyring 00:22:18.941 12:49:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:18.941 12:49:51 -- nvmf/common.sh@123 -- # set -e 00:22:18.941 12:49:51 -- nvmf/common.sh@124 -- # return 0 00:22:18.941 12:49:51 -- nvmf/common.sh@477 -- # '[' -n 3593985 ']' 00:22:18.941 12:49:51 -- nvmf/common.sh@478 -- # killprocess 3593985 00:22:18.941 12:49:51 -- common/autotest_common.sh@936 -- # '[' -z 3593985 ']' 00:22:18.941 12:49:51 -- common/autotest_common.sh@940 -- # kill -0 3593985 00:22:18.941 12:49:51 -- common/autotest_common.sh@941 -- # uname 00:22:18.941 12:49:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:18.941 12:49:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3593985 00:22:18.941 12:49:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:18.941 12:49:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:18.941 12:49:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3593985' 00:22:18.941 killing process with pid 3593985 00:22:18.941 12:49:51 -- common/autotest_common.sh@955 -- # kill 3593985 00:22:18.941 [2024-11-20 12:49:51.938580] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:18.941 12:49:51 -- common/autotest_common.sh@960 -- # wait 3593985 00:22:19.201 12:49:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:19.201 12:49:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:19.201 12:49:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:19.201 12:49:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:19.201 12:49:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:19.201 12:49:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:19.201 12:49:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:19.201 12:49:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:21.736 12:49:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:21.736 00:22:21.736 real 0m6.291s 00:22:21.736 user 0m7.342s 00:22:21.736 sys 0m1.997s 00:22:21.736 12:49:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:21.736 12:49:54 -- common/autotest_common.sh@10 -- # set +x 00:22:21.736 ************************************ 00:22:21.736 END TEST nvmf_aer 00:22:21.736 ************************************ 00:22:21.736 12:49:54 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:21.736 12:49:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:21.736 12:49:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:21.736 12:49:54 -- common/autotest_common.sh@10 -- # set +x 00:22:21.736 ************************************ 00:22:21.736 START TEST nvmf_async_init 00:22:21.736 ************************************ 00:22:21.736 12:49:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:21.736 * Looking for test storage... 00:22:21.736 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:21.736 12:49:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:21.736 12:49:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:21.736 12:49:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:21.736 12:49:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:21.736 12:49:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:21.737 12:49:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:21.737 12:49:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:21.737 12:49:54 -- scripts/common.sh@335 -- # IFS=.-: 00:22:21.737 12:49:54 -- scripts/common.sh@335 -- # read -ra ver1 00:22:21.737 12:49:54 -- scripts/common.sh@336 -- # IFS=.-: 00:22:21.737 12:49:54 -- scripts/common.sh@336 -- # read -ra ver2 00:22:21.737 12:49:54 -- scripts/common.sh@337 -- # local 'op=<' 00:22:21.737 12:49:54 -- scripts/common.sh@339 -- # ver1_l=2 00:22:21.737 12:49:54 -- scripts/common.sh@340 -- # ver2_l=1 00:22:21.737 12:49:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:21.737 12:49:54 -- scripts/common.sh@343 -- # case "$op" in 00:22:21.737 12:49:54 -- scripts/common.sh@344 -- # : 1 00:22:21.737 12:49:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:21.737 12:49:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:21.737 12:49:54 -- scripts/common.sh@364 -- # decimal 1 00:22:21.737 12:49:54 -- scripts/common.sh@352 -- # local d=1 00:22:21.737 12:49:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:21.737 12:49:54 -- scripts/common.sh@354 -- # echo 1 00:22:21.737 12:49:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:21.737 12:49:54 -- scripts/common.sh@365 -- # decimal 2 00:22:21.737 12:49:54 -- scripts/common.sh@352 -- # local d=2 00:22:21.737 12:49:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:21.737 12:49:54 -- scripts/common.sh@354 -- # echo 2 00:22:21.737 12:49:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:21.737 12:49:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:21.737 12:49:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:21.737 12:49:54 -- scripts/common.sh@367 -- # return 0 00:22:21.737 12:49:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:21.737 12:49:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:21.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:21.737 --rc genhtml_branch_coverage=1 00:22:21.737 --rc genhtml_function_coverage=1 00:22:21.737 --rc genhtml_legend=1 00:22:21.737 --rc geninfo_all_blocks=1 00:22:21.737 --rc geninfo_unexecuted_blocks=1 00:22:21.737 00:22:21.737 ' 00:22:21.737 12:49:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:21.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:21.737 --rc genhtml_branch_coverage=1 00:22:21.737 --rc genhtml_function_coverage=1 00:22:21.737 --rc genhtml_legend=1 00:22:21.737 --rc geninfo_all_blocks=1 00:22:21.737 --rc geninfo_unexecuted_blocks=1 00:22:21.737 00:22:21.737 ' 00:22:21.737 12:49:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:21.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:21.737 --rc genhtml_branch_coverage=1 00:22:21.737 --rc genhtml_function_coverage=1 00:22:21.737 --rc genhtml_legend=1 00:22:21.737 --rc geninfo_all_blocks=1 00:22:21.737 --rc geninfo_unexecuted_blocks=1 00:22:21.737 00:22:21.737 ' 00:22:21.737 12:49:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:21.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:21.737 --rc genhtml_branch_coverage=1 00:22:21.737 --rc genhtml_function_coverage=1 00:22:21.737 --rc genhtml_legend=1 00:22:21.737 --rc geninfo_all_blocks=1 00:22:21.737 --rc geninfo_unexecuted_blocks=1 00:22:21.737 00:22:21.737 ' 00:22:21.737 12:49:54 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:21.737 12:49:54 -- nvmf/common.sh@7 -- # uname -s 00:22:21.737 12:49:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:21.737 12:49:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:21.737 12:49:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:21.737 12:49:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:21.737 12:49:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:21.737 12:49:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:21.737 12:49:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:21.737 12:49:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:21.737 12:49:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:21.737 12:49:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:21.737 12:49:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:21.737 12:49:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:21.737 12:49:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:21.737 12:49:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:21.737 12:49:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:21.737 12:49:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:21.737 12:49:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:21.737 12:49:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:21.737 12:49:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:21.737 12:49:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.737 12:49:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.737 12:49:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.737 12:49:54 -- paths/export.sh@5 -- # export PATH 00:22:21.737 12:49:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.737 12:49:54 -- nvmf/common.sh@46 -- # : 0 00:22:21.737 12:49:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:21.737 12:49:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:21.737 12:49:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:21.737 12:49:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:21.737 12:49:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:21.737 12:49:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:21.737 12:49:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:21.737 12:49:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:21.737 12:49:54 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:21.737 12:49:54 -- host/async_init.sh@14 -- # null_block_size=512 00:22:21.737 12:49:54 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:21.737 12:49:54 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:21.737 12:49:54 -- host/async_init.sh@20 -- # uuidgen 00:22:21.737 12:49:54 -- host/async_init.sh@20 -- # tr -d - 00:22:21.737 12:49:54 -- host/async_init.sh@20 -- # nguid=5793add803114f51b4f9f02fa968c0bc 00:22:21.737 12:49:54 -- host/async_init.sh@22 -- # nvmftestinit 00:22:21.737 12:49:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:21.737 12:49:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:21.737 12:49:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:21.737 12:49:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:21.737 12:49:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:21.737 12:49:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:21.737 12:49:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:21.737 12:49:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:21.737 12:49:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:21.737 12:49:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:21.737 12:49:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:21.737 12:49:54 -- common/autotest_common.sh@10 -- # set +x 00:22:23.643 12:49:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:23.643 12:49:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:23.643 12:49:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:23.643 12:49:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:23.643 12:49:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:23.643 12:49:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:23.643 12:49:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:23.643 12:49:56 -- nvmf/common.sh@294 -- # net_devs=() 00:22:23.643 12:49:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:23.643 12:49:56 -- nvmf/common.sh@295 -- # e810=() 00:22:23.643 12:49:56 -- nvmf/common.sh@295 -- # local -ga e810 00:22:23.643 12:49:56 -- nvmf/common.sh@296 -- # x722=() 00:22:23.643 12:49:56 -- nvmf/common.sh@296 -- # local -ga x722 00:22:23.643 12:49:56 -- nvmf/common.sh@297 -- # mlx=() 00:22:23.643 12:49:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:23.643 12:49:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:23.643 12:49:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:23.643 12:49:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:23.643 12:49:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:23.643 12:49:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:23.643 12:49:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:23.643 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:23.643 12:49:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:23.643 12:49:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:23.643 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:23.643 12:49:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:23.643 12:49:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:23.643 12:49:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:23.643 12:49:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:23.643 12:49:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:23.643 12:49:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:23.643 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:23.643 12:49:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:23.643 12:49:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:23.643 12:49:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:23.643 12:49:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:23.643 12:49:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:23.643 12:49:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:23.643 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:23.643 12:49:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:23.643 12:49:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:23.643 12:49:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:23.643 12:49:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:23.643 12:49:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:23.643 12:49:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:23.643 12:49:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:23.644 12:49:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:23.644 12:49:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:23.644 12:49:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:23.644 12:49:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:23.644 12:49:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:23.644 12:49:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:23.644 12:49:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:23.644 12:49:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:23.644 12:49:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:23.644 12:49:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:23.644 12:49:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:23.644 12:49:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:23.644 12:49:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:23.644 12:49:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:23.644 12:49:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:23.644 12:49:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:23.644 12:49:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:23.644 12:49:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:23.644 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:23.644 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:22:23.644 00:22:23.644 --- 10.0.0.2 ping statistics --- 00:22:23.644 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:23.644 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:22:23.644 12:49:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:23.644 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:23.644 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:22:23.644 00:22:23.644 --- 10.0.0.1 ping statistics --- 00:22:23.644 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:23.644 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:22:23.644 12:49:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:23.644 12:49:56 -- nvmf/common.sh@410 -- # return 0 00:22:23.644 12:49:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:23.644 12:49:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:23.644 12:49:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:23.644 12:49:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:23.644 12:49:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:23.644 12:49:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:23.644 12:49:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:23.644 12:49:56 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:23.644 12:49:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:23.644 12:49:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:23.644 12:49:56 -- common/autotest_common.sh@10 -- # set +x 00:22:23.644 12:49:56 -- nvmf/common.sh@469 -- # nvmfpid=3596107 00:22:23.644 12:49:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:23.644 12:49:56 -- nvmf/common.sh@470 -- # waitforlisten 3596107 00:22:23.644 12:49:56 -- common/autotest_common.sh@829 -- # '[' -z 3596107 ']' 00:22:23.644 12:49:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:23.644 12:49:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:23.644 12:49:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:23.644 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:23.644 12:49:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:23.644 12:49:56 -- common/autotest_common.sh@10 -- # set +x 00:22:23.644 [2024-11-20 12:49:56.588077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:23.644 [2024-11-20 12:49:56.588153] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:23.644 EAL: No free 2048 kB hugepages reported on node 1 00:22:23.644 [2024-11-20 12:49:56.650496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:23.904 [2024-11-20 12:49:56.766557] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:23.904 [2024-11-20 12:49:56.766718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:23.904 [2024-11-20 12:49:56.766737] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:23.904 [2024-11-20 12:49:56.766750] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:23.904 [2024-11-20 12:49:56.766784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:24.841 12:49:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:24.841 12:49:57 -- common/autotest_common.sh@862 -- # return 0 00:22:24.841 12:49:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:24.841 12:49:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 12:49:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:24.841 12:49:57 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 [2024-11-20 12:49:57.642708] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 null0 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 5793add803114f51b4f9f02fa968c0bc 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 [2024-11-20 12:49:57.682980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 nvme0n1 00:22:24.841 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.841 12:49:57 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:24.841 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.841 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.841 [ 00:22:24.841 { 00:22:24.841 "name": "nvme0n1", 00:22:24.841 "aliases": [ 00:22:24.841 "5793add8-0311-4f51-b4f9-f02fa968c0bc" 00:22:24.841 ], 00:22:24.841 "product_name": "NVMe disk", 00:22:24.841 "block_size": 512, 00:22:24.841 "num_blocks": 2097152, 00:22:24.841 "uuid": "5793add8-0311-4f51-b4f9-f02fa968c0bc", 00:22:24.841 "assigned_rate_limits": { 00:22:24.841 "rw_ios_per_sec": 0, 00:22:24.841 "rw_mbytes_per_sec": 0, 00:22:24.841 "r_mbytes_per_sec": 0, 00:22:24.841 "w_mbytes_per_sec": 0 00:22:24.841 }, 00:22:24.841 "claimed": false, 00:22:24.841 "zoned": false, 00:22:24.841 "supported_io_types": { 00:22:24.841 "read": true, 00:22:24.841 "write": true, 00:22:24.841 "unmap": false, 00:22:24.841 "write_zeroes": true, 00:22:24.841 "flush": true, 00:22:24.841 "reset": true, 00:22:24.842 "compare": true, 00:22:24.842 "compare_and_write": true, 00:22:24.842 "abort": true, 00:22:24.842 "nvme_admin": true, 00:22:24.842 "nvme_io": true 00:22:24.842 }, 00:22:24.842 "driver_specific": { 00:22:24.842 "nvme": [ 00:22:24.842 { 00:22:24.842 "trid": { 00:22:24.842 "trtype": "TCP", 00:22:24.842 "adrfam": "IPv4", 00:22:24.842 "traddr": "10.0.0.2", 00:22:24.842 "trsvcid": "4420", 00:22:24.842 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:24.842 }, 00:22:24.842 "ctrlr_data": { 00:22:24.842 "cntlid": 1, 00:22:24.842 "vendor_id": "0x8086", 00:22:24.842 "model_number": "SPDK bdev Controller", 00:22:24.842 "serial_number": "00000000000000000000", 00:22:24.842 "firmware_revision": "24.01.1", 00:22:24.842 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:24.842 "oacs": { 00:22:24.842 "security": 0, 00:22:24.842 "format": 0, 00:22:24.842 "firmware": 0, 00:22:24.842 "ns_manage": 0 00:22:24.842 }, 00:22:24.842 "multi_ctrlr": true, 00:22:24.842 "ana_reporting": false 00:22:24.842 }, 00:22:24.842 "vs": { 00:22:24.842 "nvme_version": "1.3" 00:22:24.842 }, 00:22:24.842 "ns_data": { 00:22:24.842 "id": 1, 00:22:24.842 "can_share": true 00:22:24.842 } 00:22:24.842 } 00:22:24.842 ], 00:22:24.842 "mp_policy": "active_passive" 00:22:24.842 } 00:22:24.842 } 00:22:24.842 ] 00:22:24.842 12:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.842 12:49:57 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:24.842 12:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.842 12:49:57 -- common/autotest_common.sh@10 -- # set +x 00:22:24.842 [2024-11-20 12:49:57.931617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:24.842 [2024-11-20 12:49:57.931715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2533ba0 (9): Bad file descriptor 00:22:25.100 [2024-11-20 12:49:58.064226] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:25.100 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.100 12:49:58 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:25.100 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.100 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.100 [ 00:22:25.100 { 00:22:25.100 "name": "nvme0n1", 00:22:25.100 "aliases": [ 00:22:25.100 "5793add8-0311-4f51-b4f9-f02fa968c0bc" 00:22:25.100 ], 00:22:25.100 "product_name": "NVMe disk", 00:22:25.100 "block_size": 512, 00:22:25.100 "num_blocks": 2097152, 00:22:25.100 "uuid": "5793add8-0311-4f51-b4f9-f02fa968c0bc", 00:22:25.100 "assigned_rate_limits": { 00:22:25.100 "rw_ios_per_sec": 0, 00:22:25.100 "rw_mbytes_per_sec": 0, 00:22:25.100 "r_mbytes_per_sec": 0, 00:22:25.100 "w_mbytes_per_sec": 0 00:22:25.100 }, 00:22:25.100 "claimed": false, 00:22:25.100 "zoned": false, 00:22:25.100 "supported_io_types": { 00:22:25.100 "read": true, 00:22:25.100 "write": true, 00:22:25.100 "unmap": false, 00:22:25.100 "write_zeroes": true, 00:22:25.100 "flush": true, 00:22:25.100 "reset": true, 00:22:25.100 "compare": true, 00:22:25.100 "compare_and_write": true, 00:22:25.100 "abort": true, 00:22:25.100 "nvme_admin": true, 00:22:25.100 "nvme_io": true 00:22:25.100 }, 00:22:25.100 "driver_specific": { 00:22:25.100 "nvme": [ 00:22:25.100 { 00:22:25.100 "trid": { 00:22:25.100 "trtype": "TCP", 00:22:25.100 "adrfam": "IPv4", 00:22:25.100 "traddr": "10.0.0.2", 00:22:25.100 "trsvcid": "4420", 00:22:25.100 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:25.100 }, 00:22:25.100 "ctrlr_data": { 00:22:25.100 "cntlid": 2, 00:22:25.100 "vendor_id": "0x8086", 00:22:25.100 "model_number": "SPDK bdev Controller", 00:22:25.100 "serial_number": "00000000000000000000", 00:22:25.100 "firmware_revision": "24.01.1", 00:22:25.100 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:25.100 "oacs": { 00:22:25.100 "security": 0, 00:22:25.100 "format": 0, 00:22:25.100 "firmware": 0, 00:22:25.100 "ns_manage": 0 00:22:25.100 }, 00:22:25.100 "multi_ctrlr": true, 00:22:25.100 "ana_reporting": false 00:22:25.100 }, 00:22:25.100 "vs": { 00:22:25.100 "nvme_version": "1.3" 00:22:25.100 }, 00:22:25.100 "ns_data": { 00:22:25.100 "id": 1, 00:22:25.100 "can_share": true 00:22:25.100 } 00:22:25.100 } 00:22:25.100 ], 00:22:25.100 "mp_policy": "active_passive" 00:22:25.100 } 00:22:25.100 } 00:22:25.100 ] 00:22:25.100 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.100 12:49:58 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:25.100 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.100 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.100 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.100 12:49:58 -- host/async_init.sh@53 -- # mktemp 00:22:25.100 12:49:58 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.OBopzkyKWq 00:22:25.100 12:49:58 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:25.100 12:49:58 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.OBopzkyKWq 00:22:25.100 12:49:58 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:25.100 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.100 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.100 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.100 12:49:58 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:25.100 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.100 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.100 [2024-11-20 12:49:58.112224] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:25.100 [2024-11-20 12:49:58.112408] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:25.101 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.101 12:49:58 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.OBopzkyKWq 00:22:25.101 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.101 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.101 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.101 12:49:58 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.OBopzkyKWq 00:22:25.101 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.101 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.101 [2024-11-20 12:49:58.128248] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:25.101 nvme0n1 00:22:25.101 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.101 12:49:58 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:25.101 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.101 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.361 [ 00:22:25.361 { 00:22:25.361 "name": "nvme0n1", 00:22:25.361 "aliases": [ 00:22:25.361 "5793add8-0311-4f51-b4f9-f02fa968c0bc" 00:22:25.361 ], 00:22:25.361 "product_name": "NVMe disk", 00:22:25.361 "block_size": 512, 00:22:25.361 "num_blocks": 2097152, 00:22:25.361 "uuid": "5793add8-0311-4f51-b4f9-f02fa968c0bc", 00:22:25.361 "assigned_rate_limits": { 00:22:25.361 "rw_ios_per_sec": 0, 00:22:25.361 "rw_mbytes_per_sec": 0, 00:22:25.361 "r_mbytes_per_sec": 0, 00:22:25.361 "w_mbytes_per_sec": 0 00:22:25.361 }, 00:22:25.361 "claimed": false, 00:22:25.361 "zoned": false, 00:22:25.361 "supported_io_types": { 00:22:25.361 "read": true, 00:22:25.361 "write": true, 00:22:25.361 "unmap": false, 00:22:25.361 "write_zeroes": true, 00:22:25.361 "flush": true, 00:22:25.361 "reset": true, 00:22:25.361 "compare": true, 00:22:25.361 "compare_and_write": true, 00:22:25.361 "abort": true, 00:22:25.361 "nvme_admin": true, 00:22:25.361 "nvme_io": true 00:22:25.361 }, 00:22:25.361 "driver_specific": { 00:22:25.361 "nvme": [ 00:22:25.361 { 00:22:25.361 "trid": { 00:22:25.361 "trtype": "TCP", 00:22:25.361 "adrfam": "IPv4", 00:22:25.361 "traddr": "10.0.0.2", 00:22:25.361 "trsvcid": "4421", 00:22:25.361 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:25.361 }, 00:22:25.361 "ctrlr_data": { 00:22:25.361 "cntlid": 3, 00:22:25.361 "vendor_id": "0x8086", 00:22:25.361 "model_number": "SPDK bdev Controller", 00:22:25.361 "serial_number": "00000000000000000000", 00:22:25.361 "firmware_revision": "24.01.1", 00:22:25.361 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:25.361 "oacs": { 00:22:25.361 "security": 0, 00:22:25.361 "format": 0, 00:22:25.361 "firmware": 0, 00:22:25.361 "ns_manage": 0 00:22:25.361 }, 00:22:25.361 "multi_ctrlr": true, 00:22:25.361 "ana_reporting": false 00:22:25.361 }, 00:22:25.361 "vs": { 00:22:25.361 "nvme_version": "1.3" 00:22:25.361 }, 00:22:25.361 "ns_data": { 00:22:25.361 "id": 1, 00:22:25.361 "can_share": true 00:22:25.361 } 00:22:25.361 } 00:22:25.361 ], 00:22:25.361 "mp_policy": "active_passive" 00:22:25.361 } 00:22:25.361 } 00:22:25.361 ] 00:22:25.361 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.361 12:49:58 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:25.361 12:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.361 12:49:58 -- common/autotest_common.sh@10 -- # set +x 00:22:25.361 12:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.361 12:49:58 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.OBopzkyKWq 00:22:25.361 12:49:58 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:25.361 12:49:58 -- host/async_init.sh@78 -- # nvmftestfini 00:22:25.361 12:49:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:25.361 12:49:58 -- nvmf/common.sh@116 -- # sync 00:22:25.361 12:49:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:25.361 12:49:58 -- nvmf/common.sh@119 -- # set +e 00:22:25.361 12:49:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:25.361 12:49:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:25.361 rmmod nvme_tcp 00:22:25.361 rmmod nvme_fabrics 00:22:25.361 rmmod nvme_keyring 00:22:25.361 12:49:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:25.361 12:49:58 -- nvmf/common.sh@123 -- # set -e 00:22:25.361 12:49:58 -- nvmf/common.sh@124 -- # return 0 00:22:25.361 12:49:58 -- nvmf/common.sh@477 -- # '[' -n 3596107 ']' 00:22:25.361 12:49:58 -- nvmf/common.sh@478 -- # killprocess 3596107 00:22:25.361 12:49:58 -- common/autotest_common.sh@936 -- # '[' -z 3596107 ']' 00:22:25.361 12:49:58 -- common/autotest_common.sh@940 -- # kill -0 3596107 00:22:25.361 12:49:58 -- common/autotest_common.sh@941 -- # uname 00:22:25.361 12:49:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:25.361 12:49:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3596107 00:22:25.361 12:49:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:25.361 12:49:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:25.361 12:49:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3596107' 00:22:25.361 killing process with pid 3596107 00:22:25.361 12:49:58 -- common/autotest_common.sh@955 -- # kill 3596107 00:22:25.361 12:49:58 -- common/autotest_common.sh@960 -- # wait 3596107 00:22:25.620 12:49:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:25.620 12:49:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:25.620 12:49:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:25.620 12:49:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:25.620 12:49:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:25.620 12:49:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:25.620 12:49:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:25.620 12:49:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:27.525 12:50:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:27.525 00:22:27.525 real 0m6.322s 00:22:27.525 user 0m3.158s 00:22:27.525 sys 0m1.854s 00:22:27.525 12:50:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:27.525 12:50:00 -- common/autotest_common.sh@10 -- # set +x 00:22:27.525 ************************************ 00:22:27.525 END TEST nvmf_async_init 00:22:27.525 ************************************ 00:22:27.525 12:50:00 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:27.525 12:50:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:27.783 12:50:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:27.783 12:50:00 -- common/autotest_common.sh@10 -- # set +x 00:22:27.783 ************************************ 00:22:27.783 START TEST dma 00:22:27.783 ************************************ 00:22:27.783 12:50:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:27.783 * Looking for test storage... 00:22:27.783 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:27.783 12:50:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:27.783 12:50:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:27.783 12:50:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:27.783 12:50:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:27.783 12:50:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:27.783 12:50:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:27.783 12:50:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:27.783 12:50:00 -- scripts/common.sh@335 -- # IFS=.-: 00:22:27.783 12:50:00 -- scripts/common.sh@335 -- # read -ra ver1 00:22:27.783 12:50:00 -- scripts/common.sh@336 -- # IFS=.-: 00:22:27.783 12:50:00 -- scripts/common.sh@336 -- # read -ra ver2 00:22:27.783 12:50:00 -- scripts/common.sh@337 -- # local 'op=<' 00:22:27.783 12:50:00 -- scripts/common.sh@339 -- # ver1_l=2 00:22:27.783 12:50:00 -- scripts/common.sh@340 -- # ver2_l=1 00:22:27.783 12:50:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:27.783 12:50:00 -- scripts/common.sh@343 -- # case "$op" in 00:22:27.783 12:50:00 -- scripts/common.sh@344 -- # : 1 00:22:27.783 12:50:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:27.783 12:50:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:27.783 12:50:00 -- scripts/common.sh@364 -- # decimal 1 00:22:27.783 12:50:00 -- scripts/common.sh@352 -- # local d=1 00:22:27.783 12:50:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:27.783 12:50:00 -- scripts/common.sh@354 -- # echo 1 00:22:27.783 12:50:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:27.783 12:50:00 -- scripts/common.sh@365 -- # decimal 2 00:22:27.783 12:50:00 -- scripts/common.sh@352 -- # local d=2 00:22:27.783 12:50:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:27.783 12:50:00 -- scripts/common.sh@354 -- # echo 2 00:22:27.783 12:50:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:27.783 12:50:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:27.783 12:50:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:27.783 12:50:00 -- scripts/common.sh@367 -- # return 0 00:22:27.783 12:50:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:27.783 12:50:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:27.783 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.783 --rc genhtml_branch_coverage=1 00:22:27.783 --rc genhtml_function_coverage=1 00:22:27.783 --rc genhtml_legend=1 00:22:27.783 --rc geninfo_all_blocks=1 00:22:27.783 --rc geninfo_unexecuted_blocks=1 00:22:27.783 00:22:27.783 ' 00:22:27.783 12:50:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:27.783 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.784 --rc genhtml_branch_coverage=1 00:22:27.784 --rc genhtml_function_coverage=1 00:22:27.784 --rc genhtml_legend=1 00:22:27.784 --rc geninfo_all_blocks=1 00:22:27.784 --rc geninfo_unexecuted_blocks=1 00:22:27.784 00:22:27.784 ' 00:22:27.784 12:50:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:27.784 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.784 --rc genhtml_branch_coverage=1 00:22:27.784 --rc genhtml_function_coverage=1 00:22:27.784 --rc genhtml_legend=1 00:22:27.784 --rc geninfo_all_blocks=1 00:22:27.784 --rc geninfo_unexecuted_blocks=1 00:22:27.784 00:22:27.784 ' 00:22:27.784 12:50:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:27.784 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.784 --rc genhtml_branch_coverage=1 00:22:27.784 --rc genhtml_function_coverage=1 00:22:27.784 --rc genhtml_legend=1 00:22:27.784 --rc geninfo_all_blocks=1 00:22:27.784 --rc geninfo_unexecuted_blocks=1 00:22:27.784 00:22:27.784 ' 00:22:27.784 12:50:00 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:27.784 12:50:00 -- nvmf/common.sh@7 -- # uname -s 00:22:27.784 12:50:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:27.784 12:50:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:27.784 12:50:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:27.784 12:50:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:27.784 12:50:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:27.784 12:50:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:27.784 12:50:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:27.784 12:50:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:27.784 12:50:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:27.784 12:50:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:27.784 12:50:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:27.784 12:50:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:27.784 12:50:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:27.784 12:50:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:27.784 12:50:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:27.784 12:50:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:27.784 12:50:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:27.784 12:50:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:27.784 12:50:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:27.784 12:50:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.784 12:50:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.784 12:50:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.784 12:50:00 -- paths/export.sh@5 -- # export PATH 00:22:27.784 12:50:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.784 12:50:00 -- nvmf/common.sh@46 -- # : 0 00:22:27.784 12:50:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:27.784 12:50:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:27.784 12:50:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:27.784 12:50:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:27.784 12:50:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:27.784 12:50:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:27.784 12:50:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:27.784 12:50:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:27.784 12:50:00 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:27.784 12:50:00 -- host/dma.sh@13 -- # exit 0 00:22:27.784 00:22:27.784 real 0m0.177s 00:22:27.784 user 0m0.126s 00:22:27.784 sys 0m0.060s 00:22:27.784 12:50:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:27.784 12:50:00 -- common/autotest_common.sh@10 -- # set +x 00:22:27.784 ************************************ 00:22:27.784 END TEST dma 00:22:27.784 ************************************ 00:22:27.784 12:50:00 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:27.784 12:50:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:27.784 12:50:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:27.784 12:50:00 -- common/autotest_common.sh@10 -- # set +x 00:22:27.784 ************************************ 00:22:27.784 START TEST nvmf_identify 00:22:27.784 ************************************ 00:22:27.784 12:50:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:27.784 * Looking for test storage... 00:22:28.044 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:28.044 12:50:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:28.044 12:50:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:28.044 12:50:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:28.044 12:50:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:28.044 12:50:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:28.044 12:50:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:28.044 12:50:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:28.044 12:50:00 -- scripts/common.sh@335 -- # IFS=.-: 00:22:28.044 12:50:00 -- scripts/common.sh@335 -- # read -ra ver1 00:22:28.044 12:50:00 -- scripts/common.sh@336 -- # IFS=.-: 00:22:28.044 12:50:00 -- scripts/common.sh@336 -- # read -ra ver2 00:22:28.044 12:50:00 -- scripts/common.sh@337 -- # local 'op=<' 00:22:28.044 12:50:00 -- scripts/common.sh@339 -- # ver1_l=2 00:22:28.044 12:50:00 -- scripts/common.sh@340 -- # ver2_l=1 00:22:28.044 12:50:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:28.044 12:50:00 -- scripts/common.sh@343 -- # case "$op" in 00:22:28.044 12:50:00 -- scripts/common.sh@344 -- # : 1 00:22:28.044 12:50:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:28.044 12:50:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:28.044 12:50:00 -- scripts/common.sh@364 -- # decimal 1 00:22:28.044 12:50:00 -- scripts/common.sh@352 -- # local d=1 00:22:28.044 12:50:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:28.044 12:50:00 -- scripts/common.sh@354 -- # echo 1 00:22:28.044 12:50:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:28.044 12:50:00 -- scripts/common.sh@365 -- # decimal 2 00:22:28.044 12:50:00 -- scripts/common.sh@352 -- # local d=2 00:22:28.044 12:50:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:28.044 12:50:00 -- scripts/common.sh@354 -- # echo 2 00:22:28.044 12:50:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:28.044 12:50:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:28.044 12:50:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:28.044 12:50:00 -- scripts/common.sh@367 -- # return 0 00:22:28.044 12:50:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:28.044 12:50:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:28.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:28.044 --rc genhtml_branch_coverage=1 00:22:28.044 --rc genhtml_function_coverage=1 00:22:28.044 --rc genhtml_legend=1 00:22:28.044 --rc geninfo_all_blocks=1 00:22:28.044 --rc geninfo_unexecuted_blocks=1 00:22:28.044 00:22:28.044 ' 00:22:28.044 12:50:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:28.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:28.044 --rc genhtml_branch_coverage=1 00:22:28.044 --rc genhtml_function_coverage=1 00:22:28.044 --rc genhtml_legend=1 00:22:28.044 --rc geninfo_all_blocks=1 00:22:28.044 --rc geninfo_unexecuted_blocks=1 00:22:28.044 00:22:28.044 ' 00:22:28.044 12:50:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:28.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:28.044 --rc genhtml_branch_coverage=1 00:22:28.044 --rc genhtml_function_coverage=1 00:22:28.044 --rc genhtml_legend=1 00:22:28.044 --rc geninfo_all_blocks=1 00:22:28.044 --rc geninfo_unexecuted_blocks=1 00:22:28.044 00:22:28.044 ' 00:22:28.044 12:50:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:28.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:28.044 --rc genhtml_branch_coverage=1 00:22:28.044 --rc genhtml_function_coverage=1 00:22:28.044 --rc genhtml_legend=1 00:22:28.044 --rc geninfo_all_blocks=1 00:22:28.044 --rc geninfo_unexecuted_blocks=1 00:22:28.044 00:22:28.044 ' 00:22:28.044 12:50:00 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:28.044 12:50:00 -- nvmf/common.sh@7 -- # uname -s 00:22:28.044 12:50:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:28.044 12:50:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:28.044 12:50:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:28.044 12:50:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:28.044 12:50:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:28.044 12:50:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:28.044 12:50:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:28.044 12:50:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:28.044 12:50:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:28.044 12:50:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:28.044 12:50:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:28.044 12:50:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:28.044 12:50:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:28.044 12:50:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:28.044 12:50:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:28.044 12:50:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:28.044 12:50:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:28.044 12:50:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:28.044 12:50:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:28.044 12:50:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:28.044 12:50:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:28.044 12:50:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:28.044 12:50:00 -- paths/export.sh@5 -- # export PATH 00:22:28.045 12:50:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:28.045 12:50:00 -- nvmf/common.sh@46 -- # : 0 00:22:28.045 12:50:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:28.045 12:50:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:28.045 12:50:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:28.045 12:50:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:28.045 12:50:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:28.045 12:50:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:28.045 12:50:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:28.045 12:50:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:28.045 12:50:00 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:28.045 12:50:00 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:28.045 12:50:00 -- host/identify.sh@14 -- # nvmftestinit 00:22:28.045 12:50:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:28.045 12:50:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:28.045 12:50:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:28.045 12:50:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:28.045 12:50:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:28.045 12:50:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:28.045 12:50:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:28.045 12:50:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:28.045 12:50:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:28.045 12:50:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:28.045 12:50:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:28.045 12:50:00 -- common/autotest_common.sh@10 -- # set +x 00:22:29.947 12:50:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:29.947 12:50:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:29.947 12:50:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:29.947 12:50:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:29.947 12:50:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:29.947 12:50:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:29.947 12:50:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:29.947 12:50:02 -- nvmf/common.sh@294 -- # net_devs=() 00:22:29.947 12:50:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:29.948 12:50:02 -- nvmf/common.sh@295 -- # e810=() 00:22:29.948 12:50:02 -- nvmf/common.sh@295 -- # local -ga e810 00:22:29.948 12:50:02 -- nvmf/common.sh@296 -- # x722=() 00:22:29.948 12:50:02 -- nvmf/common.sh@296 -- # local -ga x722 00:22:29.948 12:50:02 -- nvmf/common.sh@297 -- # mlx=() 00:22:29.948 12:50:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:29.948 12:50:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:29.948 12:50:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:29.948 12:50:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:29.948 12:50:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:29.948 12:50:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.948 12:50:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:29.948 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:29.948 12:50:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.948 12:50:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:29.948 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:29.948 12:50:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:29.948 12:50:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:29.948 12:50:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.948 12:50:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.948 12:50:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.948 12:50:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.948 12:50:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:29.948 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:29.948 12:50:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.948 12:50:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.948 12:50:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.948 12:50:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.948 12:50:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.948 12:50:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:29.948 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:29.948 12:50:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.948 12:50:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:29.948 12:50:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:29.948 12:50:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:29.948 12:50:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:29.948 12:50:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:29.948 12:50:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:29.948 12:50:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:29.948 12:50:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:29.948 12:50:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:29.948 12:50:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:29.948 12:50:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:29.948 12:50:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:29.948 12:50:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:29.948 12:50:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:29.948 12:50:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:29.948 12:50:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:29.948 12:50:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:29.948 12:50:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:30.206 12:50:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:30.206 12:50:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:30.206 12:50:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:30.206 12:50:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:30.206 12:50:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:30.206 12:50:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:30.206 12:50:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:30.206 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:30.206 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:22:30.206 00:22:30.206 --- 10.0.0.2 ping statistics --- 00:22:30.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:30.206 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:22:30.206 12:50:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:30.206 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:30.206 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:22:30.206 00:22:30.206 --- 10.0.0.1 ping statistics --- 00:22:30.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:30.206 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:22:30.206 12:50:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:30.206 12:50:03 -- nvmf/common.sh@410 -- # return 0 00:22:30.207 12:50:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:30.207 12:50:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:30.207 12:50:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:30.207 12:50:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:30.207 12:50:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:30.207 12:50:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:30.207 12:50:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:30.207 12:50:03 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:30.207 12:50:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:30.207 12:50:03 -- common/autotest_common.sh@10 -- # set +x 00:22:30.207 12:50:03 -- host/identify.sh@19 -- # nvmfpid=3598391 00:22:30.207 12:50:03 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:30.207 12:50:03 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:30.207 12:50:03 -- host/identify.sh@23 -- # waitforlisten 3598391 00:22:30.207 12:50:03 -- common/autotest_common.sh@829 -- # '[' -z 3598391 ']' 00:22:30.207 12:50:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:30.207 12:50:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.207 12:50:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:30.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:30.207 12:50:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.207 12:50:03 -- common/autotest_common.sh@10 -- # set +x 00:22:30.207 [2024-11-20 12:50:03.192264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.207 [2024-11-20 12:50:03.192331] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:30.207 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.207 [2024-11-20 12:50:03.257979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:30.465 [2024-11-20 12:50:03.364963] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:30.465 [2024-11-20 12:50:03.365140] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:30.465 [2024-11-20 12:50:03.365168] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:30.465 [2024-11-20 12:50:03.365181] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:30.465 [2024-11-20 12:50:03.365241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:30.465 [2024-11-20 12:50:03.365266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:30.465 [2024-11-20 12:50:03.365338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:30.465 [2024-11-20 12:50:03.365341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:31.410 12:50:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:31.410 12:50:04 -- common/autotest_common.sh@862 -- # return 0 00:22:31.410 12:50:04 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 [2024-11-20 12:50:04.159714] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.410 12:50:04 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:31.410 12:50:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 12:50:04 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 Malloc0 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.410 12:50:04 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.410 12:50:04 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.410 12:50:04 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 [2024-11-20 12:50:04.237206] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.410 12:50:04 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.410 12:50:04 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:31.410 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.410 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.410 [2024-11-20 12:50:04.252851] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:31.410 [ 00:22:31.410 { 00:22:31.410 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:31.410 "subtype": "Discovery", 00:22:31.410 "listen_addresses": [ 00:22:31.410 { 00:22:31.410 "transport": "TCP", 00:22:31.410 "trtype": "TCP", 00:22:31.410 "adrfam": "IPv4", 00:22:31.410 "traddr": "10.0.0.2", 00:22:31.410 "trsvcid": "4420" 00:22:31.410 } 00:22:31.410 ], 00:22:31.410 "allow_any_host": true, 00:22:31.410 "hosts": [] 00:22:31.410 }, 00:22:31.410 { 00:22:31.410 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.410 "subtype": "NVMe", 00:22:31.410 "listen_addresses": [ 00:22:31.410 { 00:22:31.410 "transport": "TCP", 00:22:31.410 "trtype": "TCP", 00:22:31.410 "adrfam": "IPv4", 00:22:31.410 "traddr": "10.0.0.2", 00:22:31.410 "trsvcid": "4420" 00:22:31.410 } 00:22:31.410 ], 00:22:31.410 "allow_any_host": true, 00:22:31.410 "hosts": [], 00:22:31.410 "serial_number": "SPDK00000000000001", 00:22:31.410 "model_number": "SPDK bdev Controller", 00:22:31.410 "max_namespaces": 32, 00:22:31.410 "min_cntlid": 1, 00:22:31.410 "max_cntlid": 65519, 00:22:31.410 "namespaces": [ 00:22:31.410 { 00:22:31.410 "nsid": 1, 00:22:31.410 "bdev_name": "Malloc0", 00:22:31.410 "name": "Malloc0", 00:22:31.410 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:31.410 "eui64": "ABCDEF0123456789", 00:22:31.410 "uuid": "467fc925-9fa3-477d-b3ae-7654e440f964" 00:22:31.410 } 00:22:31.410 ] 00:22:31.410 } 00:22:31.410 ] 00:22:31.410 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.411 12:50:04 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:31.411 [2024-11-20 12:50:04.277329] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.411 [2024-11-20 12:50:04.277372] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3598546 ] 00:22:31.411 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.411 [2024-11-20 12:50:04.309793] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:31.411 [2024-11-20 12:50:04.309862] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:31.411 [2024-11-20 12:50:04.309872] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:31.411 [2024-11-20 12:50:04.309889] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:31.411 [2024-11-20 12:50:04.309902] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:31.411 [2024-11-20 12:50:04.313134] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:31.411 [2024-11-20 12:50:04.313209] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1d03e10 0 00:22:31.411 [2024-11-20 12:50:04.320084] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:31.411 [2024-11-20 12:50:04.320109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:31.411 [2024-11-20 12:50:04.320119] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:31.411 [2024-11-20 12:50:04.320125] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:31.411 [2024-11-20 12:50:04.320185] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.320200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.320207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.411 [2024-11-20 12:50:04.320230] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:31.411 [2024-11-20 12:50:04.320259] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.411 [2024-11-20 12:50:04.328102] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.411 [2024-11-20 12:50:04.328121] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.411 [2024-11-20 12:50:04.328129] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328136] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.411 [2024-11-20 12:50:04.328159] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:31.411 [2024-11-20 12:50:04.328177] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:31.411 [2024-11-20 12:50:04.328191] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:31.411 [2024-11-20 12:50:04.328213] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328224] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328230] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.411 [2024-11-20 12:50:04.328241] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.411 [2024-11-20 12:50:04.328266] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.411 [2024-11-20 12:50:04.328424] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.411 [2024-11-20 12:50:04.328440] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.411 [2024-11-20 12:50:04.328450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.411 [2024-11-20 12:50:04.328476] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:31.411 [2024-11-20 12:50:04.328489] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:31.411 [2024-11-20 12:50:04.328505] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328513] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328519] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.411 [2024-11-20 12:50:04.328530] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.411 [2024-11-20 12:50:04.328553] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.411 [2024-11-20 12:50:04.328639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.411 [2024-11-20 12:50:04.328655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.411 [2024-11-20 12:50:04.328662] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328671] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.411 [2024-11-20 12:50:04.328683] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:31.411 [2024-11-20 12:50:04.328699] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:31.411 [2024-11-20 12:50:04.328711] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328728] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.411 [2024-11-20 12:50:04.328739] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.411 [2024-11-20 12:50:04.328761] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.411 [2024-11-20 12:50:04.328854] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.411 [2024-11-20 12:50:04.328870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.411 [2024-11-20 12:50:04.328878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328887] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.411 [2024-11-20 12:50:04.328898] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:31.411 [2024-11-20 12:50:04.328915] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328924] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.328934] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.411 [2024-11-20 12:50:04.328945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.411 [2024-11-20 12:50:04.328967] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.411 [2024-11-20 12:50:04.329060] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.411 [2024-11-20 12:50:04.329085] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.411 [2024-11-20 12:50:04.329097] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.329104] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.411 [2024-11-20 12:50:04.329114] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:31.411 [2024-11-20 12:50:04.329127] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:31.411 [2024-11-20 12:50:04.329143] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:31.411 [2024-11-20 12:50:04.329260] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:31.411 [2024-11-20 12:50:04.329269] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:31.411 [2024-11-20 12:50:04.329285] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.329292] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.329298] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.411 [2024-11-20 12:50:04.329308] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.411 [2024-11-20 12:50:04.329329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.411 [2024-11-20 12:50:04.329524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.411 [2024-11-20 12:50:04.329540] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.411 [2024-11-20 12:50:04.329547] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.329555] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.411 [2024-11-20 12:50:04.329568] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:31.411 [2024-11-20 12:50:04.329585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.329594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.411 [2024-11-20 12:50:04.329600] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.329614] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.412 [2024-11-20 12:50:04.329637] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.412 [2024-11-20 12:50:04.329732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.412 [2024-11-20 12:50:04.329747] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.412 [2024-11-20 12:50:04.329755] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.329764] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.412 [2024-11-20 12:50:04.329773] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:31.412 [2024-11-20 12:50:04.329781] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:31.412 [2024-11-20 12:50:04.329795] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:31.412 [2024-11-20 12:50:04.329820] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:31.412 [2024-11-20 12:50:04.329839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.329846] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.329852] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.329863] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.412 [2024-11-20 12:50:04.329889] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.412 [2024-11-20 12:50:04.330043] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.412 [2024-11-20 12:50:04.330059] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.412 [2024-11-20 12:50:04.330079] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330094] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d03e10): datao=0, datal=4096, cccid=0 00:22:31.412 [2024-11-20 12:50:04.330107] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d83b30) on tqpair(0x1d03e10): expected_datao=0, payload_size=4096 00:22:31.412 [2024-11-20 12:50:04.330123] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330132] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330145] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.412 [2024-11-20 12:50:04.330155] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.412 [2024-11-20 12:50:04.330161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330168] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.412 [2024-11-20 12:50:04.330183] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:31.412 [2024-11-20 12:50:04.330192] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:31.412 [2024-11-20 12:50:04.330199] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:31.412 [2024-11-20 12:50:04.330209] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:31.412 [2024-11-20 12:50:04.330216] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:31.412 [2024-11-20 12:50:04.330224] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:31.412 [2024-11-20 12:50:04.330245] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:31.412 [2024-11-20 12:50:04.330261] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330269] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330275] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.330286] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:31.412 [2024-11-20 12:50:04.330308] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.412 [2024-11-20 12:50:04.330439] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.412 [2024-11-20 12:50:04.330454] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.412 [2024-11-20 12:50:04.330461] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330468] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83b30) on tqpair=0x1d03e10 00:22:31.412 [2024-11-20 12:50:04.330488] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330495] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330501] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.330511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.412 [2024-11-20 12:50:04.330521] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330532] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330539] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.330547] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.412 [2024-11-20 12:50:04.330557] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330564] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330570] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.330578] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.412 [2024-11-20 12:50:04.330588] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330600] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.330624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.412 [2024-11-20 12:50:04.330633] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:31.412 [2024-11-20 12:50:04.330654] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:31.412 [2024-11-20 12:50:04.330682] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330690] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330695] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.330705] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.412 [2024-11-20 12:50:04.330728] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83b30, cid 0, qid 0 00:22:31.412 [2024-11-20 12:50:04.330754] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83c90, cid 1, qid 0 00:22:31.412 [2024-11-20 12:50:04.330762] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83df0, cid 2, qid 0 00:22:31.412 [2024-11-20 12:50:04.330769] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83f50, cid 3, qid 0 00:22:31.412 [2024-11-20 12:50:04.330777] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d840b0, cid 4, qid 0 00:22:31.412 [2024-11-20 12:50:04.330930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.412 [2024-11-20 12:50:04.330945] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.412 [2024-11-20 12:50:04.330952] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.330960] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d840b0) on tqpair=0x1d03e10 00:22:31.412 [2024-11-20 12:50:04.330974] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:31.412 [2024-11-20 12:50:04.330983] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:31.412 [2024-11-20 12:50:04.331000] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.331011] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.331019] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d03e10) 00:22:31.412 [2024-11-20 12:50:04.331030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.412 [2024-11-20 12:50:04.331066] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d840b0, cid 4, qid 0 00:22:31.412 [2024-11-20 12:50:04.331241] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.412 [2024-11-20 12:50:04.331257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.412 [2024-11-20 12:50:04.331266] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.331275] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d03e10): datao=0, datal=4096, cccid=4 00:22:31.412 [2024-11-20 12:50:04.331288] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d840b0) on tqpair(0x1d03e10): expected_datao=0, payload_size=4096 00:22:31.412 [2024-11-20 12:50:04.331306] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.331316] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.412 [2024-11-20 12:50:04.331328] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.413 [2024-11-20 12:50:04.331338] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.413 [2024-11-20 12:50:04.331344] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331350] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d840b0) on tqpair=0x1d03e10 00:22:31.413 [2024-11-20 12:50:04.331373] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:31.413 [2024-11-20 12:50:04.331418] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331429] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331435] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d03e10) 00:22:31.413 [2024-11-20 12:50:04.331446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.413 [2024-11-20 12:50:04.331458] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331465] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331471] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d03e10) 00:22:31.413 [2024-11-20 12:50:04.331480] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.413 [2024-11-20 12:50:04.331507] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d840b0, cid 4, qid 0 00:22:31.413 [2024-11-20 12:50:04.331519] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84210, cid 5, qid 0 00:22:31.413 [2024-11-20 12:50:04.331681] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.413 [2024-11-20 12:50:04.331697] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.413 [2024-11-20 12:50:04.331704] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331713] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d03e10): datao=0, datal=1024, cccid=4 00:22:31.413 [2024-11-20 12:50:04.331721] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d840b0) on tqpair(0x1d03e10): expected_datao=0, payload_size=1024 00:22:31.413 [2024-11-20 12:50:04.331732] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331739] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331748] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.413 [2024-11-20 12:50:04.331757] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.413 [2024-11-20 12:50:04.331763] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.331769] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84210) on tqpair=0x1d03e10 00:22:31.413 [2024-11-20 12:50:04.373256] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.413 [2024-11-20 12:50:04.373277] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.413 [2024-11-20 12:50:04.373285] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373292] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d840b0) on tqpair=0x1d03e10 00:22:31.413 [2024-11-20 12:50:04.373318] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373328] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373334] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d03e10) 00:22:31.413 [2024-11-20 12:50:04.373346] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.413 [2024-11-20 12:50:04.373379] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d840b0, cid 4, qid 0 00:22:31.413 [2024-11-20 12:50:04.373572] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.413 [2024-11-20 12:50:04.373588] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.413 [2024-11-20 12:50:04.373595] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373604] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d03e10): datao=0, datal=3072, cccid=4 00:22:31.413 [2024-11-20 12:50:04.373616] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d840b0) on tqpair(0x1d03e10): expected_datao=0, payload_size=3072 00:22:31.413 [2024-11-20 12:50:04.373644] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373670] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373716] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.413 [2024-11-20 12:50:04.373731] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.413 [2024-11-20 12:50:04.373737] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373744] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d840b0) on tqpair=0x1d03e10 00:22:31.413 [2024-11-20 12:50:04.373761] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373769] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373775] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d03e10) 00:22:31.413 [2024-11-20 12:50:04.373785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.413 [2024-11-20 12:50:04.373815] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d840b0, cid 4, qid 0 00:22:31.413 [2024-11-20 12:50:04.373941] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.413 [2024-11-20 12:50:04.373957] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.413 [2024-11-20 12:50:04.373964] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373970] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d03e10): datao=0, datal=8, cccid=4 00:22:31.413 [2024-11-20 12:50:04.373977] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d840b0) on tqpair(0x1d03e10): expected_datao=0, payload_size=8 00:22:31.413 [2024-11-20 12:50:04.373988] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.373995] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.414240] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.413 [2024-11-20 12:50:04.414262] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.413 [2024-11-20 12:50:04.414270] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.413 [2024-11-20 12:50:04.414276] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d840b0) on tqpair=0x1d03e10 00:22:31.413 ===================================================== 00:22:31.413 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:31.413 ===================================================== 00:22:31.413 Controller Capabilities/Features 00:22:31.413 ================================ 00:22:31.413 Vendor ID: 0000 00:22:31.413 Subsystem Vendor ID: 0000 00:22:31.413 Serial Number: .................... 00:22:31.413 Model Number: ........................................ 00:22:31.413 Firmware Version: 24.01.1 00:22:31.413 Recommended Arb Burst: 0 00:22:31.413 IEEE OUI Identifier: 00 00 00 00:22:31.413 Multi-path I/O 00:22:31.413 May have multiple subsystem ports: No 00:22:31.413 May have multiple controllers: No 00:22:31.413 Associated with SR-IOV VF: No 00:22:31.413 Max Data Transfer Size: 131072 00:22:31.413 Max Number of Namespaces: 0 00:22:31.413 Max Number of I/O Queues: 1024 00:22:31.413 NVMe Specification Version (VS): 1.3 00:22:31.413 NVMe Specification Version (Identify): 1.3 00:22:31.413 Maximum Queue Entries: 128 00:22:31.413 Contiguous Queues Required: Yes 00:22:31.413 Arbitration Mechanisms Supported 00:22:31.413 Weighted Round Robin: Not Supported 00:22:31.413 Vendor Specific: Not Supported 00:22:31.413 Reset Timeout: 15000 ms 00:22:31.413 Doorbell Stride: 4 bytes 00:22:31.413 NVM Subsystem Reset: Not Supported 00:22:31.413 Command Sets Supported 00:22:31.413 NVM Command Set: Supported 00:22:31.413 Boot Partition: Not Supported 00:22:31.413 Memory Page Size Minimum: 4096 bytes 00:22:31.413 Memory Page Size Maximum: 4096 bytes 00:22:31.413 Persistent Memory Region: Not Supported 00:22:31.413 Optional Asynchronous Events Supported 00:22:31.413 Namespace Attribute Notices: Not Supported 00:22:31.413 Firmware Activation Notices: Not Supported 00:22:31.413 ANA Change Notices: Not Supported 00:22:31.413 PLE Aggregate Log Change Notices: Not Supported 00:22:31.413 LBA Status Info Alert Notices: Not Supported 00:22:31.413 EGE Aggregate Log Change Notices: Not Supported 00:22:31.413 Normal NVM Subsystem Shutdown event: Not Supported 00:22:31.413 Zone Descriptor Change Notices: Not Supported 00:22:31.413 Discovery Log Change Notices: Supported 00:22:31.413 Controller Attributes 00:22:31.413 128-bit Host Identifier: Not Supported 00:22:31.413 Non-Operational Permissive Mode: Not Supported 00:22:31.413 NVM Sets: Not Supported 00:22:31.413 Read Recovery Levels: Not Supported 00:22:31.413 Endurance Groups: Not Supported 00:22:31.414 Predictable Latency Mode: Not Supported 00:22:31.414 Traffic Based Keep ALive: Not Supported 00:22:31.414 Namespace Granularity: Not Supported 00:22:31.414 SQ Associations: Not Supported 00:22:31.414 UUID List: Not Supported 00:22:31.414 Multi-Domain Subsystem: Not Supported 00:22:31.414 Fixed Capacity Management: Not Supported 00:22:31.414 Variable Capacity Management: Not Supported 00:22:31.414 Delete Endurance Group: Not Supported 00:22:31.414 Delete NVM Set: Not Supported 00:22:31.414 Extended LBA Formats Supported: Not Supported 00:22:31.414 Flexible Data Placement Supported: Not Supported 00:22:31.414 00:22:31.414 Controller Memory Buffer Support 00:22:31.414 ================================ 00:22:31.414 Supported: No 00:22:31.414 00:22:31.414 Persistent Memory Region Support 00:22:31.414 ================================ 00:22:31.414 Supported: No 00:22:31.414 00:22:31.414 Admin Command Set Attributes 00:22:31.414 ============================ 00:22:31.414 Security Send/Receive: Not Supported 00:22:31.414 Format NVM: Not Supported 00:22:31.414 Firmware Activate/Download: Not Supported 00:22:31.414 Namespace Management: Not Supported 00:22:31.414 Device Self-Test: Not Supported 00:22:31.414 Directives: Not Supported 00:22:31.414 NVMe-MI: Not Supported 00:22:31.414 Virtualization Management: Not Supported 00:22:31.414 Doorbell Buffer Config: Not Supported 00:22:31.414 Get LBA Status Capability: Not Supported 00:22:31.414 Command & Feature Lockdown Capability: Not Supported 00:22:31.414 Abort Command Limit: 1 00:22:31.414 Async Event Request Limit: 4 00:22:31.414 Number of Firmware Slots: N/A 00:22:31.414 Firmware Slot 1 Read-Only: N/A 00:22:31.414 Firmware Activation Without Reset: N/A 00:22:31.414 Multiple Update Detection Support: N/A 00:22:31.414 Firmware Update Granularity: No Information Provided 00:22:31.414 Per-Namespace SMART Log: No 00:22:31.414 Asymmetric Namespace Access Log Page: Not Supported 00:22:31.414 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:31.414 Command Effects Log Page: Not Supported 00:22:31.414 Get Log Page Extended Data: Supported 00:22:31.414 Telemetry Log Pages: Not Supported 00:22:31.414 Persistent Event Log Pages: Not Supported 00:22:31.414 Supported Log Pages Log Page: May Support 00:22:31.414 Commands Supported & Effects Log Page: Not Supported 00:22:31.414 Feature Identifiers & Effects Log Page:May Support 00:22:31.414 NVMe-MI Commands & Effects Log Page: May Support 00:22:31.414 Data Area 4 for Telemetry Log: Not Supported 00:22:31.414 Error Log Page Entries Supported: 128 00:22:31.414 Keep Alive: Not Supported 00:22:31.414 00:22:31.414 NVM Command Set Attributes 00:22:31.414 ========================== 00:22:31.414 Submission Queue Entry Size 00:22:31.414 Max: 1 00:22:31.414 Min: 1 00:22:31.414 Completion Queue Entry Size 00:22:31.414 Max: 1 00:22:31.414 Min: 1 00:22:31.414 Number of Namespaces: 0 00:22:31.414 Compare Command: Not Supported 00:22:31.414 Write Uncorrectable Command: Not Supported 00:22:31.414 Dataset Management Command: Not Supported 00:22:31.414 Write Zeroes Command: Not Supported 00:22:31.414 Set Features Save Field: Not Supported 00:22:31.414 Reservations: Not Supported 00:22:31.414 Timestamp: Not Supported 00:22:31.414 Copy: Not Supported 00:22:31.414 Volatile Write Cache: Not Present 00:22:31.414 Atomic Write Unit (Normal): 1 00:22:31.414 Atomic Write Unit (PFail): 1 00:22:31.414 Atomic Compare & Write Unit: 1 00:22:31.414 Fused Compare & Write: Supported 00:22:31.414 Scatter-Gather List 00:22:31.414 SGL Command Set: Supported 00:22:31.414 SGL Keyed: Supported 00:22:31.414 SGL Bit Bucket Descriptor: Not Supported 00:22:31.414 SGL Metadata Pointer: Not Supported 00:22:31.414 Oversized SGL: Not Supported 00:22:31.414 SGL Metadata Address: Not Supported 00:22:31.414 SGL Offset: Supported 00:22:31.414 Transport SGL Data Block: Not Supported 00:22:31.414 Replay Protected Memory Block: Not Supported 00:22:31.414 00:22:31.414 Firmware Slot Information 00:22:31.414 ========================= 00:22:31.414 Active slot: 0 00:22:31.414 00:22:31.414 00:22:31.414 Error Log 00:22:31.414 ========= 00:22:31.414 00:22:31.414 Active Namespaces 00:22:31.414 ================= 00:22:31.414 Discovery Log Page 00:22:31.414 ================== 00:22:31.414 Generation Counter: 2 00:22:31.414 Number of Records: 2 00:22:31.414 Record Format: 0 00:22:31.414 00:22:31.414 Discovery Log Entry 0 00:22:31.414 ---------------------- 00:22:31.414 Transport Type: 3 (TCP) 00:22:31.414 Address Family: 1 (IPv4) 00:22:31.414 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:31.414 Entry Flags: 00:22:31.414 Duplicate Returned Information: 1 00:22:31.414 Explicit Persistent Connection Support for Discovery: 1 00:22:31.414 Transport Requirements: 00:22:31.414 Secure Channel: Not Required 00:22:31.414 Port ID: 0 (0x0000) 00:22:31.414 Controller ID: 65535 (0xffff) 00:22:31.414 Admin Max SQ Size: 128 00:22:31.414 Transport Service Identifier: 4420 00:22:31.414 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:31.414 Transport Address: 10.0.0.2 00:22:31.414 Discovery Log Entry 1 00:22:31.414 ---------------------- 00:22:31.414 Transport Type: 3 (TCP) 00:22:31.414 Address Family: 1 (IPv4) 00:22:31.414 Subsystem Type: 2 (NVM Subsystem) 00:22:31.414 Entry Flags: 00:22:31.414 Duplicate Returned Information: 0 00:22:31.414 Explicit Persistent Connection Support for Discovery: 0 00:22:31.414 Transport Requirements: 00:22:31.414 Secure Channel: Not Required 00:22:31.414 Port ID: 0 (0x0000) 00:22:31.414 Controller ID: 65535 (0xffff) 00:22:31.414 Admin Max SQ Size: 128 00:22:31.414 Transport Service Identifier: 4420 00:22:31.414 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:31.415 Transport Address: 10.0.0.2 [2024-11-20 12:50:04.414407] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:31.415 [2024-11-20 12:50:04.414437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.415 [2024-11-20 12:50:04.414452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.415 [2024-11-20 12:50:04.414465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.415 [2024-11-20 12:50:04.414475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.415 [2024-11-20 12:50:04.414490] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.414497] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.414503] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d03e10) 00:22:31.415 [2024-11-20 12:50:04.414514] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.415 [2024-11-20 12:50:04.414557] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83f50, cid 3, qid 0 00:22:31.415 [2024-11-20 12:50:04.414714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.415 [2024-11-20 12:50:04.414730] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.415 [2024-11-20 12:50:04.414737] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.414744] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83f50) on tqpair=0x1d03e10 00:22:31.415 [2024-11-20 12:50:04.414759] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.414766] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.414772] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d03e10) 00:22:31.415 [2024-11-20 12:50:04.414783] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.415 [2024-11-20 12:50:04.414812] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83f50, cid 3, qid 0 00:22:31.415 [2024-11-20 12:50:04.414953] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.415 [2024-11-20 12:50:04.414968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.415 [2024-11-20 12:50:04.414975] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.414982] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83f50) on tqpair=0x1d03e10 00:22:31.415 [2024-11-20 12:50:04.414993] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:31.415 [2024-11-20 12:50:04.415001] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:31.415 [2024-11-20 12:50:04.415019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.415030] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.415036] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d03e10) 00:22:31.415 [2024-11-20 12:50:04.415046] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.415 [2024-11-20 12:50:04.419090] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83f50, cid 3, qid 0 00:22:31.415 [2024-11-20 12:50:04.419112] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.415 [2024-11-20 12:50:04.419122] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.415 [2024-11-20 12:50:04.419129] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.419135] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83f50) on tqpair=0x1d03e10 00:22:31.415 [2024-11-20 12:50:04.419156] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.419167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.419173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d03e10) 00:22:31.415 [2024-11-20 12:50:04.419184] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.415 [2024-11-20 12:50:04.419213] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d83f50, cid 3, qid 0 00:22:31.415 [2024-11-20 12:50:04.419344] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.415 [2024-11-20 12:50:04.419359] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.415 [2024-11-20 12:50:04.419369] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.419377] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d83f50) on tqpair=0x1d03e10 00:22:31.415 [2024-11-20 12:50:04.419393] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:22:31.415 00:22:31.415 12:50:04 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:31.415 [2024-11-20 12:50:04.452928] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.415 [2024-11-20 12:50:04.452969] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3598554 ] 00:22:31.415 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.415 [2024-11-20 12:50:04.484532] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:31.415 [2024-11-20 12:50:04.484585] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:31.415 [2024-11-20 12:50:04.484594] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:31.415 [2024-11-20 12:50:04.484609] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:31.415 [2024-11-20 12:50:04.484621] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:31.415 [2024-11-20 12:50:04.488105] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:31.415 [2024-11-20 12:50:04.488164] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1017e10 0 00:22:31.415 [2024-11-20 12:50:04.496085] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:31.415 [2024-11-20 12:50:04.496104] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:31.415 [2024-11-20 12:50:04.496112] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:31.415 [2024-11-20 12:50:04.496118] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:31.415 [2024-11-20 12:50:04.496157] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.496169] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.496176] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.415 [2024-11-20 12:50:04.496190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:31.415 [2024-11-20 12:50:04.496216] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.415 [2024-11-20 12:50:04.502095] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.415 [2024-11-20 12:50:04.502112] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.415 [2024-11-20 12:50:04.502119] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.502126] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.415 [2024-11-20 12:50:04.502141] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:31.415 [2024-11-20 12:50:04.502151] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:31.415 [2024-11-20 12:50:04.502165] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:31.415 [2024-11-20 12:50:04.502181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.502189] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.415 [2024-11-20 12:50:04.502196] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.415 [2024-11-20 12:50:04.502206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.415 [2024-11-20 12:50:04.502230] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.415 [2024-11-20 12:50:04.502369] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.415 [2024-11-20 12:50:04.502384] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.415 [2024-11-20 12:50:04.502391] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502398] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.416 [2024-11-20 12:50:04.502407] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:31.416 [2024-11-20 12:50:04.502421] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:31.416 [2024-11-20 12:50:04.502433] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502441] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502447] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.416 [2024-11-20 12:50:04.502458] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.416 [2024-11-20 12:50:04.502479] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.416 [2024-11-20 12:50:04.502568] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.416 [2024-11-20 12:50:04.502580] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.416 [2024-11-20 12:50:04.502587] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502594] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.416 [2024-11-20 12:50:04.502603] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:31.416 [2024-11-20 12:50:04.502616] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:31.416 [2024-11-20 12:50:04.502628] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502636] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502641] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.416 [2024-11-20 12:50:04.502652] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.416 [2024-11-20 12:50:04.502673] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.416 [2024-11-20 12:50:04.502760] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.416 [2024-11-20 12:50:04.502775] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.416 [2024-11-20 12:50:04.502781] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502788] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.416 [2024-11-20 12:50:04.502798] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:31.416 [2024-11-20 12:50:04.502815] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502828] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502835] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.416 [2024-11-20 12:50:04.502845] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.416 [2024-11-20 12:50:04.502866] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.416 [2024-11-20 12:50:04.502953] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.416 [2024-11-20 12:50:04.502966] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.416 [2024-11-20 12:50:04.502972] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.502979] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.416 [2024-11-20 12:50:04.502988] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:31.416 [2024-11-20 12:50:04.502996] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:31.416 [2024-11-20 12:50:04.503008] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:31.416 [2024-11-20 12:50:04.503119] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:31.416 [2024-11-20 12:50:04.503128] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:31.416 [2024-11-20 12:50:04.503140] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.416 [2024-11-20 12:50:04.503178] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.416 [2024-11-20 12:50:04.503200] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.416 [2024-11-20 12:50:04.503336] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.416 [2024-11-20 12:50:04.503351] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.416 [2024-11-20 12:50:04.503358] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503365] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.416 [2024-11-20 12:50:04.503374] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:31.416 [2024-11-20 12:50:04.503391] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503399] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.416 [2024-11-20 12:50:04.503416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.416 [2024-11-20 12:50:04.503437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.416 [2024-11-20 12:50:04.503527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.416 [2024-11-20 12:50:04.503542] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.416 [2024-11-20 12:50:04.503548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503555] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.416 [2024-11-20 12:50:04.503564] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:31.416 [2024-11-20 12:50:04.503575] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:31.416 [2024-11-20 12:50:04.503590] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:31.416 [2024-11-20 12:50:04.503608] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:31.416 [2024-11-20 12:50:04.503623] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503630] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.416 [2024-11-20 12:50:04.503636] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.416 [2024-11-20 12:50:04.503647] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.416 [2024-11-20 12:50:04.503668] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.417 [2024-11-20 12:50:04.503808] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.417 [2024-11-20 12:50:04.503823] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.417 [2024-11-20 12:50:04.503830] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.417 [2024-11-20 12:50:04.503836] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=4096, cccid=0 00:22:31.417 [2024-11-20 12:50:04.503844] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1097b30) on tqpair(0x1017e10): expected_datao=0, payload_size=4096 00:22:31.417 [2024-11-20 12:50:04.503863] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.417 [2024-11-20 12:50:04.503873] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544231] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.683 [2024-11-20 12:50:04.544251] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.683 [2024-11-20 12:50:04.544259] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.683 [2024-11-20 12:50:04.544279] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:31.683 [2024-11-20 12:50:04.544287] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:31.683 [2024-11-20 12:50:04.544295] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:31.683 [2024-11-20 12:50:04.544301] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:31.683 [2024-11-20 12:50:04.544309] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:31.683 [2024-11-20 12:50:04.544317] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:31.683 [2024-11-20 12:50:04.544336] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:31.683 [2024-11-20 12:50:04.544350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544358] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544364] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.683 [2024-11-20 12:50:04.544376] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:31.683 [2024-11-20 12:50:04.544399] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.683 [2024-11-20 12:50:04.544488] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.683 [2024-11-20 12:50:04.544503] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.683 [2024-11-20 12:50:04.544515] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544522] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097b30) on tqpair=0x1017e10 00:22:31.683 [2024-11-20 12:50:04.544534] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544541] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544547] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1017e10) 00:22:31.683 [2024-11-20 12:50:04.544556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.683 [2024-11-20 12:50:04.544567] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544573] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544579] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1017e10) 00:22:31.683 [2024-11-20 12:50:04.544588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.683 [2024-11-20 12:50:04.544597] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544604] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544610] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1017e10) 00:22:31.683 [2024-11-20 12:50:04.544618] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.683 [2024-11-20 12:50:04.544628] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544641] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.683 [2024-11-20 12:50:04.544649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.683 [2024-11-20 12:50:04.544658] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:31.683 [2024-11-20 12:50:04.544692] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:31.683 [2024-11-20 12:50:04.544705] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544711] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.683 [2024-11-20 12:50:04.544717] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.683 [2024-11-20 12:50:04.544727] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.683 [2024-11-20 12:50:04.544749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097b30, cid 0, qid 0 00:22:31.683 [2024-11-20 12:50:04.544774] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097c90, cid 1, qid 0 00:22:31.683 [2024-11-20 12:50:04.544782] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097df0, cid 2, qid 0 00:22:31.684 [2024-11-20 12:50:04.544789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.684 [2024-11-20 12:50:04.544797] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.684 [2024-11-20 12:50:04.544941] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.684 [2024-11-20 12:50:04.544956] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.684 [2024-11-20 12:50:04.544963] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.544970] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.684 [2024-11-20 12:50:04.544978] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:31.684 [2024-11-20 12:50:04.544991] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545007] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545024] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545036] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545043] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545049] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.684 [2024-11-20 12:50:04.545060] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:31.684 [2024-11-20 12:50:04.545104] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.684 [2024-11-20 12:50:04.545294] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.684 [2024-11-20 12:50:04.545310] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.684 [2024-11-20 12:50:04.545317] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545323] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.684 [2024-11-20 12:50:04.545392] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545411] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545426] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545440] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.684 [2024-11-20 12:50:04.545465] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.684 [2024-11-20 12:50:04.545486] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.684 [2024-11-20 12:50:04.545658] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.684 [2024-11-20 12:50:04.545674] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.684 [2024-11-20 12:50:04.545681] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545687] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=4096, cccid=4 00:22:31.684 [2024-11-20 12:50:04.545695] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10980b0) on tqpair(0x1017e10): expected_datao=0, payload_size=4096 00:22:31.684 [2024-11-20 12:50:04.545706] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545714] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545725] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.684 [2024-11-20 12:50:04.545735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.684 [2024-11-20 12:50:04.545742] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545748] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.684 [2024-11-20 12:50:04.545774] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:31.684 [2024-11-20 12:50:04.545791] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545809] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.545827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545835] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.545841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.684 [2024-11-20 12:50:04.545852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.684 [2024-11-20 12:50:04.545873] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.684 [2024-11-20 12:50:04.545998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.684 [2024-11-20 12:50:04.546013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.684 [2024-11-20 12:50:04.546020] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546026] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=4096, cccid=4 00:22:31.684 [2024-11-20 12:50:04.546033] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10980b0) on tqpair(0x1017e10): expected_datao=0, payload_size=4096 00:22:31.684 [2024-11-20 12:50:04.546044] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546052] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546064] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.684 [2024-11-20 12:50:04.546082] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.684 [2024-11-20 12:50:04.546090] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546096] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.684 [2024-11-20 12:50:04.546125] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.546145] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.546159] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.684 [2024-11-20 12:50:04.546183] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.684 [2024-11-20 12:50:04.546205] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.684 [2024-11-20 12:50:04.546311] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.684 [2024-11-20 12:50:04.546327] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.684 [2024-11-20 12:50:04.546334] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546340] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=4096, cccid=4 00:22:31.684 [2024-11-20 12:50:04.546347] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10980b0) on tqpair(0x1017e10): expected_datao=0, payload_size=4096 00:22:31.684 [2024-11-20 12:50:04.546358] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546366] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546395] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.684 [2024-11-20 12:50:04.546407] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.684 [2024-11-20 12:50:04.546414] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.684 [2024-11-20 12:50:04.546420] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.684 [2024-11-20 12:50:04.546440] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.546455] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:31.684 [2024-11-20 12:50:04.546472] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:31.685 [2024-11-20 12:50:04.546484] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:31.685 [2024-11-20 12:50:04.546493] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:31.685 [2024-11-20 12:50:04.546502] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:31.685 [2024-11-20 12:50:04.546510] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:31.685 [2024-11-20 12:50:04.546519] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:31.685 [2024-11-20 12:50:04.546538] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546546] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546552] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.546563] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.546589] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546597] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546602] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.546611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:31.685 [2024-11-20 12:50:04.546636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.685 [2024-11-20 12:50:04.546662] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1098210, cid 5, qid 0 00:22:31.685 [2024-11-20 12:50:04.546850] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.685 [2024-11-20 12:50:04.546865] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.685 [2024-11-20 12:50:04.546872] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546878] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.685 [2024-11-20 12:50:04.546890] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.685 [2024-11-20 12:50:04.546899] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.685 [2024-11-20 12:50:04.546906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546912] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1098210) on tqpair=0x1017e10 00:22:31.685 [2024-11-20 12:50:04.546929] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.546944] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.546954] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.546976] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1098210, cid 5, qid 0 00:22:31.685 [2024-11-20 12:50:04.551097] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.685 [2024-11-20 12:50:04.551123] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.685 [2024-11-20 12:50:04.551135] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551143] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1098210) on tqpair=0x1017e10 00:22:31.685 [2024-11-20 12:50:04.551161] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551170] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551176] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.551186] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.551209] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1098210, cid 5, qid 0 00:22:31.685 [2024-11-20 12:50:04.551339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.685 [2024-11-20 12:50:04.551354] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.685 [2024-11-20 12:50:04.551361] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551367] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1098210) on tqpair=0x1017e10 00:22:31.685 [2024-11-20 12:50:04.551385] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551394] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551400] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.551410] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.551431] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1098210, cid 5, qid 0 00:22:31.685 [2024-11-20 12:50:04.551519] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.685 [2024-11-20 12:50:04.551534] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.685 [2024-11-20 12:50:04.551541] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551547] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1098210) on tqpair=0x1017e10 00:22:31.685 [2024-11-20 12:50:04.551568] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551578] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551585] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.551595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.551608] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551615] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551621] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.551630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.551642] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551649] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551655] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.551664] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.551676] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551683] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.551689] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1017e10) 00:22:31.685 [2024-11-20 12:50:04.551703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.685 [2024-11-20 12:50:04.551740] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1098210, cid 5, qid 0 00:22:31.685 [2024-11-20 12:50:04.551751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10980b0, cid 4, qid 0 00:22:31.685 [2024-11-20 12:50:04.551758] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1098370, cid 6, qid 0 00:22:31.685 [2024-11-20 12:50:04.551765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10984d0, cid 7, qid 0 00:22:31.685 [2024-11-20 12:50:04.552026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.685 [2024-11-20 12:50:04.552042] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.685 [2024-11-20 12:50:04.552049] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.552056] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=8192, cccid=5 00:22:31.685 [2024-11-20 12:50:04.552063] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1098210) on tqpair(0x1017e10): expected_datao=0, payload_size=8192 00:22:31.685 [2024-11-20 12:50:04.552092] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.552101] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.552110] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.685 [2024-11-20 12:50:04.552119] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.685 [2024-11-20 12:50:04.552125] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.552131] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=512, cccid=4 00:22:31.685 [2024-11-20 12:50:04.552149] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10980b0) on tqpair(0x1017e10): expected_datao=0, payload_size=512 00:22:31.685 [2024-11-20 12:50:04.552159] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.552166] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.685 [2024-11-20 12:50:04.552174] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.685 [2024-11-20 12:50:04.552183] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.685 [2024-11-20 12:50:04.552189] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552195] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=512, cccid=6 00:22:31.686 [2024-11-20 12:50:04.552202] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1098370) on tqpair(0x1017e10): expected_datao=0, payload_size=512 00:22:31.686 [2024-11-20 12:50:04.552212] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552226] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552235] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:31.686 [2024-11-20 12:50:04.552243] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:31.686 [2024-11-20 12:50:04.552250] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552256] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1017e10): datao=0, datal=4096, cccid=7 00:22:31.686 [2024-11-20 12:50:04.552263] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10984d0) on tqpair(0x1017e10): expected_datao=0, payload_size=4096 00:22:31.686 [2024-11-20 12:50:04.552282] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552291] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552302] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.686 [2024-11-20 12:50:04.552311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.686 [2024-11-20 12:50:04.552318] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552340] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1098210) on tqpair=0x1017e10 00:22:31.686 [2024-11-20 12:50:04.552365] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.686 [2024-11-20 12:50:04.552377] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.686 [2024-11-20 12:50:04.552384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552390] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10980b0) on tqpair=0x1017e10 00:22:31.686 [2024-11-20 12:50:04.552419] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.686 [2024-11-20 12:50:04.552429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.686 [2024-11-20 12:50:04.552435] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552442] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1098370) on tqpair=0x1017e10 00:22:31.686 [2024-11-20 12:50:04.552452] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.686 [2024-11-20 12:50:04.552461] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.686 [2024-11-20 12:50:04.552467] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.686 [2024-11-20 12:50:04.552473] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10984d0) on tqpair=0x1017e10 00:22:31.686 ===================================================== 00:22:31.686 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:31.686 ===================================================== 00:22:31.686 Controller Capabilities/Features 00:22:31.686 ================================ 00:22:31.686 Vendor ID: 8086 00:22:31.686 Subsystem Vendor ID: 8086 00:22:31.686 Serial Number: SPDK00000000000001 00:22:31.686 Model Number: SPDK bdev Controller 00:22:31.686 Firmware Version: 24.01.1 00:22:31.686 Recommended Arb Burst: 6 00:22:31.686 IEEE OUI Identifier: e4 d2 5c 00:22:31.686 Multi-path I/O 00:22:31.686 May have multiple subsystem ports: Yes 00:22:31.686 May have multiple controllers: Yes 00:22:31.686 Associated with SR-IOV VF: No 00:22:31.686 Max Data Transfer Size: 131072 00:22:31.686 Max Number of Namespaces: 32 00:22:31.686 Max Number of I/O Queues: 127 00:22:31.686 NVMe Specification Version (VS): 1.3 00:22:31.686 NVMe Specification Version (Identify): 1.3 00:22:31.686 Maximum Queue Entries: 128 00:22:31.686 Contiguous Queues Required: Yes 00:22:31.686 Arbitration Mechanisms Supported 00:22:31.686 Weighted Round Robin: Not Supported 00:22:31.686 Vendor Specific: Not Supported 00:22:31.686 Reset Timeout: 15000 ms 00:22:31.686 Doorbell Stride: 4 bytes 00:22:31.686 NVM Subsystem Reset: Not Supported 00:22:31.686 Command Sets Supported 00:22:31.686 NVM Command Set: Supported 00:22:31.686 Boot Partition: Not Supported 00:22:31.686 Memory Page Size Minimum: 4096 bytes 00:22:31.686 Memory Page Size Maximum: 4096 bytes 00:22:31.686 Persistent Memory Region: Not Supported 00:22:31.686 Optional Asynchronous Events Supported 00:22:31.686 Namespace Attribute Notices: Supported 00:22:31.686 Firmware Activation Notices: Not Supported 00:22:31.686 ANA Change Notices: Not Supported 00:22:31.686 PLE Aggregate Log Change Notices: Not Supported 00:22:31.686 LBA Status Info Alert Notices: Not Supported 00:22:31.686 EGE Aggregate Log Change Notices: Not Supported 00:22:31.686 Normal NVM Subsystem Shutdown event: Not Supported 00:22:31.686 Zone Descriptor Change Notices: Not Supported 00:22:31.686 Discovery Log Change Notices: Not Supported 00:22:31.686 Controller Attributes 00:22:31.686 128-bit Host Identifier: Supported 00:22:31.686 Non-Operational Permissive Mode: Not Supported 00:22:31.686 NVM Sets: Not Supported 00:22:31.686 Read Recovery Levels: Not Supported 00:22:31.686 Endurance Groups: Not Supported 00:22:31.686 Predictable Latency Mode: Not Supported 00:22:31.686 Traffic Based Keep ALive: Not Supported 00:22:31.686 Namespace Granularity: Not Supported 00:22:31.686 SQ Associations: Not Supported 00:22:31.686 UUID List: Not Supported 00:22:31.686 Multi-Domain Subsystem: Not Supported 00:22:31.686 Fixed Capacity Management: Not Supported 00:22:31.686 Variable Capacity Management: Not Supported 00:22:31.686 Delete Endurance Group: Not Supported 00:22:31.686 Delete NVM Set: Not Supported 00:22:31.686 Extended LBA Formats Supported: Not Supported 00:22:31.686 Flexible Data Placement Supported: Not Supported 00:22:31.686 00:22:31.686 Controller Memory Buffer Support 00:22:31.686 ================================ 00:22:31.686 Supported: No 00:22:31.686 00:22:31.686 Persistent Memory Region Support 00:22:31.686 ================================ 00:22:31.686 Supported: No 00:22:31.686 00:22:31.686 Admin Command Set Attributes 00:22:31.686 ============================ 00:22:31.686 Security Send/Receive: Not Supported 00:22:31.686 Format NVM: Not Supported 00:22:31.686 Firmware Activate/Download: Not Supported 00:22:31.686 Namespace Management: Not Supported 00:22:31.686 Device Self-Test: Not Supported 00:22:31.686 Directives: Not Supported 00:22:31.686 NVMe-MI: Not Supported 00:22:31.686 Virtualization Management: Not Supported 00:22:31.686 Doorbell Buffer Config: Not Supported 00:22:31.686 Get LBA Status Capability: Not Supported 00:22:31.686 Command & Feature Lockdown Capability: Not Supported 00:22:31.686 Abort Command Limit: 4 00:22:31.686 Async Event Request Limit: 4 00:22:31.686 Number of Firmware Slots: N/A 00:22:31.686 Firmware Slot 1 Read-Only: N/A 00:22:31.686 Firmware Activation Without Reset: N/A 00:22:31.686 Multiple Update Detection Support: N/A 00:22:31.686 Firmware Update Granularity: No Information Provided 00:22:31.687 Per-Namespace SMART Log: No 00:22:31.687 Asymmetric Namespace Access Log Page: Not Supported 00:22:31.687 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:31.687 Command Effects Log Page: Supported 00:22:31.687 Get Log Page Extended Data: Supported 00:22:31.687 Telemetry Log Pages: Not Supported 00:22:31.687 Persistent Event Log Pages: Not Supported 00:22:31.687 Supported Log Pages Log Page: May Support 00:22:31.687 Commands Supported & Effects Log Page: Not Supported 00:22:31.687 Feature Identifiers & Effects Log Page:May Support 00:22:31.687 NVMe-MI Commands & Effects Log Page: May Support 00:22:31.687 Data Area 4 for Telemetry Log: Not Supported 00:22:31.687 Error Log Page Entries Supported: 128 00:22:31.687 Keep Alive: Supported 00:22:31.687 Keep Alive Granularity: 10000 ms 00:22:31.687 00:22:31.687 NVM Command Set Attributes 00:22:31.687 ========================== 00:22:31.687 Submission Queue Entry Size 00:22:31.687 Max: 64 00:22:31.687 Min: 64 00:22:31.687 Completion Queue Entry Size 00:22:31.687 Max: 16 00:22:31.687 Min: 16 00:22:31.687 Number of Namespaces: 32 00:22:31.687 Compare Command: Supported 00:22:31.687 Write Uncorrectable Command: Not Supported 00:22:31.687 Dataset Management Command: Supported 00:22:31.687 Write Zeroes Command: Supported 00:22:31.687 Set Features Save Field: Not Supported 00:22:31.687 Reservations: Supported 00:22:31.687 Timestamp: Not Supported 00:22:31.687 Copy: Supported 00:22:31.687 Volatile Write Cache: Present 00:22:31.687 Atomic Write Unit (Normal): 1 00:22:31.687 Atomic Write Unit (PFail): 1 00:22:31.687 Atomic Compare & Write Unit: 1 00:22:31.687 Fused Compare & Write: Supported 00:22:31.687 Scatter-Gather List 00:22:31.687 SGL Command Set: Supported 00:22:31.687 SGL Keyed: Supported 00:22:31.687 SGL Bit Bucket Descriptor: Not Supported 00:22:31.687 SGL Metadata Pointer: Not Supported 00:22:31.687 Oversized SGL: Not Supported 00:22:31.687 SGL Metadata Address: Not Supported 00:22:31.687 SGL Offset: Supported 00:22:31.687 Transport SGL Data Block: Not Supported 00:22:31.687 Replay Protected Memory Block: Not Supported 00:22:31.687 00:22:31.687 Firmware Slot Information 00:22:31.687 ========================= 00:22:31.687 Active slot: 1 00:22:31.687 Slot 1 Firmware Revision: 24.01.1 00:22:31.687 00:22:31.687 00:22:31.687 Commands Supported and Effects 00:22:31.687 ============================== 00:22:31.687 Admin Commands 00:22:31.687 -------------- 00:22:31.687 Get Log Page (02h): Supported 00:22:31.687 Identify (06h): Supported 00:22:31.687 Abort (08h): Supported 00:22:31.687 Set Features (09h): Supported 00:22:31.687 Get Features (0Ah): Supported 00:22:31.687 Asynchronous Event Request (0Ch): Supported 00:22:31.687 Keep Alive (18h): Supported 00:22:31.687 I/O Commands 00:22:31.687 ------------ 00:22:31.687 Flush (00h): Supported LBA-Change 00:22:31.687 Write (01h): Supported LBA-Change 00:22:31.687 Read (02h): Supported 00:22:31.687 Compare (05h): Supported 00:22:31.687 Write Zeroes (08h): Supported LBA-Change 00:22:31.687 Dataset Management (09h): Supported LBA-Change 00:22:31.687 Copy (19h): Supported LBA-Change 00:22:31.687 Unknown (79h): Supported LBA-Change 00:22:31.687 Unknown (7Ah): Supported 00:22:31.687 00:22:31.687 Error Log 00:22:31.687 ========= 00:22:31.687 00:22:31.687 Arbitration 00:22:31.687 =========== 00:22:31.687 Arbitration Burst: 1 00:22:31.687 00:22:31.687 Power Management 00:22:31.687 ================ 00:22:31.687 Number of Power States: 1 00:22:31.687 Current Power State: Power State #0 00:22:31.687 Power State #0: 00:22:31.687 Max Power: 0.00 W 00:22:31.687 Non-Operational State: Operational 00:22:31.687 Entry Latency: Not Reported 00:22:31.687 Exit Latency: Not Reported 00:22:31.687 Relative Read Throughput: 0 00:22:31.687 Relative Read Latency: 0 00:22:31.687 Relative Write Throughput: 0 00:22:31.687 Relative Write Latency: 0 00:22:31.687 Idle Power: Not Reported 00:22:31.687 Active Power: Not Reported 00:22:31.687 Non-Operational Permissive Mode: Not Supported 00:22:31.687 00:22:31.687 Health Information 00:22:31.687 ================== 00:22:31.687 Critical Warnings: 00:22:31.687 Available Spare Space: OK 00:22:31.687 Temperature: OK 00:22:31.687 Device Reliability: OK 00:22:31.687 Read Only: No 00:22:31.687 Volatile Memory Backup: OK 00:22:31.687 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:31.687 Temperature Threshold: [2024-11-20 12:50:04.552592] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.687 [2024-11-20 12:50:04.552603] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.687 [2024-11-20 12:50:04.552609] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1017e10) 00:22:31.687 [2024-11-20 12:50:04.552619] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.687 [2024-11-20 12:50:04.552641] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10984d0, cid 7, qid 0 00:22:31.687 [2024-11-20 12:50:04.552796] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.687 [2024-11-20 12:50:04.552811] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.687 [2024-11-20 12:50:04.552818] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.687 [2024-11-20 12:50:04.552825] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10984d0) on tqpair=0x1017e10 00:22:31.687 [2024-11-20 12:50:04.552868] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:31.687 [2024-11-20 12:50:04.552890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.687 [2024-11-20 12:50:04.552901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.687 [2024-11-20 12:50:04.552911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.687 [2024-11-20 12:50:04.552920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:31.687 [2024-11-20 12:50:04.552932] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.687 [2024-11-20 12:50:04.552940] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.687 [2024-11-20 12:50:04.552946] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.687 [2024-11-20 12:50:04.552972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.687 [2024-11-20 12:50:04.552994] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.687 [2024-11-20 12:50:04.553186] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.687 [2024-11-20 12:50:04.553202] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.687 [2024-11-20 12:50:04.553208] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.687 [2024-11-20 12:50:04.553215] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.553231] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553240] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553246] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.553256] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.553283] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.553392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.553404] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.553411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553417] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.553426] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:31.688 [2024-11-20 12:50:04.553433] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:31.688 [2024-11-20 12:50:04.553448] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553457] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553463] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.553473] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.553494] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.553579] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.553594] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.553601] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553607] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.553625] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553640] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.553650] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.553671] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.553782] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.553797] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.553803] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553810] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.553827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553836] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.553842] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.553853] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.553873] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.553984] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.553999] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.554009] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554017] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.554034] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554043] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554050] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.554060] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.554090] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.554184] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.554196] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.554203] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554210] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.554226] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554236] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554243] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.554253] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.554274] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.554357] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.554371] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.554378] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554385] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.554402] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554411] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.554430] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.554450] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.554562] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.554577] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.554584] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554590] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.554607] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554616] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554623] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.554633] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.554653] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.554761] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.554773] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.554780] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554791] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.688 [2024-11-20 12:50:04.554809] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554818] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.688 [2024-11-20 12:50:04.554824] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.688 [2024-11-20 12:50:04.554834] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.688 [2024-11-20 12:50:04.554855] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.688 [2024-11-20 12:50:04.554939] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.688 [2024-11-20 12:50:04.554952] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.688 [2024-11-20 12:50:04.554961] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.554967] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.554984] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.554994] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555001] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.555011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.555031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.555138] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.689 [2024-11-20 12:50:04.555154] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.689 [2024-11-20 12:50:04.555160] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555167] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.555184] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.555210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.555231] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.555316] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.689 [2024-11-20 12:50:04.555328] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.689 [2024-11-20 12:50:04.555335] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555342] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.555358] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555368] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555374] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.555384] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.555405] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.555494] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.689 [2024-11-20 12:50:04.555509] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.689 [2024-11-20 12:50:04.555516] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555524] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.555545] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555555] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555561] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.555572] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.555593] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.555694] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.689 [2024-11-20 12:50:04.555709] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.689 [2024-11-20 12:50:04.555717] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555724] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.555742] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.555768] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.555788] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.555884] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.689 [2024-11-20 12:50:04.555898] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.689 [2024-11-20 12:50:04.555905] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555912] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.555929] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.555944] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.555955] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.555975] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.556096] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.689 [2024-11-20 12:50:04.556109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.689 [2024-11-20 12:50:04.556116] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.556123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.689 [2024-11-20 12:50:04.556140] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.556149] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.689 [2024-11-20 12:50:04.556155] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.689 [2024-11-20 12:50:04.556165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.689 [2024-11-20 12:50:04.556186] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.689 [2024-11-20 12:50:04.556271] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.556284] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.556290] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556297] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.556314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556327] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556335] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.556345] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.556366] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.556500] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.556513] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.556519] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556526] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.556544] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556553] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556559] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.556570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.556590] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.556673] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.556688] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.556695] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556701] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.556718] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556728] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.556745] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.556765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.556857] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.556869] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.556876] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556883] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.556899] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556908] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.556915] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.556925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.556945] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.557090] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.557105] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.557112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557119] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.557136] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557149] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557156] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.557166] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.557187] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.557282] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.557294] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.557300] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557307] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.557323] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557332] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557339] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.557349] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.557369] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.557453] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.557465] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.557471] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557478] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.557494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557503] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557510] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.557520] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.557540] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.557624] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.557636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.557643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557649] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.557665] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557674] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557681] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.557691] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.557711] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.557794] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.557806] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.557812] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557819] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.557835] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.557865] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.557886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.557970] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.557982] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.557989] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.557995] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.558012] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.558021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.558027] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.558038] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.558058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.558166] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.558181] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.558188] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.558194] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.690 [2024-11-20 12:50:04.558211] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.558220] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.690 [2024-11-20 12:50:04.558227] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.690 [2024-11-20 12:50:04.558237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.690 [2024-11-20 12:50:04.558258] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.690 [2024-11-20 12:50:04.558349] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.690 [2024-11-20 12:50:04.558361] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.690 [2024-11-20 12:50:04.558368] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558374] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.691 [2024-11-20 12:50:04.558391] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558400] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.691 [2024-11-20 12:50:04.558416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.691 [2024-11-20 12:50:04.558436] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.691 [2024-11-20 12:50:04.558521] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.691 [2024-11-20 12:50:04.558533] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.691 [2024-11-20 12:50:04.558540] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558546] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.691 [2024-11-20 12:50:04.558563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.691 [2024-11-20 12:50:04.558593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.691 [2024-11-20 12:50:04.558614] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.691 [2024-11-20 12:50:04.558699] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.691 [2024-11-20 12:50:04.558711] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.691 [2024-11-20 12:50:04.558718] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558724] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.691 [2024-11-20 12:50:04.558741] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558750] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558756] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.691 [2024-11-20 12:50:04.558766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.691 [2024-11-20 12:50:04.558787] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.691 [2024-11-20 12:50:04.558871] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.691 [2024-11-20 12:50:04.558883] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.691 [2024-11-20 12:50:04.558890] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558896] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.691 [2024-11-20 12:50:04.558913] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558921] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.558928] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.691 [2024-11-20 12:50:04.558938] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.691 [2024-11-20 12:50:04.558958] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.691 [2024-11-20 12:50:04.563080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.691 [2024-11-20 12:50:04.563109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.691 [2024-11-20 12:50:04.563117] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.563123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.691 [2024-11-20 12:50:04.563143] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.563152] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.563158] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1017e10) 00:22:31.691 [2024-11-20 12:50:04.563169] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:31.691 [2024-11-20 12:50:04.563191] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1097f50, cid 3, qid 0 00:22:31.691 [2024-11-20 12:50:04.563327] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:31.691 [2024-11-20 12:50:04.563339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:31.691 [2024-11-20 12:50:04.563346] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:31.691 [2024-11-20 12:50:04.563352] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1097f50) on tqpair=0x1017e10 00:22:31.691 [2024-11-20 12:50:04.563366] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 9 milliseconds 00:22:31.691 0 Kelvin (-273 Celsius) 00:22:31.691 Available Spare: 0% 00:22:31.691 Available Spare Threshold: 0% 00:22:31.691 Life Percentage Used: 0% 00:22:31.691 Data Units Read: 0 00:22:31.691 Data Units Written: 0 00:22:31.691 Host Read Commands: 0 00:22:31.691 Host Write Commands: 0 00:22:31.691 Controller Busy Time: 0 minutes 00:22:31.691 Power Cycles: 0 00:22:31.691 Power On Hours: 0 hours 00:22:31.691 Unsafe Shutdowns: 0 00:22:31.691 Unrecoverable Media Errors: 0 00:22:31.691 Lifetime Error Log Entries: 0 00:22:31.691 Warning Temperature Time: 0 minutes 00:22:31.691 Critical Temperature Time: 0 minutes 00:22:31.691 00:22:31.691 Number of Queues 00:22:31.691 ================ 00:22:31.691 Number of I/O Submission Queues: 127 00:22:31.691 Number of I/O Completion Queues: 127 00:22:31.691 00:22:31.691 Active Namespaces 00:22:31.691 ================= 00:22:31.691 Namespace ID:1 00:22:31.691 Error Recovery Timeout: Unlimited 00:22:31.691 Command Set Identifier: NVM (00h) 00:22:31.691 Deallocate: Supported 00:22:31.691 Deallocated/Unwritten Error: Not Supported 00:22:31.691 Deallocated Read Value: Unknown 00:22:31.691 Deallocate in Write Zeroes: Not Supported 00:22:31.691 Deallocated Guard Field: 0xFFFF 00:22:31.691 Flush: Supported 00:22:31.691 Reservation: Supported 00:22:31.691 Namespace Sharing Capabilities: Multiple Controllers 00:22:31.691 Size (in LBAs): 131072 (0GiB) 00:22:31.691 Capacity (in LBAs): 131072 (0GiB) 00:22:31.691 Utilization (in LBAs): 131072 (0GiB) 00:22:31.691 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:31.691 EUI64: ABCDEF0123456789 00:22:31.691 UUID: 467fc925-9fa3-477d-b3ae-7654e440f964 00:22:31.691 Thin Provisioning: Not Supported 00:22:31.691 Per-NS Atomic Units: Yes 00:22:31.691 Atomic Boundary Size (Normal): 0 00:22:31.691 Atomic Boundary Size (PFail): 0 00:22:31.691 Atomic Boundary Offset: 0 00:22:31.691 Maximum Single Source Range Length: 65535 00:22:31.691 Maximum Copy Length: 65535 00:22:31.691 Maximum Source Range Count: 1 00:22:31.691 NGUID/EUI64 Never Reused: No 00:22:31.691 Namespace Write Protected: No 00:22:31.691 Number of LBA Formats: 1 00:22:31.691 Current LBA Format: LBA Format #00 00:22:31.691 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:31.691 00:22:31.691 12:50:04 -- host/identify.sh@51 -- # sync 00:22:31.691 12:50:04 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:31.691 12:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.691 12:50:04 -- common/autotest_common.sh@10 -- # set +x 00:22:31.691 12:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.691 12:50:04 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:31.691 12:50:04 -- host/identify.sh@56 -- # nvmftestfini 00:22:31.691 12:50:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:31.691 12:50:04 -- nvmf/common.sh@116 -- # sync 00:22:31.691 12:50:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:31.691 12:50:04 -- nvmf/common.sh@119 -- # set +e 00:22:31.691 12:50:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:31.691 12:50:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:31.691 rmmod nvme_tcp 00:22:31.691 rmmod nvme_fabrics 00:22:31.691 rmmod nvme_keyring 00:22:31.691 12:50:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:31.691 12:50:04 -- nvmf/common.sh@123 -- # set -e 00:22:31.691 12:50:04 -- nvmf/common.sh@124 -- # return 0 00:22:31.691 12:50:04 -- nvmf/common.sh@477 -- # '[' -n 3598391 ']' 00:22:31.691 12:50:04 -- nvmf/common.sh@478 -- # killprocess 3598391 00:22:31.691 12:50:04 -- common/autotest_common.sh@936 -- # '[' -z 3598391 ']' 00:22:31.691 12:50:04 -- common/autotest_common.sh@940 -- # kill -0 3598391 00:22:31.691 12:50:04 -- common/autotest_common.sh@941 -- # uname 00:22:31.691 12:50:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:31.691 12:50:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3598391 00:22:31.691 12:50:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:31.692 12:50:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:31.692 12:50:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3598391' 00:22:31.692 killing process with pid 3598391 00:22:31.692 12:50:04 -- common/autotest_common.sh@955 -- # kill 3598391 00:22:31.692 [2024-11-20 12:50:04.687925] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:31.692 12:50:04 -- common/autotest_common.sh@960 -- # wait 3598391 00:22:31.950 12:50:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:31.950 12:50:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:31.950 12:50:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:31.950 12:50:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:31.950 12:50:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:31.950 12:50:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:31.950 12:50:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:31.950 12:50:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.489 12:50:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:34.489 00:22:34.489 real 0m6.180s 00:22:34.489 user 0m7.311s 00:22:34.489 sys 0m1.888s 00:22:34.489 12:50:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:34.489 12:50:07 -- common/autotest_common.sh@10 -- # set +x 00:22:34.489 ************************************ 00:22:34.489 END TEST nvmf_identify 00:22:34.489 ************************************ 00:22:34.489 12:50:07 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:34.489 12:50:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:34.489 12:50:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:34.489 12:50:07 -- common/autotest_common.sh@10 -- # set +x 00:22:34.489 ************************************ 00:22:34.489 START TEST nvmf_perf 00:22:34.489 ************************************ 00:22:34.489 12:50:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:34.489 * Looking for test storage... 00:22:34.489 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:34.489 12:50:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:34.490 12:50:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:34.490 12:50:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:34.490 12:50:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:34.490 12:50:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:34.490 12:50:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:34.490 12:50:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:34.490 12:50:07 -- scripts/common.sh@335 -- # IFS=.-: 00:22:34.490 12:50:07 -- scripts/common.sh@335 -- # read -ra ver1 00:22:34.490 12:50:07 -- scripts/common.sh@336 -- # IFS=.-: 00:22:34.490 12:50:07 -- scripts/common.sh@336 -- # read -ra ver2 00:22:34.490 12:50:07 -- scripts/common.sh@337 -- # local 'op=<' 00:22:34.490 12:50:07 -- scripts/common.sh@339 -- # ver1_l=2 00:22:34.490 12:50:07 -- scripts/common.sh@340 -- # ver2_l=1 00:22:34.490 12:50:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:34.490 12:50:07 -- scripts/common.sh@343 -- # case "$op" in 00:22:34.490 12:50:07 -- scripts/common.sh@344 -- # : 1 00:22:34.490 12:50:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:34.490 12:50:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:34.490 12:50:07 -- scripts/common.sh@364 -- # decimal 1 00:22:34.490 12:50:07 -- scripts/common.sh@352 -- # local d=1 00:22:34.490 12:50:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:34.490 12:50:07 -- scripts/common.sh@354 -- # echo 1 00:22:34.490 12:50:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:34.490 12:50:07 -- scripts/common.sh@365 -- # decimal 2 00:22:34.490 12:50:07 -- scripts/common.sh@352 -- # local d=2 00:22:34.490 12:50:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:34.490 12:50:07 -- scripts/common.sh@354 -- # echo 2 00:22:34.490 12:50:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:34.490 12:50:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:34.490 12:50:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:34.490 12:50:07 -- scripts/common.sh@367 -- # return 0 00:22:34.490 12:50:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:34.490 12:50:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:34.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.490 --rc genhtml_branch_coverage=1 00:22:34.490 --rc genhtml_function_coverage=1 00:22:34.490 --rc genhtml_legend=1 00:22:34.490 --rc geninfo_all_blocks=1 00:22:34.490 --rc geninfo_unexecuted_blocks=1 00:22:34.490 00:22:34.490 ' 00:22:34.490 12:50:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:34.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.490 --rc genhtml_branch_coverage=1 00:22:34.490 --rc genhtml_function_coverage=1 00:22:34.490 --rc genhtml_legend=1 00:22:34.490 --rc geninfo_all_blocks=1 00:22:34.490 --rc geninfo_unexecuted_blocks=1 00:22:34.490 00:22:34.490 ' 00:22:34.490 12:50:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:34.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.490 --rc genhtml_branch_coverage=1 00:22:34.490 --rc genhtml_function_coverage=1 00:22:34.490 --rc genhtml_legend=1 00:22:34.490 --rc geninfo_all_blocks=1 00:22:34.490 --rc geninfo_unexecuted_blocks=1 00:22:34.490 00:22:34.490 ' 00:22:34.490 12:50:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:34.490 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.490 --rc genhtml_branch_coverage=1 00:22:34.490 --rc genhtml_function_coverage=1 00:22:34.490 --rc genhtml_legend=1 00:22:34.490 --rc geninfo_all_blocks=1 00:22:34.490 --rc geninfo_unexecuted_blocks=1 00:22:34.490 00:22:34.490 ' 00:22:34.490 12:50:07 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:34.490 12:50:07 -- nvmf/common.sh@7 -- # uname -s 00:22:34.490 12:50:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:34.490 12:50:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:34.490 12:50:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:34.490 12:50:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:34.490 12:50:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:34.490 12:50:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:34.490 12:50:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:34.490 12:50:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:34.490 12:50:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:34.490 12:50:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:34.490 12:50:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:34.490 12:50:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:34.490 12:50:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:34.490 12:50:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:34.490 12:50:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:34.490 12:50:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:34.490 12:50:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:34.490 12:50:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:34.490 12:50:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:34.490 12:50:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.490 12:50:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.490 12:50:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.490 12:50:07 -- paths/export.sh@5 -- # export PATH 00:22:34.490 12:50:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.490 12:50:07 -- nvmf/common.sh@46 -- # : 0 00:22:34.490 12:50:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:34.490 12:50:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:34.490 12:50:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:34.490 12:50:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:34.490 12:50:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:34.490 12:50:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:34.490 12:50:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:34.490 12:50:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:34.490 12:50:07 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:34.490 12:50:07 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:34.490 12:50:07 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:34.490 12:50:07 -- host/perf.sh@17 -- # nvmftestinit 00:22:34.491 12:50:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:34.491 12:50:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:34.491 12:50:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:34.491 12:50:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:34.491 12:50:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:34.491 12:50:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.491 12:50:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.491 12:50:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.491 12:50:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:34.491 12:50:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:34.491 12:50:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:34.491 12:50:07 -- common/autotest_common.sh@10 -- # set +x 00:22:36.398 12:50:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:36.398 12:50:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:36.398 12:50:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:36.398 12:50:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:36.398 12:50:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:36.398 12:50:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:36.399 12:50:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:36.399 12:50:09 -- nvmf/common.sh@294 -- # net_devs=() 00:22:36.399 12:50:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:36.399 12:50:09 -- nvmf/common.sh@295 -- # e810=() 00:22:36.399 12:50:09 -- nvmf/common.sh@295 -- # local -ga e810 00:22:36.399 12:50:09 -- nvmf/common.sh@296 -- # x722=() 00:22:36.399 12:50:09 -- nvmf/common.sh@296 -- # local -ga x722 00:22:36.399 12:50:09 -- nvmf/common.sh@297 -- # mlx=() 00:22:36.399 12:50:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:36.399 12:50:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:36.399 12:50:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:36.399 12:50:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:36.399 12:50:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:36.399 12:50:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.399 12:50:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:36.399 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:36.399 12:50:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.399 12:50:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:36.399 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:36.399 12:50:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:36.399 12:50:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.399 12:50:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.399 12:50:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.399 12:50:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.399 12:50:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:36.399 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:36.399 12:50:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.399 12:50:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.399 12:50:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.399 12:50:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.399 12:50:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.399 12:50:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:36.399 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:36.399 12:50:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.399 12:50:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:36.399 12:50:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:36.399 12:50:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:36.399 12:50:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:36.399 12:50:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:36.399 12:50:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:36.399 12:50:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:36.399 12:50:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:36.399 12:50:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:36.399 12:50:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:36.399 12:50:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:36.399 12:50:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:36.399 12:50:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:36.399 12:50:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:36.399 12:50:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:36.399 12:50:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:36.399 12:50:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:36.399 12:50:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:36.399 12:50:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:36.399 12:50:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:36.399 12:50:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:36.399 12:50:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:36.399 12:50:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:36.399 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:36.399 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.185 ms 00:22:36.399 00:22:36.399 --- 10.0.0.2 ping statistics --- 00:22:36.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.399 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:22:36.399 12:50:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:36.399 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:36.399 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:22:36.399 00:22:36.399 --- 10.0.0.1 ping statistics --- 00:22:36.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.399 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:22:36.399 12:50:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:36.399 12:50:09 -- nvmf/common.sh@410 -- # return 0 00:22:36.399 12:50:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:36.399 12:50:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:36.399 12:50:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:36.399 12:50:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:36.399 12:50:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:36.399 12:50:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:36.399 12:50:09 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:36.399 12:50:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:36.399 12:50:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:36.399 12:50:09 -- common/autotest_common.sh@10 -- # set +x 00:22:36.399 12:50:09 -- nvmf/common.sh@469 -- # nvmfpid=3600617 00:22:36.399 12:50:09 -- nvmf/common.sh@470 -- # waitforlisten 3600617 00:22:36.399 12:50:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:36.399 12:50:09 -- common/autotest_common.sh@829 -- # '[' -z 3600617 ']' 00:22:36.399 12:50:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:36.399 12:50:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:36.399 12:50:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:36.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:36.399 12:50:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:36.399 12:50:09 -- common/autotest_common.sh@10 -- # set +x 00:22:36.399 [2024-11-20 12:50:09.292304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.399 [2024-11-20 12:50:09.292376] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:36.399 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.399 [2024-11-20 12:50:09.360234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:36.399 [2024-11-20 12:50:09.479447] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:36.399 [2024-11-20 12:50:09.479585] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:36.399 [2024-11-20 12:50:09.479602] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:36.399 [2024-11-20 12:50:09.479615] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:36.399 [2024-11-20 12:50:09.479683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.399 [2024-11-20 12:50:09.479713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:36.399 [2024-11-20 12:50:09.479761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:36.399 [2024-11-20 12:50:09.479763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.335 12:50:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:37.335 12:50:10 -- common/autotest_common.sh@862 -- # return 0 00:22:37.335 12:50:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:37.335 12:50:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:37.335 12:50:10 -- common/autotest_common.sh@10 -- # set +x 00:22:37.335 12:50:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:37.335 12:50:10 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:37.335 12:50:10 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:40.623 12:50:13 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:40.623 12:50:13 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:40.623 12:50:13 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:22:40.623 12:50:13 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:40.882 12:50:13 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:40.882 12:50:13 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:22:40.882 12:50:13 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:40.882 12:50:13 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:22:40.882 12:50:13 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:22:41.141 [2024-11-20 12:50:14.173909] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:41.141 12:50:14 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:41.399 12:50:14 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:41.399 12:50:14 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:41.657 12:50:14 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:41.657 12:50:14 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:41.915 12:50:14 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:42.173 [2024-11-20 12:50:15.197816] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:42.173 12:50:15 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:42.431 12:50:15 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:22:42.431 12:50:15 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:42.431 12:50:15 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:22:42.431 12:50:15 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:43.812 Initializing NVMe Controllers 00:22:43.812 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:22:43.812 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:22:43.812 Initialization complete. Launching workers. 00:22:43.812 ======================================================== 00:22:43.812 Latency(us) 00:22:43.812 Device Information : IOPS MiB/s Average min max 00:22:43.812 PCIE (0000:88:00.0) NSID 1 from core 0: 86312.24 337.16 370.05 43.73 7278.23 00:22:43.812 ======================================================== 00:22:43.812 Total : 86312.24 337.16 370.05 43.73 7278.23 00:22:43.812 00:22:43.812 12:50:16 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:43.812 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.191 Initializing NVMe Controllers 00:22:45.191 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:45.191 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:45.191 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:45.191 Initialization complete. Launching workers. 00:22:45.191 ======================================================== 00:22:45.191 Latency(us) 00:22:45.191 Device Information : IOPS MiB/s Average min max 00:22:45.191 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 99.00 0.39 10430.25 145.39 44766.71 00:22:45.191 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 46.00 0.18 22769.41 7955.76 50856.78 00:22:45.191 ======================================================== 00:22:45.191 Total : 145.00 0.57 14344.74 145.39 50856.78 00:22:45.191 00:22:45.191 12:50:18 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:45.191 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.094 Initializing NVMe Controllers 00:22:47.094 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:47.094 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:47.094 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:47.094 Initialization complete. Launching workers. 00:22:47.094 ======================================================== 00:22:47.094 Latency(us) 00:22:47.094 Device Information : IOPS MiB/s Average min max 00:22:47.094 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8787.00 34.32 3658.86 556.00 8754.97 00:22:47.094 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3891.00 15.20 8261.31 5983.26 16328.91 00:22:47.094 ======================================================== 00:22:47.094 Total : 12678.00 49.52 5071.40 556.00 16328.91 00:22:47.094 00:22:47.094 12:50:19 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:22:47.094 12:50:19 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:22:47.094 12:50:19 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:47.094 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.627 Initializing NVMe Controllers 00:22:49.627 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:49.627 Controller IO queue size 128, less than required. 00:22:49.627 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:49.627 Controller IO queue size 128, less than required. 00:22:49.627 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:49.627 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:49.627 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:49.627 Initialization complete. Launching workers. 00:22:49.627 ======================================================== 00:22:49.627 Latency(us) 00:22:49.627 Device Information : IOPS MiB/s Average min max 00:22:49.627 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1513.99 378.50 86356.03 62924.64 151956.14 00:22:49.627 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 581.50 145.37 227789.61 85704.27 333412.42 00:22:49.627 ======================================================== 00:22:49.627 Total : 2095.49 523.87 125603.77 62924.64 333412.42 00:22:49.627 00:22:49.627 12:50:22 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:22:49.627 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.627 No valid NVMe controllers or AIO or URING devices found 00:22:49.627 Initializing NVMe Controllers 00:22:49.627 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:49.627 Controller IO queue size 128, less than required. 00:22:49.627 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:49.627 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:22:49.627 Controller IO queue size 128, less than required. 00:22:49.627 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:49.627 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:22:49.627 WARNING: Some requested NVMe devices were skipped 00:22:49.627 12:50:22 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:22:49.627 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.163 Initializing NVMe Controllers 00:22:52.163 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:52.163 Controller IO queue size 128, less than required. 00:22:52.163 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:52.163 Controller IO queue size 128, less than required. 00:22:52.163 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:52.163 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:52.163 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:52.163 Initialization complete. Launching workers. 00:22:52.163 00:22:52.163 ==================== 00:22:52.163 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:22:52.163 TCP transport: 00:22:52.163 polls: 11719 00:22:52.163 idle_polls: 8727 00:22:52.163 sock_completions: 2992 00:22:52.163 nvme_completions: 4940 00:22:52.163 submitted_requests: 7610 00:22:52.163 queued_requests: 1 00:22:52.163 00:22:52.163 ==================== 00:22:52.163 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:22:52.163 TCP transport: 00:22:52.163 polls: 10053 00:22:52.163 idle_polls: 6167 00:22:52.163 sock_completions: 3886 00:22:52.163 nvme_completions: 6097 00:22:52.163 submitted_requests: 9205 00:22:52.163 queued_requests: 1 00:22:52.163 ======================================================== 00:22:52.163 Latency(us) 00:22:52.163 Device Information : IOPS MiB/s Average min max 00:22:52.163 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1298.34 324.59 99763.39 59033.99 159190.85 00:22:52.163 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1587.81 396.95 81722.41 38833.68 115049.91 00:22:52.163 ======================================================== 00:22:52.163 Total : 2886.16 721.54 89838.20 38833.68 159190.85 00:22:52.163 00:22:52.163 12:50:25 -- host/perf.sh@66 -- # sync 00:22:52.163 12:50:25 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:52.422 12:50:25 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:22:52.422 12:50:25 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:22:52.422 12:50:25 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:22:55.711 12:50:28 -- host/perf.sh@72 -- # ls_guid=2d241e1d-9d65-4273-8490-d4383042cad0 00:22:55.711 12:50:28 -- host/perf.sh@73 -- # get_lvs_free_mb 2d241e1d-9d65-4273-8490-d4383042cad0 00:22:55.711 12:50:28 -- common/autotest_common.sh@1353 -- # local lvs_uuid=2d241e1d-9d65-4273-8490-d4383042cad0 00:22:55.711 12:50:28 -- common/autotest_common.sh@1354 -- # local lvs_info 00:22:55.711 12:50:28 -- common/autotest_common.sh@1355 -- # local fc 00:22:55.711 12:50:28 -- common/autotest_common.sh@1356 -- # local cs 00:22:55.711 12:50:28 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:22:55.968 12:50:29 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:22:55.968 { 00:22:55.968 "uuid": "2d241e1d-9d65-4273-8490-d4383042cad0", 00:22:55.968 "name": "lvs_0", 00:22:55.968 "base_bdev": "Nvme0n1", 00:22:55.968 "total_data_clusters": 238234, 00:22:55.968 "free_clusters": 238234, 00:22:55.968 "block_size": 512, 00:22:55.968 "cluster_size": 4194304 00:22:55.968 } 00:22:55.968 ]' 00:22:55.968 12:50:29 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="2d241e1d-9d65-4273-8490-d4383042cad0") .free_clusters' 00:22:55.968 12:50:29 -- common/autotest_common.sh@1358 -- # fc=238234 00:22:55.968 12:50:29 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="2d241e1d-9d65-4273-8490-d4383042cad0") .cluster_size' 00:22:56.236 12:50:29 -- common/autotest_common.sh@1359 -- # cs=4194304 00:22:56.236 12:50:29 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:22:56.236 12:50:29 -- common/autotest_common.sh@1363 -- # echo 952936 00:22:56.236 952936 00:22:56.236 12:50:29 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:22:56.236 12:50:29 -- host/perf.sh@78 -- # free_mb=20480 00:22:56.236 12:50:29 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 2d241e1d-9d65-4273-8490-d4383042cad0 lbd_0 20480 00:22:56.236 12:50:29 -- host/perf.sh@80 -- # lb_guid=f187fd96-b7c7-4688-9241-e3e29e4daf8e 00:22:56.236 12:50:29 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore f187fd96-b7c7-4688-9241-e3e29e4daf8e lvs_n_0 00:22:57.171 12:50:30 -- host/perf.sh@83 -- # ls_nested_guid=4bd15fdf-2c16-49af-8d75-e642d43bb446 00:22:57.171 12:50:30 -- host/perf.sh@84 -- # get_lvs_free_mb 4bd15fdf-2c16-49af-8d75-e642d43bb446 00:22:57.171 12:50:30 -- common/autotest_common.sh@1353 -- # local lvs_uuid=4bd15fdf-2c16-49af-8d75-e642d43bb446 00:22:57.171 12:50:30 -- common/autotest_common.sh@1354 -- # local lvs_info 00:22:57.436 12:50:30 -- common/autotest_common.sh@1355 -- # local fc 00:22:57.436 12:50:30 -- common/autotest_common.sh@1356 -- # local cs 00:22:57.436 12:50:30 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:22:57.436 12:50:30 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:22:57.436 { 00:22:57.436 "uuid": "2d241e1d-9d65-4273-8490-d4383042cad0", 00:22:57.436 "name": "lvs_0", 00:22:57.436 "base_bdev": "Nvme0n1", 00:22:57.436 "total_data_clusters": 238234, 00:22:57.436 "free_clusters": 233114, 00:22:57.436 "block_size": 512, 00:22:57.436 "cluster_size": 4194304 00:22:57.436 }, 00:22:57.436 { 00:22:57.436 "uuid": "4bd15fdf-2c16-49af-8d75-e642d43bb446", 00:22:57.436 "name": "lvs_n_0", 00:22:57.436 "base_bdev": "f187fd96-b7c7-4688-9241-e3e29e4daf8e", 00:22:57.436 "total_data_clusters": 5114, 00:22:57.436 "free_clusters": 5114, 00:22:57.436 "block_size": 512, 00:22:57.436 "cluster_size": 4194304 00:22:57.436 } 00:22:57.436 ]' 00:22:57.436 12:50:30 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="4bd15fdf-2c16-49af-8d75-e642d43bb446") .free_clusters' 00:22:57.750 12:50:30 -- common/autotest_common.sh@1358 -- # fc=5114 00:22:57.750 12:50:30 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="4bd15fdf-2c16-49af-8d75-e642d43bb446") .cluster_size' 00:22:57.750 12:50:30 -- common/autotest_common.sh@1359 -- # cs=4194304 00:22:57.750 12:50:30 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:22:57.750 12:50:30 -- common/autotest_common.sh@1363 -- # echo 20456 00:22:57.750 20456 00:22:57.750 12:50:30 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:22:57.750 12:50:30 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4bd15fdf-2c16-49af-8d75-e642d43bb446 lbd_nest_0 20456 00:22:58.037 12:50:30 -- host/perf.sh@88 -- # lb_nested_guid=92c3f69f-821e-4d32-9905-2afd8815db46 00:22:58.037 12:50:30 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:58.037 12:50:31 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:22:58.037 12:50:31 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 92c3f69f-821e-4d32-9905-2afd8815db46 00:22:58.293 12:50:31 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:58.551 12:50:31 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:22:58.551 12:50:31 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:22:58.551 12:50:31 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:22:58.551 12:50:31 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:22:58.551 12:50:31 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:58.551 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.778 Initializing NVMe Controllers 00:23:10.778 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.778 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:10.778 Initialization complete. Launching workers. 00:23:10.778 ======================================================== 00:23:10.778 Latency(us) 00:23:10.778 Device Information : IOPS MiB/s Average min max 00:23:10.778 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 47.19 0.02 21191.56 170.96 46019.04 00:23:10.778 ======================================================== 00:23:10.778 Total : 47.19 0.02 21191.56 170.96 46019.04 00:23:10.778 00:23:10.778 12:50:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:10.778 12:50:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:10.778 EAL: No free 2048 kB hugepages reported on node 1 00:23:20.754 Initializing NVMe Controllers 00:23:20.754 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:20.754 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:20.754 Initialization complete. Launching workers. 00:23:20.754 ======================================================== 00:23:20.754 Latency(us) 00:23:20.754 Device Information : IOPS MiB/s Average min max 00:23:20.754 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 79.10 9.89 12648.69 4977.14 47897.69 00:23:20.754 ======================================================== 00:23:20.754 Total : 79.10 9.89 12648.69 4977.14 47897.69 00:23:20.754 00:23:20.754 12:50:52 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:20.754 12:50:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:20.754 12:50:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:20.754 EAL: No free 2048 kB hugepages reported on node 1 00:23:30.734 Initializing NVMe Controllers 00:23:30.734 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:30.734 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:30.734 Initialization complete. Launching workers. 00:23:30.734 ======================================================== 00:23:30.734 Latency(us) 00:23:30.734 Device Information : IOPS MiB/s Average min max 00:23:30.735 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7774.07 3.80 4115.82 268.21 12050.06 00:23:30.735 ======================================================== 00:23:30.735 Total : 7774.07 3.80 4115.82 268.21 12050.06 00:23:30.735 00:23:30.735 12:51:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:30.735 12:51:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:30.735 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.715 Initializing NVMe Controllers 00:23:40.715 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:40.715 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:40.715 Initialization complete. Launching workers. 00:23:40.715 ======================================================== 00:23:40.715 Latency(us) 00:23:40.715 Device Information : IOPS MiB/s Average min max 00:23:40.715 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3924.61 490.58 8155.54 783.36 18903.44 00:23:40.715 ======================================================== 00:23:40.715 Total : 3924.61 490.58 8155.54 783.36 18903.44 00:23:40.715 00:23:40.715 12:51:12 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:40.715 12:51:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:40.715 12:51:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:40.715 EAL: No free 2048 kB hugepages reported on node 1 00:23:50.717 Initializing NVMe Controllers 00:23:50.717 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:50.717 Controller IO queue size 128, less than required. 00:23:50.717 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:50.717 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:50.717 Initialization complete. Launching workers. 00:23:50.717 ======================================================== 00:23:50.717 Latency(us) 00:23:50.717 Device Information : IOPS MiB/s Average min max 00:23:50.717 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12007.18 5.86 10664.75 1776.59 29064.59 00:23:50.717 ======================================================== 00:23:50.717 Total : 12007.18 5.86 10664.75 1776.59 29064.59 00:23:50.717 00:23:50.717 12:51:23 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:50.717 12:51:23 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:50.717 EAL: No free 2048 kB hugepages reported on node 1 00:24:00.697 Initializing NVMe Controllers 00:24:00.697 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:00.697 Controller IO queue size 128, less than required. 00:24:00.697 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:00.697 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:00.697 Initialization complete. Launching workers. 00:24:00.697 ======================================================== 00:24:00.697 Latency(us) 00:24:00.697 Device Information : IOPS MiB/s Average min max 00:24:00.697 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1190.61 148.83 107857.59 15563.51 238955.29 00:24:00.697 ======================================================== 00:24:00.697 Total : 1190.61 148.83 107857.59 15563.51 238955.29 00:24:00.697 00:24:00.697 12:51:33 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:00.955 12:51:33 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 92c3f69f-821e-4d32-9905-2afd8815db46 00:24:01.521 12:51:34 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:01.780 12:51:34 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f187fd96-b7c7-4688-9241-e3e29e4daf8e 00:24:02.346 12:51:35 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:02.347 12:51:35 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:02.347 12:51:35 -- host/perf.sh@114 -- # nvmftestfini 00:24:02.347 12:51:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:02.347 12:51:35 -- nvmf/common.sh@116 -- # sync 00:24:02.347 12:51:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:02.347 12:51:35 -- nvmf/common.sh@119 -- # set +e 00:24:02.347 12:51:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:02.347 12:51:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:02.347 rmmod nvme_tcp 00:24:02.347 rmmod nvme_fabrics 00:24:02.607 rmmod nvme_keyring 00:24:02.607 12:51:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:02.607 12:51:35 -- nvmf/common.sh@123 -- # set -e 00:24:02.607 12:51:35 -- nvmf/common.sh@124 -- # return 0 00:24:02.607 12:51:35 -- nvmf/common.sh@477 -- # '[' -n 3600617 ']' 00:24:02.607 12:51:35 -- nvmf/common.sh@478 -- # killprocess 3600617 00:24:02.607 12:51:35 -- common/autotest_common.sh@936 -- # '[' -z 3600617 ']' 00:24:02.607 12:51:35 -- common/autotest_common.sh@940 -- # kill -0 3600617 00:24:02.607 12:51:35 -- common/autotest_common.sh@941 -- # uname 00:24:02.607 12:51:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:02.607 12:51:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3600617 00:24:02.607 12:51:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:02.607 12:51:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:02.607 12:51:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3600617' 00:24:02.607 killing process with pid 3600617 00:24:02.607 12:51:35 -- common/autotest_common.sh@955 -- # kill 3600617 00:24:02.607 12:51:35 -- common/autotest_common.sh@960 -- # wait 3600617 00:24:04.512 12:51:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:04.512 12:51:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:04.512 12:51:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:04.512 12:51:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:04.512 12:51:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:04.512 12:51:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:04.512 12:51:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:04.512 12:51:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:06.416 12:51:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:06.416 00:24:06.416 real 1m32.197s 00:24:06.416 user 5m38.522s 00:24:06.416 sys 0m16.440s 00:24:06.416 12:51:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:06.416 12:51:39 -- common/autotest_common.sh@10 -- # set +x 00:24:06.416 ************************************ 00:24:06.416 END TEST nvmf_perf 00:24:06.416 ************************************ 00:24:06.416 12:51:39 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:06.416 12:51:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:06.416 12:51:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:06.417 12:51:39 -- common/autotest_common.sh@10 -- # set +x 00:24:06.417 ************************************ 00:24:06.417 START TEST nvmf_fio_host 00:24:06.417 ************************************ 00:24:06.417 12:51:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:06.417 * Looking for test storage... 00:24:06.417 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:06.417 12:51:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:06.417 12:51:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:06.417 12:51:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:06.417 12:51:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:06.417 12:51:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:06.417 12:51:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:06.417 12:51:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:06.417 12:51:39 -- scripts/common.sh@335 -- # IFS=.-: 00:24:06.417 12:51:39 -- scripts/common.sh@335 -- # read -ra ver1 00:24:06.417 12:51:39 -- scripts/common.sh@336 -- # IFS=.-: 00:24:06.417 12:51:39 -- scripts/common.sh@336 -- # read -ra ver2 00:24:06.417 12:51:39 -- scripts/common.sh@337 -- # local 'op=<' 00:24:06.417 12:51:39 -- scripts/common.sh@339 -- # ver1_l=2 00:24:06.417 12:51:39 -- scripts/common.sh@340 -- # ver2_l=1 00:24:06.417 12:51:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:06.417 12:51:39 -- scripts/common.sh@343 -- # case "$op" in 00:24:06.417 12:51:39 -- scripts/common.sh@344 -- # : 1 00:24:06.417 12:51:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:06.417 12:51:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:06.417 12:51:39 -- scripts/common.sh@364 -- # decimal 1 00:24:06.417 12:51:39 -- scripts/common.sh@352 -- # local d=1 00:24:06.417 12:51:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:06.417 12:51:39 -- scripts/common.sh@354 -- # echo 1 00:24:06.417 12:51:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:06.417 12:51:39 -- scripts/common.sh@365 -- # decimal 2 00:24:06.417 12:51:39 -- scripts/common.sh@352 -- # local d=2 00:24:06.417 12:51:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:06.417 12:51:39 -- scripts/common.sh@354 -- # echo 2 00:24:06.417 12:51:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:06.417 12:51:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:06.417 12:51:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:06.417 12:51:39 -- scripts/common.sh@367 -- # return 0 00:24:06.417 12:51:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:06.417 12:51:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:06.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.417 --rc genhtml_branch_coverage=1 00:24:06.417 --rc genhtml_function_coverage=1 00:24:06.417 --rc genhtml_legend=1 00:24:06.417 --rc geninfo_all_blocks=1 00:24:06.417 --rc geninfo_unexecuted_blocks=1 00:24:06.417 00:24:06.417 ' 00:24:06.417 12:51:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:06.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.417 --rc genhtml_branch_coverage=1 00:24:06.417 --rc genhtml_function_coverage=1 00:24:06.417 --rc genhtml_legend=1 00:24:06.417 --rc geninfo_all_blocks=1 00:24:06.417 --rc geninfo_unexecuted_blocks=1 00:24:06.417 00:24:06.417 ' 00:24:06.417 12:51:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:06.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.417 --rc genhtml_branch_coverage=1 00:24:06.417 --rc genhtml_function_coverage=1 00:24:06.417 --rc genhtml_legend=1 00:24:06.417 --rc geninfo_all_blocks=1 00:24:06.417 --rc geninfo_unexecuted_blocks=1 00:24:06.417 00:24:06.417 ' 00:24:06.417 12:51:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:06.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.417 --rc genhtml_branch_coverage=1 00:24:06.417 --rc genhtml_function_coverage=1 00:24:06.417 --rc genhtml_legend=1 00:24:06.417 --rc geninfo_all_blocks=1 00:24:06.417 --rc geninfo_unexecuted_blocks=1 00:24:06.417 00:24:06.417 ' 00:24:06.417 12:51:39 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:06.417 12:51:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:06.417 12:51:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:06.417 12:51:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:06.417 12:51:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.417 12:51:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.417 12:51:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.417 12:51:39 -- paths/export.sh@5 -- # export PATH 00:24:06.417 12:51:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.417 12:51:39 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:06.417 12:51:39 -- nvmf/common.sh@7 -- # uname -s 00:24:06.417 12:51:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:06.417 12:51:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:06.417 12:51:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:06.417 12:51:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:06.417 12:51:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:06.417 12:51:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:06.417 12:51:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:06.417 12:51:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:06.417 12:51:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:06.417 12:51:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:06.417 12:51:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:06.417 12:51:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:06.417 12:51:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:06.417 12:51:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:06.417 12:51:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:06.417 12:51:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:06.417 12:51:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:06.417 12:51:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:06.417 12:51:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:06.417 12:51:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.417 12:51:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.418 12:51:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.418 12:51:39 -- paths/export.sh@5 -- # export PATH 00:24:06.418 12:51:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.418 12:51:39 -- nvmf/common.sh@46 -- # : 0 00:24:06.418 12:51:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:06.418 12:51:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:06.418 12:51:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:06.418 12:51:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:06.418 12:51:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:06.418 12:51:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:06.418 12:51:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:06.418 12:51:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:06.418 12:51:39 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:06.418 12:51:39 -- host/fio.sh@14 -- # nvmftestinit 00:24:06.418 12:51:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:06.418 12:51:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:06.418 12:51:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:06.418 12:51:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:06.418 12:51:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:06.418 12:51:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:06.418 12:51:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:06.418 12:51:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:06.418 12:51:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:06.418 12:51:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:06.418 12:51:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:06.418 12:51:39 -- common/autotest_common.sh@10 -- # set +x 00:24:08.325 12:51:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:08.325 12:51:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:08.325 12:51:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:08.325 12:51:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:08.325 12:51:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:08.325 12:51:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:08.325 12:51:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:08.325 12:51:41 -- nvmf/common.sh@294 -- # net_devs=() 00:24:08.325 12:51:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:08.325 12:51:41 -- nvmf/common.sh@295 -- # e810=() 00:24:08.325 12:51:41 -- nvmf/common.sh@295 -- # local -ga e810 00:24:08.325 12:51:41 -- nvmf/common.sh@296 -- # x722=() 00:24:08.325 12:51:41 -- nvmf/common.sh@296 -- # local -ga x722 00:24:08.325 12:51:41 -- nvmf/common.sh@297 -- # mlx=() 00:24:08.325 12:51:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:08.325 12:51:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:08.325 12:51:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:08.325 12:51:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:08.325 12:51:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:08.325 12:51:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:08.325 12:51:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:08.325 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:08.325 12:51:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:08.325 12:51:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:08.325 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:08.325 12:51:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:08.325 12:51:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:08.325 12:51:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.325 12:51:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:08.325 12:51:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.325 12:51:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:08.325 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:08.325 12:51:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.325 12:51:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:08.325 12:51:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.325 12:51:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:08.325 12:51:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.325 12:51:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:08.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:08.325 12:51:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.325 12:51:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:08.325 12:51:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:08.325 12:51:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:08.325 12:51:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:08.325 12:51:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:08.325 12:51:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:08.325 12:51:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:08.325 12:51:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:08.325 12:51:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:08.325 12:51:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:08.325 12:51:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:08.325 12:51:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:08.325 12:51:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:08.325 12:51:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:08.325 12:51:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:08.325 12:51:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:08.325 12:51:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:08.325 12:51:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:08.325 12:51:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:08.325 12:51:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:08.325 12:51:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:08.326 12:51:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:08.326 12:51:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:08.584 12:51:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:08.584 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:08.584 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:24:08.584 00:24:08.584 --- 10.0.0.2 ping statistics --- 00:24:08.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:08.584 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:24:08.584 12:51:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:08.584 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:08.584 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:24:08.584 00:24:08.584 --- 10.0.0.1 ping statistics --- 00:24:08.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:08.584 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:24:08.584 12:51:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:08.584 12:51:41 -- nvmf/common.sh@410 -- # return 0 00:24:08.584 12:51:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:08.584 12:51:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:08.584 12:51:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:08.584 12:51:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:08.584 12:51:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:08.584 12:51:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:08.584 12:51:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:08.584 12:51:41 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:08.584 12:51:41 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:08.584 12:51:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:08.584 12:51:41 -- common/autotest_common.sh@10 -- # set +x 00:24:08.584 12:51:41 -- host/fio.sh@24 -- # nvmfpid=3613679 00:24:08.584 12:51:41 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:08.584 12:51:41 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:08.584 12:51:41 -- host/fio.sh@28 -- # waitforlisten 3613679 00:24:08.584 12:51:41 -- common/autotest_common.sh@829 -- # '[' -z 3613679 ']' 00:24:08.584 12:51:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:08.584 12:51:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:08.584 12:51:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:08.584 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:08.584 12:51:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:08.584 12:51:41 -- common/autotest_common.sh@10 -- # set +x 00:24:08.584 [2024-11-20 12:51:41.504207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:08.584 [2024-11-20 12:51:41.504275] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:08.584 EAL: No free 2048 kB hugepages reported on node 1 00:24:08.584 [2024-11-20 12:51:41.566801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:08.584 [2024-11-20 12:51:41.673812] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:08.584 [2024-11-20 12:51:41.673964] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:08.584 [2024-11-20 12:51:41.673996] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:08.584 [2024-11-20 12:51:41.674009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:08.584 [2024-11-20 12:51:41.674101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:08.584 [2024-11-20 12:51:41.674139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:08.584 [2024-11-20 12:51:41.674191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:08.584 [2024-11-20 12:51:41.674193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:09.520 12:51:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:09.520 12:51:42 -- common/autotest_common.sh@862 -- # return 0 00:24:09.520 12:51:42 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:09.779 [2024-11-20 12:51:42.760580] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:09.779 12:51:42 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:09.779 12:51:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:09.779 12:51:42 -- common/autotest_common.sh@10 -- # set +x 00:24:09.779 12:51:42 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:10.037 Malloc1 00:24:10.037 12:51:43 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:10.295 12:51:43 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:10.552 12:51:43 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:10.846 [2024-11-20 12:51:43.843376] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:10.846 12:51:43 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:11.129 12:51:44 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:11.129 12:51:44 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:11.129 12:51:44 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:11.129 12:51:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:11.129 12:51:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:11.129 12:51:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:11.129 12:51:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:11.129 12:51:44 -- common/autotest_common.sh@1330 -- # shift 00:24:11.129 12:51:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:11.129 12:51:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:11.129 12:51:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:11.129 12:51:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:11.129 12:51:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:11.129 12:51:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:11.129 12:51:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:11.129 12:51:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:11.130 12:51:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:11.130 12:51:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:11.130 12:51:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:11.130 12:51:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:11.130 12:51:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:11.130 12:51:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:11.130 12:51:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:11.388 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:11.388 fio-3.35 00:24:11.388 Starting 1 thread 00:24:11.388 EAL: No free 2048 kB hugepages reported on node 1 00:24:13.921 00:24:13.921 test: (groupid=0, jobs=1): err= 0: pid=3614177: Wed Nov 20 12:51:46 2024 00:24:13.921 read: IOPS=9731, BW=38.0MiB/s (39.9MB/s)(76.3MiB/2006msec) 00:24:13.921 slat (nsec): min=1794, max=132445, avg=2342.25, stdev=1539.00 00:24:13.921 clat (usec): min=2390, max=12417, avg=7259.17, stdev=536.87 00:24:13.921 lat (usec): min=2416, max=12419, avg=7261.51, stdev=536.77 00:24:13.921 clat percentiles (usec): 00:24:13.921 | 1.00th=[ 6063], 5.00th=[ 6456], 10.00th=[ 6587], 20.00th=[ 6849], 00:24:13.921 | 30.00th=[ 6980], 40.00th=[ 7111], 50.00th=[ 7242], 60.00th=[ 7373], 00:24:13.921 | 70.00th=[ 7504], 80.00th=[ 7701], 90.00th=[ 7898], 95.00th=[ 8094], 00:24:13.921 | 99.00th=[ 8455], 99.50th=[ 8586], 99.90th=[10945], 99.95th=[11731], 00:24:13.921 | 99.99th=[12387] 00:24:13.921 bw ( KiB/s): min=37984, max=39528, per=99.95%, avg=38906.00, stdev=701.58, samples=4 00:24:13.921 iops : min= 9496, max= 9882, avg=9726.50, stdev=175.40, samples=4 00:24:13.921 write: IOPS=9739, BW=38.0MiB/s (39.9MB/s)(76.3MiB/2006msec); 0 zone resets 00:24:13.921 slat (nsec): min=1932, max=141106, avg=2478.14, stdev=1467.01 00:24:13.921 clat (usec): min=1351, max=11058, avg=5830.77, stdev=467.37 00:24:13.921 lat (usec): min=1359, max=11060, avg=5833.25, stdev=467.32 00:24:13.921 clat percentiles (usec): 00:24:13.921 | 1.00th=[ 4752], 5.00th=[ 5145], 10.00th=[ 5276], 20.00th=[ 5473], 00:24:13.921 | 30.00th=[ 5604], 40.00th=[ 5735], 50.00th=[ 5866], 60.00th=[ 5932], 00:24:13.921 | 70.00th=[ 6063], 80.00th=[ 6194], 90.00th=[ 6325], 95.00th=[ 6521], 00:24:13.921 | 99.00th=[ 6783], 99.50th=[ 6980], 99.90th=[ 9241], 99.95th=[10683], 00:24:13.921 | 99.99th=[10945] 00:24:13.921 bw ( KiB/s): min=38608, max=39408, per=100.00%, avg=38960.00, stdev=335.36, samples=4 00:24:13.921 iops : min= 9652, max= 9852, avg=9740.00, stdev=83.84, samples=4 00:24:13.921 lat (msec) : 2=0.03%, 4=0.10%, 10=99.76%, 20=0.11% 00:24:13.921 cpu : usr=61.70%, sys=35.61%, ctx=68, majf=0, minf=37 00:24:13.922 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:13.922 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:13.922 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:13.922 issued rwts: total=19522,19538,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:13.922 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:13.922 00:24:13.922 Run status group 0 (all jobs): 00:24:13.922 READ: bw=38.0MiB/s (39.9MB/s), 38.0MiB/s-38.0MiB/s (39.9MB/s-39.9MB/s), io=76.3MiB (80.0MB), run=2006-2006msec 00:24:13.922 WRITE: bw=38.0MiB/s (39.9MB/s), 38.0MiB/s-38.0MiB/s (39.9MB/s-39.9MB/s), io=76.3MiB (80.0MB), run=2006-2006msec 00:24:13.922 12:51:46 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:13.922 12:51:46 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:13.922 12:51:46 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:13.922 12:51:46 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:13.922 12:51:46 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:13.922 12:51:46 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:13.922 12:51:46 -- common/autotest_common.sh@1330 -- # shift 00:24:13.922 12:51:46 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:13.922 12:51:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:13.922 12:51:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:13.922 12:51:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:13.922 12:51:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:13.922 12:51:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:13.922 12:51:46 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:13.922 12:51:46 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:13.922 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:13.922 fio-3.35 00:24:13.922 Starting 1 thread 00:24:13.922 EAL: No free 2048 kB hugepages reported on node 1 00:24:16.451 00:24:16.451 test: (groupid=0, jobs=1): err= 0: pid=3614526: Wed Nov 20 12:51:49 2024 00:24:16.451 read: IOPS=8563, BW=134MiB/s (140MB/s)(268MiB/2005msec) 00:24:16.451 slat (nsec): min=2709, max=91401, avg=3576.14, stdev=1668.90 00:24:16.451 clat (usec): min=2391, max=52070, avg=8662.35, stdev=3178.68 00:24:16.451 lat (usec): min=2394, max=52073, avg=8665.92, stdev=3178.67 00:24:16.451 clat percentiles (usec): 00:24:16.451 | 1.00th=[ 4555], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 6718], 00:24:16.451 | 30.00th=[ 7373], 40.00th=[ 7963], 50.00th=[ 8455], 60.00th=[ 8979], 00:24:16.451 | 70.00th=[ 9503], 80.00th=[10159], 90.00th=[11076], 95.00th=[12125], 00:24:16.451 | 99.00th=[14353], 99.50th=[15270], 99.90th=[50070], 99.95th=[50594], 00:24:16.451 | 99.99th=[52167] 00:24:16.451 bw ( KiB/s): min=61792, max=79168, per=51.33%, avg=70328.00, stdev=9644.60, samples=4 00:24:16.451 iops : min= 3862, max= 4948, avg=4395.50, stdev=602.79, samples=4 00:24:16.451 write: IOPS=5079, BW=79.4MiB/s (83.2MB/s)(144MiB/1813msec); 0 zone resets 00:24:16.451 slat (usec): min=30, max=186, avg=33.34, stdev= 5.18 00:24:16.451 clat (usec): min=6439, max=53819, avg=11009.87, stdev=3807.08 00:24:16.451 lat (usec): min=6471, max=53851, avg=11043.21, stdev=3807.01 00:24:16.451 clat percentiles (usec): 00:24:16.451 | 1.00th=[ 7308], 5.00th=[ 8029], 10.00th=[ 8455], 20.00th=[ 9110], 00:24:16.451 | 30.00th=[ 9634], 40.00th=[10028], 50.00th=[10421], 60.00th=[10945], 00:24:16.451 | 70.00th=[11600], 80.00th=[12387], 90.00th=[13698], 95.00th=[14484], 00:24:16.451 | 99.00th=[16319], 99.50th=[49546], 99.90th=[53216], 99.95th=[53740], 00:24:16.451 | 99.99th=[53740] 00:24:16.451 bw ( KiB/s): min=65472, max=81952, per=90.34%, avg=73432.00, stdev=9114.27, samples=4 00:24:16.451 iops : min= 4092, max= 5122, avg=4589.50, stdev=569.64, samples=4 00:24:16.451 lat (msec) : 4=0.19%, 10=64.07%, 20=35.25%, 50=0.24%, 100=0.24% 00:24:16.451 cpu : usr=77.69%, sys=20.51%, ctx=35, majf=0, minf=64 00:24:16.451 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:16.451 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:16.451 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:16.451 issued rwts: total=17169,9210,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:16.451 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:16.451 00:24:16.451 Run status group 0 (all jobs): 00:24:16.451 READ: bw=134MiB/s (140MB/s), 134MiB/s-134MiB/s (140MB/s-140MB/s), io=268MiB (281MB), run=2005-2005msec 00:24:16.451 WRITE: bw=79.4MiB/s (83.2MB/s), 79.4MiB/s-79.4MiB/s (83.2MB/s-83.2MB/s), io=144MiB (151MB), run=1813-1813msec 00:24:16.451 12:51:49 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:16.451 12:51:49 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:16.451 12:51:49 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:16.451 12:51:49 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:16.451 12:51:49 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:16.451 12:51:49 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:16.451 12:51:49 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:16.451 12:51:49 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:16.451 12:51:49 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:16.710 12:51:49 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:16.710 12:51:49 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:16.710 12:51:49 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:19.998 Nvme0n1 00:24:19.998 12:51:52 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:22.533 12:51:55 -- host/fio.sh@53 -- # ls_guid=cce2aec9-b6ea-4c32-96f1-0ec740154cc0 00:24:22.533 12:51:55 -- host/fio.sh@54 -- # get_lvs_free_mb cce2aec9-b6ea-4c32-96f1-0ec740154cc0 00:24:22.533 12:51:55 -- common/autotest_common.sh@1353 -- # local lvs_uuid=cce2aec9-b6ea-4c32-96f1-0ec740154cc0 00:24:22.533 12:51:55 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:22.533 12:51:55 -- common/autotest_common.sh@1355 -- # local fc 00:24:22.533 12:51:55 -- common/autotest_common.sh@1356 -- # local cs 00:24:22.533 12:51:55 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:22.791 12:51:55 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:22.791 { 00:24:22.791 "uuid": "cce2aec9-b6ea-4c32-96f1-0ec740154cc0", 00:24:22.791 "name": "lvs_0", 00:24:22.791 "base_bdev": "Nvme0n1", 00:24:22.791 "total_data_clusters": 930, 00:24:22.791 "free_clusters": 930, 00:24:22.791 "block_size": 512, 00:24:22.791 "cluster_size": 1073741824 00:24:22.791 } 00:24:22.791 ]' 00:24:22.791 12:51:55 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="cce2aec9-b6ea-4c32-96f1-0ec740154cc0") .free_clusters' 00:24:22.791 12:51:55 -- common/autotest_common.sh@1358 -- # fc=930 00:24:22.791 12:51:55 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="cce2aec9-b6ea-4c32-96f1-0ec740154cc0") .cluster_size' 00:24:22.791 12:51:55 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:24:22.791 12:51:55 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:24:22.791 12:51:55 -- common/autotest_common.sh@1363 -- # echo 952320 00:24:22.791 952320 00:24:22.791 12:51:55 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:23.359 33495441-53c2-44b3-93dd-22692398cab9 00:24:23.359 12:51:56 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:23.617 12:51:56 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:23.875 12:51:56 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:24.134 12:51:57 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:24.134 12:51:57 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:24.134 12:51:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:24.134 12:51:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:24.134 12:51:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:24.134 12:51:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:24.134 12:51:57 -- common/autotest_common.sh@1330 -- # shift 00:24:24.134 12:51:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:24.134 12:51:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:24.134 12:51:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:24.134 12:51:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:24.134 12:51:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:24.134 12:51:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:24.134 12:51:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:24.134 12:51:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:24.393 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:24.393 fio-3.35 00:24:24.393 Starting 1 thread 00:24:24.393 EAL: No free 2048 kB hugepages reported on node 1 00:24:26.923 00:24:26.923 test: (groupid=0, jobs=1): err= 0: pid=3615844: Wed Nov 20 12:51:59 2024 00:24:26.923 read: IOPS=6429, BW=25.1MiB/s (26.3MB/s)(50.4MiB/2007msec) 00:24:26.923 slat (nsec): min=1862, max=159205, avg=2458.06, stdev=2157.61 00:24:26.923 clat (usec): min=772, max=170706, avg=10913.64, stdev=11272.69 00:24:26.923 lat (usec): min=776, max=170750, avg=10916.10, stdev=11273.02 00:24:26.923 clat percentiles (msec): 00:24:26.923 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:24:26.923 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:24:26.923 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:24:26.923 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:26.923 | 99.99th=[ 171] 00:24:26.923 bw ( KiB/s): min=17800, max=28600, per=99.84%, avg=25676.00, stdev=5256.38, samples=4 00:24:26.923 iops : min= 4450, max= 7150, avg=6419.00, stdev=1314.09, samples=4 00:24:26.923 write: IOPS=6434, BW=25.1MiB/s (26.4MB/s)(50.4MiB/2007msec); 0 zone resets 00:24:26.923 slat (nsec): min=1971, max=118585, avg=2537.72, stdev=1638.20 00:24:26.923 clat (usec): min=253, max=168937, avg=8821.46, stdev=10568.69 00:24:26.923 lat (usec): min=257, max=168944, avg=8823.99, stdev=10568.99 00:24:26.923 clat percentiles (msec): 00:24:26.923 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:24:26.923 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:24:26.923 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:24:26.923 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:24:26.923 | 99.99th=[ 169] 00:24:26.923 bw ( KiB/s): min=18856, max=28072, per=99.88%, avg=25706.00, stdev=4568.16, samples=4 00:24:26.923 iops : min= 4714, max= 7018, avg=6426.50, stdev=1142.04, samples=4 00:24:26.923 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:24:26.923 lat (msec) : 2=0.02%, 4=0.14%, 10=72.12%, 20=27.20%, 250=0.50% 00:24:26.923 cpu : usr=61.62%, sys=36.34%, ctx=120, majf=0, minf=37 00:24:26.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:26.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:26.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:26.923 issued rwts: total=12904,12914,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:26.923 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:26.923 00:24:26.923 Run status group 0 (all jobs): 00:24:26.923 READ: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.4MiB (52.9MB), run=2007-2007msec 00:24:26.923 WRITE: bw=25.1MiB/s (26.4MB/s), 25.1MiB/s-25.1MiB/s (26.4MB/s-26.4MB/s), io=50.4MiB (52.9MB), run=2007-2007msec 00:24:26.923 12:51:59 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:26.923 12:51:59 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:28.298 12:52:01 -- host/fio.sh@64 -- # ls_nested_guid=a27565de-2779-44d8-823f-02a781f8f14b 00:24:28.298 12:52:01 -- host/fio.sh@65 -- # get_lvs_free_mb a27565de-2779-44d8-823f-02a781f8f14b 00:24:28.298 12:52:01 -- common/autotest_common.sh@1353 -- # local lvs_uuid=a27565de-2779-44d8-823f-02a781f8f14b 00:24:28.298 12:52:01 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:28.298 12:52:01 -- common/autotest_common.sh@1355 -- # local fc 00:24:28.298 12:52:01 -- common/autotest_common.sh@1356 -- # local cs 00:24:28.298 12:52:01 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:28.298 12:52:01 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:28.298 { 00:24:28.298 "uuid": "cce2aec9-b6ea-4c32-96f1-0ec740154cc0", 00:24:28.298 "name": "lvs_0", 00:24:28.298 "base_bdev": "Nvme0n1", 00:24:28.298 "total_data_clusters": 930, 00:24:28.298 "free_clusters": 0, 00:24:28.298 "block_size": 512, 00:24:28.298 "cluster_size": 1073741824 00:24:28.298 }, 00:24:28.298 { 00:24:28.298 "uuid": "a27565de-2779-44d8-823f-02a781f8f14b", 00:24:28.298 "name": "lvs_n_0", 00:24:28.298 "base_bdev": "33495441-53c2-44b3-93dd-22692398cab9", 00:24:28.298 "total_data_clusters": 237847, 00:24:28.298 "free_clusters": 237847, 00:24:28.298 "block_size": 512, 00:24:28.298 "cluster_size": 4194304 00:24:28.298 } 00:24:28.298 ]' 00:24:28.298 12:52:01 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="a27565de-2779-44d8-823f-02a781f8f14b") .free_clusters' 00:24:28.298 12:52:01 -- common/autotest_common.sh@1358 -- # fc=237847 00:24:28.298 12:52:01 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="a27565de-2779-44d8-823f-02a781f8f14b") .cluster_size' 00:24:28.556 12:52:01 -- common/autotest_common.sh@1359 -- # cs=4194304 00:24:28.556 12:52:01 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:24:28.556 12:52:01 -- common/autotest_common.sh@1363 -- # echo 951388 00:24:28.556 951388 00:24:28.556 12:52:01 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:29.124 f444b9c8-96fd-4b07-8117-3ee105e5cf21 00:24:29.124 12:52:02 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:29.382 12:52:02 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:29.639 12:52:02 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:29.897 12:52:02 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:29.897 12:52:02 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:29.897 12:52:02 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:29.897 12:52:02 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:29.897 12:52:02 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:29.897 12:52:02 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.897 12:52:02 -- common/autotest_common.sh@1330 -- # shift 00:24:29.897 12:52:02 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:29.897 12:52:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:29.897 12:52:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:29.897 12:52:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:29.897 12:52:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:29.897 12:52:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:29.897 12:52:02 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:29.897 12:52:02 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:30.155 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:30.155 fio-3.35 00:24:30.155 Starting 1 thread 00:24:30.155 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.684 00:24:32.684 test: (groupid=0, jobs=1): err= 0: pid=3616601: Wed Nov 20 12:52:05 2024 00:24:32.684 read: IOPS=6239, BW=24.4MiB/s (25.6MB/s)(48.9MiB/2008msec) 00:24:32.684 slat (nsec): min=1869, max=142705, avg=2458.23, stdev=1865.41 00:24:32.684 clat (usec): min=4244, max=18169, avg=11352.36, stdev=969.35 00:24:32.684 lat (usec): min=4259, max=18171, avg=11354.82, stdev=969.23 00:24:32.684 clat percentiles (usec): 00:24:32.684 | 1.00th=[ 9241], 5.00th=[ 9896], 10.00th=[10159], 20.00th=[10552], 00:24:32.684 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11600], 00:24:32.684 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12780], 00:24:32.684 | 99.00th=[13566], 99.50th=[13698], 99.90th=[17171], 99.95th=[17695], 00:24:32.684 | 99.99th=[18220] 00:24:32.684 bw ( KiB/s): min=23904, max=25328, per=99.78%, avg=24902.00, stdev=669.95, samples=4 00:24:32.684 iops : min= 5976, max= 6332, avg=6225.50, stdev=167.49, samples=4 00:24:32.684 write: IOPS=6230, BW=24.3MiB/s (25.5MB/s)(48.9MiB/2008msec); 0 zone resets 00:24:32.684 slat (nsec): min=1920, max=109331, avg=2563.44, stdev=1341.40 00:24:32.684 clat (usec): min=2122, max=17182, avg=9065.98, stdev=841.06 00:24:32.684 lat (usec): min=2128, max=17184, avg=9068.55, stdev=841.01 00:24:32.684 clat percentiles (usec): 00:24:32.684 | 1.00th=[ 7111], 5.00th=[ 7832], 10.00th=[ 8094], 20.00th=[ 8455], 00:24:32.684 | 30.00th=[ 8717], 40.00th=[ 8848], 50.00th=[ 9110], 60.00th=[ 9241], 00:24:32.684 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10028], 95.00th=[10290], 00:24:32.684 | 99.00th=[10945], 99.50th=[11207], 99.90th=[15139], 99.95th=[16188], 00:24:32.684 | 99.99th=[17171] 00:24:32.684 bw ( KiB/s): min=24704, max=25088, per=99.99%, avg=24918.00, stdev=162.83, samples=4 00:24:32.684 iops : min= 6176, max= 6272, avg=6229.50, stdev=40.71, samples=4 00:24:32.684 lat (msec) : 4=0.04%, 10=47.78%, 20=52.17% 00:24:32.684 cpu : usr=62.03%, sys=35.97%, ctx=143, majf=0, minf=37 00:24:32.684 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:32.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:32.684 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:32.684 issued rwts: total=12528,12510,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:32.684 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:32.684 00:24:32.684 Run status group 0 (all jobs): 00:24:32.684 READ: bw=24.4MiB/s (25.6MB/s), 24.4MiB/s-24.4MiB/s (25.6MB/s-25.6MB/s), io=48.9MiB (51.3MB), run=2008-2008msec 00:24:32.684 WRITE: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.9MiB (51.2MB), run=2008-2008msec 00:24:32.684 12:52:05 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:32.684 12:52:05 -- host/fio.sh@74 -- # sync 00:24:32.685 12:52:05 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:36.878 12:52:09 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:36.878 12:52:09 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:24:40.170 12:52:12 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:40.170 12:52:12 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:24:42.074 12:52:14 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:24:42.074 12:52:14 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:24:42.074 12:52:14 -- host/fio.sh@86 -- # nvmftestfini 00:24:42.074 12:52:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:42.074 12:52:14 -- nvmf/common.sh@116 -- # sync 00:24:42.074 12:52:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:42.074 12:52:14 -- nvmf/common.sh@119 -- # set +e 00:24:42.074 12:52:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:42.074 12:52:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:42.074 rmmod nvme_tcp 00:24:42.074 rmmod nvme_fabrics 00:24:42.074 rmmod nvme_keyring 00:24:42.074 12:52:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:42.074 12:52:14 -- nvmf/common.sh@123 -- # set -e 00:24:42.074 12:52:14 -- nvmf/common.sh@124 -- # return 0 00:24:42.074 12:52:14 -- nvmf/common.sh@477 -- # '[' -n 3613679 ']' 00:24:42.074 12:52:14 -- nvmf/common.sh@478 -- # killprocess 3613679 00:24:42.074 12:52:14 -- common/autotest_common.sh@936 -- # '[' -z 3613679 ']' 00:24:42.074 12:52:14 -- common/autotest_common.sh@940 -- # kill -0 3613679 00:24:42.074 12:52:14 -- common/autotest_common.sh@941 -- # uname 00:24:42.074 12:52:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:42.074 12:52:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3613679 00:24:42.074 12:52:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:42.074 12:52:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:42.074 12:52:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3613679' 00:24:42.074 killing process with pid 3613679 00:24:42.074 12:52:14 -- common/autotest_common.sh@955 -- # kill 3613679 00:24:42.074 12:52:14 -- common/autotest_common.sh@960 -- # wait 3613679 00:24:42.332 12:52:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:42.332 12:52:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:42.332 12:52:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:42.332 12:52:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:42.332 12:52:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:42.332 12:52:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:42.332 12:52:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:42.332 12:52:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:44.239 12:52:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:44.239 00:24:44.239 real 0m38.054s 00:24:44.239 user 2m26.764s 00:24:44.239 sys 0m6.707s 00:24:44.239 12:52:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:44.239 12:52:17 -- common/autotest_common.sh@10 -- # set +x 00:24:44.239 ************************************ 00:24:44.239 END TEST nvmf_fio_host 00:24:44.239 ************************************ 00:24:44.498 12:52:17 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:44.498 12:52:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:44.498 12:52:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:44.498 12:52:17 -- common/autotest_common.sh@10 -- # set +x 00:24:44.498 ************************************ 00:24:44.498 START TEST nvmf_failover 00:24:44.498 ************************************ 00:24:44.498 12:52:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:44.498 * Looking for test storage... 00:24:44.498 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:44.498 12:52:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:44.498 12:52:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:44.498 12:52:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:44.498 12:52:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:44.498 12:52:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:44.498 12:52:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:44.498 12:52:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:44.498 12:52:17 -- scripts/common.sh@335 -- # IFS=.-: 00:24:44.498 12:52:17 -- scripts/common.sh@335 -- # read -ra ver1 00:24:44.498 12:52:17 -- scripts/common.sh@336 -- # IFS=.-: 00:24:44.498 12:52:17 -- scripts/common.sh@336 -- # read -ra ver2 00:24:44.498 12:52:17 -- scripts/common.sh@337 -- # local 'op=<' 00:24:44.498 12:52:17 -- scripts/common.sh@339 -- # ver1_l=2 00:24:44.498 12:52:17 -- scripts/common.sh@340 -- # ver2_l=1 00:24:44.498 12:52:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:44.498 12:52:17 -- scripts/common.sh@343 -- # case "$op" in 00:24:44.499 12:52:17 -- scripts/common.sh@344 -- # : 1 00:24:44.499 12:52:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:44.499 12:52:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:44.499 12:52:17 -- scripts/common.sh@364 -- # decimal 1 00:24:44.499 12:52:17 -- scripts/common.sh@352 -- # local d=1 00:24:44.499 12:52:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:44.499 12:52:17 -- scripts/common.sh@354 -- # echo 1 00:24:44.499 12:52:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:44.499 12:52:17 -- scripts/common.sh@365 -- # decimal 2 00:24:44.499 12:52:17 -- scripts/common.sh@352 -- # local d=2 00:24:44.499 12:52:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:44.499 12:52:17 -- scripts/common.sh@354 -- # echo 2 00:24:44.499 12:52:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:44.499 12:52:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:44.499 12:52:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:44.499 12:52:17 -- scripts/common.sh@367 -- # return 0 00:24:44.499 12:52:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:44.499 12:52:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:44.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:44.499 --rc genhtml_branch_coverage=1 00:24:44.499 --rc genhtml_function_coverage=1 00:24:44.499 --rc genhtml_legend=1 00:24:44.499 --rc geninfo_all_blocks=1 00:24:44.499 --rc geninfo_unexecuted_blocks=1 00:24:44.499 00:24:44.499 ' 00:24:44.499 12:52:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:44.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:44.499 --rc genhtml_branch_coverage=1 00:24:44.499 --rc genhtml_function_coverage=1 00:24:44.499 --rc genhtml_legend=1 00:24:44.499 --rc geninfo_all_blocks=1 00:24:44.499 --rc geninfo_unexecuted_blocks=1 00:24:44.499 00:24:44.499 ' 00:24:44.499 12:52:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:44.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:44.499 --rc genhtml_branch_coverage=1 00:24:44.499 --rc genhtml_function_coverage=1 00:24:44.499 --rc genhtml_legend=1 00:24:44.499 --rc geninfo_all_blocks=1 00:24:44.499 --rc geninfo_unexecuted_blocks=1 00:24:44.499 00:24:44.499 ' 00:24:44.499 12:52:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:44.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:44.499 --rc genhtml_branch_coverage=1 00:24:44.499 --rc genhtml_function_coverage=1 00:24:44.499 --rc genhtml_legend=1 00:24:44.499 --rc geninfo_all_blocks=1 00:24:44.499 --rc geninfo_unexecuted_blocks=1 00:24:44.499 00:24:44.499 ' 00:24:44.499 12:52:17 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:44.499 12:52:17 -- nvmf/common.sh@7 -- # uname -s 00:24:44.499 12:52:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:44.499 12:52:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:44.499 12:52:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:44.499 12:52:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:44.499 12:52:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:44.499 12:52:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:44.499 12:52:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:44.499 12:52:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:44.499 12:52:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:44.499 12:52:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:44.499 12:52:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:44.499 12:52:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:44.499 12:52:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:44.499 12:52:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:44.499 12:52:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:44.499 12:52:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:44.499 12:52:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:44.499 12:52:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:44.499 12:52:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:44.499 12:52:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.499 12:52:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.499 12:52:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.499 12:52:17 -- paths/export.sh@5 -- # export PATH 00:24:44.499 12:52:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.499 12:52:17 -- nvmf/common.sh@46 -- # : 0 00:24:44.499 12:52:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:44.499 12:52:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:44.499 12:52:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:44.499 12:52:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:44.499 12:52:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:44.499 12:52:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:44.499 12:52:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:44.499 12:52:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:44.499 12:52:17 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:44.499 12:52:17 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:44.499 12:52:17 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:44.499 12:52:17 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:44.499 12:52:17 -- host/failover.sh@18 -- # nvmftestinit 00:24:44.499 12:52:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:44.499 12:52:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:44.499 12:52:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:44.499 12:52:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:44.499 12:52:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:44.499 12:52:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:44.499 12:52:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:44.499 12:52:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:44.499 12:52:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:44.499 12:52:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:44.499 12:52:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:44.499 12:52:17 -- common/autotest_common.sh@10 -- # set +x 00:24:47.035 12:52:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:47.035 12:52:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:47.035 12:52:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:47.035 12:52:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:47.035 12:52:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:47.035 12:52:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:47.035 12:52:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:47.035 12:52:19 -- nvmf/common.sh@294 -- # net_devs=() 00:24:47.035 12:52:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:47.035 12:52:19 -- nvmf/common.sh@295 -- # e810=() 00:24:47.035 12:52:19 -- nvmf/common.sh@295 -- # local -ga e810 00:24:47.035 12:52:19 -- nvmf/common.sh@296 -- # x722=() 00:24:47.035 12:52:19 -- nvmf/common.sh@296 -- # local -ga x722 00:24:47.035 12:52:19 -- nvmf/common.sh@297 -- # mlx=() 00:24:47.035 12:52:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:47.035 12:52:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:47.035 12:52:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:47.035 12:52:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:47.035 12:52:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:47.035 12:52:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.035 12:52:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:47.035 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:47.035 12:52:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.035 12:52:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:47.035 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:47.035 12:52:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:47.035 12:52:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.035 12:52:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.035 12:52:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.035 12:52:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.035 12:52:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:47.035 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:47.035 12:52:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.035 12:52:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.035 12:52:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.035 12:52:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.035 12:52:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.035 12:52:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:47.035 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:47.035 12:52:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.035 12:52:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:47.035 12:52:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:47.035 12:52:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:47.035 12:52:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:47.035 12:52:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:47.035 12:52:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:47.035 12:52:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:47.035 12:52:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:47.035 12:52:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:47.035 12:52:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:47.035 12:52:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:47.035 12:52:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:47.035 12:52:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:47.035 12:52:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:47.035 12:52:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:47.035 12:52:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:47.035 12:52:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:47.035 12:52:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:47.036 12:52:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:47.036 12:52:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:47.036 12:52:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:47.036 12:52:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:47.036 12:52:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:47.036 12:52:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:47.036 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:47.036 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.279 ms 00:24:47.036 00:24:47.036 --- 10.0.0.2 ping statistics --- 00:24:47.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:47.036 rtt min/avg/max/mdev = 0.279/0.279/0.279/0.000 ms 00:24:47.036 12:52:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:47.036 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:47.036 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:24:47.036 00:24:47.036 --- 10.0.0.1 ping statistics --- 00:24:47.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:47.036 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:24:47.036 12:52:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:47.036 12:52:19 -- nvmf/common.sh@410 -- # return 0 00:24:47.036 12:52:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:47.036 12:52:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:47.036 12:52:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:47.036 12:52:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:47.036 12:52:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:47.036 12:52:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:47.036 12:52:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:47.036 12:52:19 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:24:47.036 12:52:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:47.036 12:52:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:47.036 12:52:19 -- common/autotest_common.sh@10 -- # set +x 00:24:47.036 12:52:19 -- nvmf/common.sh@469 -- # nvmfpid=3620023 00:24:47.036 12:52:19 -- nvmf/common.sh@470 -- # waitforlisten 3620023 00:24:47.036 12:52:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:47.036 12:52:19 -- common/autotest_common.sh@829 -- # '[' -z 3620023 ']' 00:24:47.036 12:52:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:47.036 12:52:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:47.036 12:52:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:47.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:47.036 12:52:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:47.036 12:52:19 -- common/autotest_common.sh@10 -- # set +x 00:24:47.036 [2024-11-20 12:52:19.778448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:47.036 [2024-11-20 12:52:19.778523] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:47.036 EAL: No free 2048 kB hugepages reported on node 1 00:24:47.036 [2024-11-20 12:52:19.846184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:47.036 [2024-11-20 12:52:19.965299] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:47.036 [2024-11-20 12:52:19.965443] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:47.036 [2024-11-20 12:52:19.965462] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:47.036 [2024-11-20 12:52:19.965475] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:47.036 [2024-11-20 12:52:19.965577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:47.036 [2024-11-20 12:52:19.965628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:47.036 [2024-11-20 12:52:19.965646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:47.973 12:52:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:47.973 12:52:20 -- common/autotest_common.sh@862 -- # return 0 00:24:47.973 12:52:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:47.973 12:52:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:47.973 12:52:20 -- common/autotest_common.sh@10 -- # set +x 00:24:47.973 12:52:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:47.973 12:52:20 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:47.973 [2024-11-20 12:52:21.008269] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:47.973 12:52:21 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:24:48.232 Malloc0 00:24:48.232 12:52:21 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:48.490 12:52:21 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:48.747 12:52:21 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:49.004 [2024-11-20 12:52:22.037286] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:49.004 12:52:22 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:49.262 [2024-11-20 12:52:22.293973] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:49.262 12:52:22 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:49.520 [2024-11-20 12:52:22.566907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:24:49.520 12:52:22 -- host/failover.sh@31 -- # bdevperf_pid=3620456 00:24:49.520 12:52:22 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:24:49.520 12:52:22 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:49.520 12:52:22 -- host/failover.sh@34 -- # waitforlisten 3620456 /var/tmp/bdevperf.sock 00:24:49.520 12:52:22 -- common/autotest_common.sh@829 -- # '[' -z 3620456 ']' 00:24:49.520 12:52:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:49.520 12:52:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:49.520 12:52:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:49.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:49.520 12:52:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:49.520 12:52:22 -- common/autotest_common.sh@10 -- # set +x 00:24:50.544 12:52:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:50.544 12:52:23 -- common/autotest_common.sh@862 -- # return 0 00:24:50.544 12:52:23 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:51.112 NVMe0n1 00:24:51.113 12:52:24 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:51.370 00:24:51.370 12:52:24 -- host/failover.sh@39 -- # run_test_pid=3620610 00:24:51.370 12:52:24 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:24:51.371 12:52:24 -- host/failover.sh@41 -- # sleep 1 00:24:52.306 12:52:25 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:52.567 [2024-11-20 12:52:25.623726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.623996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.567 [2024-11-20 12:52:25.624272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 [2024-11-20 12:52:25.624690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2234cb0 is same with the state(5) to be set 00:24:52.568 12:52:25 -- host/failover.sh@45 -- # sleep 3 00:24:55.855 12:52:28 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:56.113 00:24:56.113 12:52:29 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:56.373 [2024-11-20 12:52:29.382890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.382963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.382993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 [2024-11-20 12:52:29.383486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22363a0 is same with the state(5) to be set 00:24:56.373 12:52:29 -- host/failover.sh@50 -- # sleep 3 00:24:59.663 12:52:32 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:59.663 [2024-11-20 12:52:32.665244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.663 12:52:32 -- host/failover.sh@55 -- # sleep 1 00:25:00.601 12:52:33 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:00.859 [2024-11-20 12:52:33.929195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 [2024-11-20 12:52:33.929842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2236a80 is same with the state(5) to be set 00:25:00.860 12:52:33 -- host/failover.sh@59 -- # wait 3620610 00:25:07.439 0 00:25:07.439 12:52:39 -- host/failover.sh@61 -- # killprocess 3620456 00:25:07.439 12:52:39 -- common/autotest_common.sh@936 -- # '[' -z 3620456 ']' 00:25:07.439 12:52:39 -- common/autotest_common.sh@940 -- # kill -0 3620456 00:25:07.439 12:52:39 -- common/autotest_common.sh@941 -- # uname 00:25:07.439 12:52:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:07.439 12:52:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3620456 00:25:07.439 12:52:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:07.439 12:52:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:07.439 12:52:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3620456' 00:25:07.439 killing process with pid 3620456 00:25:07.439 12:52:39 -- common/autotest_common.sh@955 -- # kill 3620456 00:25:07.439 12:52:39 -- common/autotest_common.sh@960 -- # wait 3620456 00:25:07.439 12:52:39 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:07.439 [2024-11-20 12:52:22.622705] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:07.439 [2024-11-20 12:52:22.622800] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3620456 ] 00:25:07.439 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.439 [2024-11-20 12:52:22.683034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:07.439 [2024-11-20 12:52:22.789033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:07.439 Running I/O for 15 seconds... 00:25:07.439 [2024-11-20 12:52:25.624996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:115256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:114608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:114624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:114632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:114640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:114648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:114656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:114672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:114696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:114704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:114720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:114728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:114752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:114760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:114776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.439 [2024-11-20 12:52:25.625678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:114792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.439 [2024-11-20 12:52:25.625692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:114800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:115368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.625815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:115376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.625845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:115392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.625904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:115400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:114808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.625977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:114856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.625991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:114888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:114904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:114912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:114936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:114960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:115416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:115424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:115448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:115456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:115488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.440 [2024-11-20 12:52:25.626766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:115504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:115512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.440 [2024-11-20 12:52:25.626838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:115520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.440 [2024-11-20 12:52:25.626852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.626867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.626880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.626903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:115536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.626918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.626933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.626946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.626962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:115552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.626975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.626990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:115616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:115624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:115632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:115640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:115648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:115656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:115664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:115688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:115696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:115704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:115728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:115744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.441 [2024-11-20 12:52:25.627957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.627972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.627986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.628001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.628014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.628030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.441 [2024-11-20 12:52:25.628044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.441 [2024-11-20 12:52:25.628078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:115784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:115792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:115800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:115808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:115816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:115824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:115832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:115840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:115848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:115856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:115864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:115872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:115880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:115896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:115912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:115920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:115928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.442 [2024-11-20 12:52:25.628658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:25.628893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.628908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24276a0 is same with the state(5) to be set 00:25:07.442 [2024-11-20 12:52:25.628926] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:07.442 [2024-11-20 12:52:25.628944] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:07.442 [2024-11-20 12:52:25.628957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115352 len:8 PRP1 0x0 PRP2 0x0 00:25:07.442 [2024-11-20 12:52:25.628970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.629037] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x24276a0 was disconnected and freed. reset controller. 00:25:07.442 [2024-11-20 12:52:25.629062] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:07.442 [2024-11-20 12:52:25.629121] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.442 [2024-11-20 12:52:25.629139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.629154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.442 [2024-11-20 12:52:25.629167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.629181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.442 [2024-11-20 12:52:25.629193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.629207] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.442 [2024-11-20 12:52:25.629220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:25.629233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:07.442 [2024-11-20 12:52:25.629284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2408870 (9): Bad file descriptor 00:25:07.442 [2024-11-20 12:52:25.631571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:07.442 [2024-11-20 12:52:25.778166] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:07.442 [2024-11-20 12:52:29.383604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:9944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:29.383649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:29.383687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:9320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:29.383703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.442 [2024-11-20 12:52:29.383720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.442 [2024-11-20 12:52:29.383735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:9360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:9424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:9952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.383973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.383987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:9448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:9456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:9488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:9496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:9512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:9968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:10000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:10016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:10032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:10048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:10128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:10144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.443 [2024-11-20 12:52:29.384524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:10152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:9528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.443 [2024-11-20 12:52:29.384708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.443 [2024-11-20 12:52:29.384721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:9656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:9704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.384978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.384992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:9728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:9784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:9808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:9832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:9848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:10160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:10184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:10192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:10200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:10216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:10224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:10232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:10240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:10248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:10256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:10264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:10272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:10280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:10288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:10296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.444 [2024-11-20 12:52:29.385796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:10304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:10312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:10320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.444 [2024-11-20 12:52:29.385879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.444 [2024-11-20 12:52:29.385894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:10328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.385907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.385922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:10336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.385935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.385953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:10344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.385967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.385982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.385995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:10360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:10368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:10384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:10392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:10400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:10408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:10416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:10424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:10448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:10456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:10464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:10480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:10512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:10528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:10536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.445 [2024-11-20 12:52:29.386789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:10560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:10568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:10576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:9880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.386980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:9976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.386993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.387008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:9984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.387022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.387038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:10008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.387052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.387067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:10024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.387088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.445 [2024-11-20 12:52:29.387103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:10056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.445 [2024-11-20 12:52:29.387120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:10584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.446 [2024-11-20 12:52:29.387150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:10600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.446 [2024-11-20 12:52:29.387235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:10616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.446 [2024-11-20 12:52:29.387263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:10080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:10088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:10096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:10104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:10112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:10120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:29.387462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2414d10 is same with the state(5) to be set 00:25:07.446 [2024-11-20 12:52:29.387497] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:07.446 [2024-11-20 12:52:29.387509] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:07.446 [2024-11-20 12:52:29.387522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10136 len:8 PRP1 0x0 PRP2 0x0 00:25:07.446 [2024-11-20 12:52:29.387534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387603] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2414d10 was disconnected and freed. reset controller. 00:25:07.446 [2024-11-20 12:52:29.387622] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:07.446 [2024-11-20 12:52:29.387657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.446 [2024-11-20 12:52:29.387677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.446 [2024-11-20 12:52:29.387726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.446 [2024-11-20 12:52:29.387754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.446 [2024-11-20 12:52:29.387781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:29.387794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:07.446 [2024-11-20 12:52:29.387849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2408870 (9): Bad file descriptor 00:25:07.446 [2024-11-20 12:52:29.390049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:07.446 [2024-11-20 12:52:29.539926] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:07.446 [2024-11-20 12:52:33.929993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:4072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:4088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:4112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:4120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:4128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:4144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:3480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:3488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:3504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:3520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:3528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:3536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:3544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:3608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.446 [2024-11-20 12:52:33.930582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.446 [2024-11-20 12:52:33.930596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:4176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:4184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:4192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:4208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:3616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:3632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:3640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:3648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:3664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:3672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:3680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:4248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.930979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.930995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:4256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:4272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:4288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:3696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:3720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:3776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:3856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:4328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:4336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:4344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:4360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:4368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:4376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:4384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:4392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:4400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:4408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:4416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:4424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:4432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.447 [2024-11-20 12:52:33.931750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:4440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.447 [2024-11-20 12:52:33.931778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.447 [2024-11-20 12:52:33.931793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:4448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.931806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:4456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.931833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.931861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:4472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.931888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:4480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.931916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.931944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.931977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.931992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:4504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:4512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:4520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:4528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:4536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:4544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:4552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:4560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:4568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:4576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:4584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:4592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:4600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:4616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:3864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:3872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:3880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:3936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:3984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:4024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:4632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:4640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.448 [2024-11-20 12:52:33.932762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.448 [2024-11-20 12:52:33.932789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.448 [2024-11-20 12:52:33.932804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:4656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.932817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.932836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:4664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.932849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.932864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:4672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.932877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.932892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:4680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.932906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.932920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:4688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.932934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.932949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:4696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.932963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.932977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.932991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:4712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:4720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:4728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:4736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:4744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:4752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:4760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:4768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:4776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:4784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:4792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:4800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:4808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:07.449 [2024-11-20 12:52:33.933398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:4048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:4056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:4152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:4160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:4224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:4232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:4240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:4264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:4280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:4296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:4304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:4312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.449 [2024-11-20 12:52:33.933838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x242b630 is same with the state(5) to be set 00:25:07.449 [2024-11-20 12:52:33.933869] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:07.449 [2024-11-20 12:52:33.933881] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:07.449 [2024-11-20 12:52:33.933892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4320 len:8 PRP1 0x0 PRP2 0x0 00:25:07.449 [2024-11-20 12:52:33.933905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.933965] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x242b630 was disconnected and freed. reset controller. 00:25:07.449 [2024-11-20 12:52:33.933984] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:07.449 [2024-11-20 12:52:33.934019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.449 [2024-11-20 12:52:33.934037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.449 [2024-11-20 12:52:33.934056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.449 [2024-11-20 12:52:33.934076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.450 [2024-11-20 12:52:33.934092] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.450 [2024-11-20 12:52:33.934104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.450 [2024-11-20 12:52:33.934117] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.450 [2024-11-20 12:52:33.934130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.450 [2024-11-20 12:52:33.934143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:07.450 [2024-11-20 12:52:33.934194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2408870 (9): Bad file descriptor 00:25:07.450 [2024-11-20 12:52:33.936364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:07.450 [2024-11-20 12:52:34.056833] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:07.450 00:25:07.450 Latency(us) 00:25:07.450 [2024-11-20T11:52:40.558Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:07.450 [2024-11-20T11:52:40.558Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:07.450 Verification LBA range: start 0x0 length 0x4000 00:25:07.450 NVMe0n1 : 15.01 12361.66 48.29 1625.13 0.00 9135.16 670.53 15243.19 00:25:07.450 [2024-11-20T11:52:40.558Z] =================================================================================================================== 00:25:07.450 [2024-11-20T11:52:40.558Z] Total : 12361.66 48.29 1625.13 0.00 9135.16 670.53 15243.19 00:25:07.450 Received shutdown signal, test time was about 15.000000 seconds 00:25:07.450 00:25:07.450 Latency(us) 00:25:07.450 [2024-11-20T11:52:40.558Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:07.450 [2024-11-20T11:52:40.558Z] =================================================================================================================== 00:25:07.450 [2024-11-20T11:52:40.558Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:07.450 12:52:39 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:07.450 12:52:39 -- host/failover.sh@65 -- # count=3 00:25:07.450 12:52:39 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:07.450 12:52:39 -- host/failover.sh@73 -- # bdevperf_pid=3622505 00:25:07.450 12:52:39 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:07.450 12:52:39 -- host/failover.sh@75 -- # waitforlisten 3622505 /var/tmp/bdevperf.sock 00:25:07.450 12:52:39 -- common/autotest_common.sh@829 -- # '[' -z 3622505 ']' 00:25:07.450 12:52:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:07.450 12:52:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:07.450 12:52:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:07.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:07.450 12:52:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:07.450 12:52:39 -- common/autotest_common.sh@10 -- # set +x 00:25:08.017 12:52:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:08.017 12:52:40 -- common/autotest_common.sh@862 -- # return 0 00:25:08.017 12:52:40 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:08.017 [2024-11-20 12:52:41.080773] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:08.017 12:52:41 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:08.275 [2024-11-20 12:52:41.325457] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:08.275 12:52:41 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:08.843 NVMe0n1 00:25:08.843 12:52:41 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:09.102 00:25:09.102 12:52:42 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:09.359 00:25:09.359 12:52:42 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:09.359 12:52:42 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:09.618 12:52:42 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:09.876 12:52:42 -- host/failover.sh@87 -- # sleep 3 00:25:13.167 12:52:45 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:13.167 12:52:45 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:13.167 12:52:46 -- host/failover.sh@90 -- # run_test_pid=3623321 00:25:13.167 12:52:46 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:13.167 12:52:46 -- host/failover.sh@92 -- # wait 3623321 00:25:14.544 0 00:25:14.544 12:52:47 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:14.544 [2024-11-20 12:52:39.895629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:14.544 [2024-11-20 12:52:39.895708] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3622505 ] 00:25:14.544 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.544 [2024-11-20 12:52:39.954399] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:14.544 [2024-11-20 12:52:40.063689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:14.545 [2024-11-20 12:52:42.886634] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:14.545 [2024-11-20 12:52:42.886722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:14.545 [2024-11-20 12:52:42.886745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:14.545 [2024-11-20 12:52:42.886778] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:14.545 [2024-11-20 12:52:42.886792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:14.545 [2024-11-20 12:52:42.886806] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:14.545 [2024-11-20 12:52:42.886820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:14.545 [2024-11-20 12:52:42.886834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:14.545 [2024-11-20 12:52:42.886847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:14.545 [2024-11-20 12:52:42.886861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:14.545 [2024-11-20 12:52:42.886903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:14.545 [2024-11-20 12:52:42.886934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18b2870 (9): Bad file descriptor 00:25:14.545 [2024-11-20 12:52:43.029200] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:14.545 Running I/O for 1 seconds... 00:25:14.545 00:25:14.545 Latency(us) 00:25:14.545 [2024-11-20T11:52:47.653Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:14.545 [2024-11-20T11:52:47.653Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:14.545 Verification LBA range: start 0x0 length 0x4000 00:25:14.545 NVMe0n1 : 1.01 12833.81 50.13 0.00 0.00 9923.28 1316.79 12718.84 00:25:14.545 [2024-11-20T11:52:47.653Z] =================================================================================================================== 00:25:14.545 [2024-11-20T11:52:47.653Z] Total : 12833.81 50.13 0.00 0.00 9923.28 1316.79 12718.84 00:25:14.545 12:52:47 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:14.545 12:52:47 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:14.545 12:52:47 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:14.803 12:52:47 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:14.803 12:52:47 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:15.061 12:52:48 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:15.319 12:52:48 -- host/failover.sh@101 -- # sleep 3 00:25:18.614 12:52:51 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:18.614 12:52:51 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:18.614 12:52:51 -- host/failover.sh@108 -- # killprocess 3622505 00:25:18.614 12:52:51 -- common/autotest_common.sh@936 -- # '[' -z 3622505 ']' 00:25:18.614 12:52:51 -- common/autotest_common.sh@940 -- # kill -0 3622505 00:25:18.614 12:52:51 -- common/autotest_common.sh@941 -- # uname 00:25:18.614 12:52:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:18.614 12:52:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3622505 00:25:18.614 12:52:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:18.614 12:52:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:18.614 12:52:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3622505' 00:25:18.614 killing process with pid 3622505 00:25:18.614 12:52:51 -- common/autotest_common.sh@955 -- # kill 3622505 00:25:18.614 12:52:51 -- common/autotest_common.sh@960 -- # wait 3622505 00:25:18.873 12:52:51 -- host/failover.sh@110 -- # sync 00:25:18.873 12:52:51 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:19.131 12:52:52 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:19.131 12:52:52 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:19.131 12:52:52 -- host/failover.sh@116 -- # nvmftestfini 00:25:19.131 12:52:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:19.131 12:52:52 -- nvmf/common.sh@116 -- # sync 00:25:19.131 12:52:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:19.131 12:52:52 -- nvmf/common.sh@119 -- # set +e 00:25:19.131 12:52:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:19.131 12:52:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:19.131 rmmod nvme_tcp 00:25:19.131 rmmod nvme_fabrics 00:25:19.131 rmmod nvme_keyring 00:25:19.131 12:52:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:19.131 12:52:52 -- nvmf/common.sh@123 -- # set -e 00:25:19.131 12:52:52 -- nvmf/common.sh@124 -- # return 0 00:25:19.131 12:52:52 -- nvmf/common.sh@477 -- # '[' -n 3620023 ']' 00:25:19.131 12:52:52 -- nvmf/common.sh@478 -- # killprocess 3620023 00:25:19.131 12:52:52 -- common/autotest_common.sh@936 -- # '[' -z 3620023 ']' 00:25:19.131 12:52:52 -- common/autotest_common.sh@940 -- # kill -0 3620023 00:25:19.131 12:52:52 -- common/autotest_common.sh@941 -- # uname 00:25:19.131 12:52:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:19.131 12:52:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3620023 00:25:19.390 12:52:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:19.390 12:52:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:19.390 12:52:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3620023' 00:25:19.390 killing process with pid 3620023 00:25:19.390 12:52:52 -- common/autotest_common.sh@955 -- # kill 3620023 00:25:19.390 12:52:52 -- common/autotest_common.sh@960 -- # wait 3620023 00:25:19.648 12:52:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:19.648 12:52:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:19.648 12:52:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:19.648 12:52:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:19.648 12:52:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:19.648 12:52:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:19.648 12:52:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:19.649 12:52:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:21.553 12:52:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:21.553 00:25:21.553 real 0m37.250s 00:25:21.553 user 2m10.030s 00:25:21.553 sys 0m6.804s 00:25:21.553 12:52:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:21.553 12:52:54 -- common/autotest_common.sh@10 -- # set +x 00:25:21.553 ************************************ 00:25:21.553 END TEST nvmf_failover 00:25:21.553 ************************************ 00:25:21.553 12:52:54 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:21.553 12:52:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:21.553 12:52:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:21.553 12:52:54 -- common/autotest_common.sh@10 -- # set +x 00:25:21.553 ************************************ 00:25:21.553 START TEST nvmf_discovery 00:25:21.553 ************************************ 00:25:21.553 12:52:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:21.812 * Looking for test storage... 00:25:21.812 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:21.812 12:52:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:21.812 12:52:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:21.812 12:52:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:21.812 12:52:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:21.812 12:52:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:21.812 12:52:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:21.812 12:52:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:21.812 12:52:54 -- scripts/common.sh@335 -- # IFS=.-: 00:25:21.812 12:52:54 -- scripts/common.sh@335 -- # read -ra ver1 00:25:21.812 12:52:54 -- scripts/common.sh@336 -- # IFS=.-: 00:25:21.812 12:52:54 -- scripts/common.sh@336 -- # read -ra ver2 00:25:21.812 12:52:54 -- scripts/common.sh@337 -- # local 'op=<' 00:25:21.812 12:52:54 -- scripts/common.sh@339 -- # ver1_l=2 00:25:21.812 12:52:54 -- scripts/common.sh@340 -- # ver2_l=1 00:25:21.812 12:52:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:21.812 12:52:54 -- scripts/common.sh@343 -- # case "$op" in 00:25:21.812 12:52:54 -- scripts/common.sh@344 -- # : 1 00:25:21.812 12:52:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:21.812 12:52:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:21.812 12:52:54 -- scripts/common.sh@364 -- # decimal 1 00:25:21.812 12:52:54 -- scripts/common.sh@352 -- # local d=1 00:25:21.812 12:52:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:21.812 12:52:54 -- scripts/common.sh@354 -- # echo 1 00:25:21.812 12:52:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:21.812 12:52:54 -- scripts/common.sh@365 -- # decimal 2 00:25:21.813 12:52:54 -- scripts/common.sh@352 -- # local d=2 00:25:21.813 12:52:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:21.813 12:52:54 -- scripts/common.sh@354 -- # echo 2 00:25:21.813 12:52:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:21.813 12:52:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:21.813 12:52:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:21.813 12:52:54 -- scripts/common.sh@367 -- # return 0 00:25:21.813 12:52:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:21.813 12:52:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:21.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:21.813 --rc genhtml_branch_coverage=1 00:25:21.813 --rc genhtml_function_coverage=1 00:25:21.813 --rc genhtml_legend=1 00:25:21.813 --rc geninfo_all_blocks=1 00:25:21.813 --rc geninfo_unexecuted_blocks=1 00:25:21.813 00:25:21.813 ' 00:25:21.813 12:52:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:21.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:21.813 --rc genhtml_branch_coverage=1 00:25:21.813 --rc genhtml_function_coverage=1 00:25:21.813 --rc genhtml_legend=1 00:25:21.813 --rc geninfo_all_blocks=1 00:25:21.813 --rc geninfo_unexecuted_blocks=1 00:25:21.813 00:25:21.813 ' 00:25:21.813 12:52:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:21.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:21.813 --rc genhtml_branch_coverage=1 00:25:21.813 --rc genhtml_function_coverage=1 00:25:21.813 --rc genhtml_legend=1 00:25:21.813 --rc geninfo_all_blocks=1 00:25:21.813 --rc geninfo_unexecuted_blocks=1 00:25:21.813 00:25:21.813 ' 00:25:21.813 12:52:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:21.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:21.813 --rc genhtml_branch_coverage=1 00:25:21.813 --rc genhtml_function_coverage=1 00:25:21.813 --rc genhtml_legend=1 00:25:21.813 --rc geninfo_all_blocks=1 00:25:21.813 --rc geninfo_unexecuted_blocks=1 00:25:21.813 00:25:21.813 ' 00:25:21.813 12:52:54 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:21.813 12:52:54 -- nvmf/common.sh@7 -- # uname -s 00:25:21.813 12:52:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:21.813 12:52:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:21.813 12:52:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:21.813 12:52:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:21.813 12:52:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:21.813 12:52:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:21.813 12:52:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:21.813 12:52:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:21.813 12:52:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:21.813 12:52:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:21.813 12:52:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:21.813 12:52:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:21.813 12:52:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:21.813 12:52:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:21.813 12:52:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:21.813 12:52:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:21.813 12:52:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:21.813 12:52:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:21.813 12:52:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:21.813 12:52:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.813 12:52:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.813 12:52:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.813 12:52:54 -- paths/export.sh@5 -- # export PATH 00:25:21.813 12:52:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.813 12:52:54 -- nvmf/common.sh@46 -- # : 0 00:25:21.813 12:52:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:21.813 12:52:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:21.813 12:52:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:21.813 12:52:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:21.813 12:52:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:21.813 12:52:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:21.813 12:52:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:21.813 12:52:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:21.813 12:52:54 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:21.813 12:52:54 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:21.813 12:52:54 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:21.813 12:52:54 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:21.813 12:52:54 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:21.813 12:52:54 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:21.813 12:52:54 -- host/discovery.sh@25 -- # nvmftestinit 00:25:21.813 12:52:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:21.813 12:52:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:21.813 12:52:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:21.813 12:52:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:21.813 12:52:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:21.813 12:52:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.813 12:52:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.813 12:52:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:21.813 12:52:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:21.813 12:52:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:21.813 12:52:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:21.813 12:52:54 -- common/autotest_common.sh@10 -- # set +x 00:25:24.349 12:52:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:24.349 12:52:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:24.349 12:52:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:24.349 12:52:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:24.349 12:52:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:24.349 12:52:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:24.349 12:52:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:24.349 12:52:56 -- nvmf/common.sh@294 -- # net_devs=() 00:25:24.349 12:52:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:24.349 12:52:56 -- nvmf/common.sh@295 -- # e810=() 00:25:24.349 12:52:56 -- nvmf/common.sh@295 -- # local -ga e810 00:25:24.349 12:52:56 -- nvmf/common.sh@296 -- # x722=() 00:25:24.349 12:52:56 -- nvmf/common.sh@296 -- # local -ga x722 00:25:24.349 12:52:56 -- nvmf/common.sh@297 -- # mlx=() 00:25:24.349 12:52:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:24.349 12:52:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:24.349 12:52:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:24.349 12:52:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:24.349 12:52:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:24.350 12:52:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:24.350 12:52:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.350 12:52:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:24.350 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:24.350 12:52:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.350 12:52:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:24.350 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:24.350 12:52:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:24.350 12:52:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.350 12:52:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.350 12:52:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.350 12:52:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.350 12:52:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:24.350 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:24.350 12:52:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.350 12:52:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.350 12:52:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.350 12:52:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.350 12:52:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.350 12:52:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:24.350 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:24.350 12:52:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.350 12:52:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:24.350 12:52:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:24.350 12:52:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:24.350 12:52:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:24.350 12:52:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:24.350 12:52:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:24.350 12:52:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:24.350 12:52:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:24.350 12:52:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:24.350 12:52:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:24.350 12:52:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:24.350 12:52:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:24.350 12:52:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:24.350 12:52:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:24.350 12:52:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:24.350 12:52:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:24.350 12:52:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:24.350 12:52:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:24.350 12:52:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:24.350 12:52:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:24.350 12:52:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:24.350 12:52:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:24.350 12:52:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:24.350 12:52:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:24.350 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:24.350 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.316 ms 00:25:24.350 00:25:24.350 --- 10.0.0.2 ping statistics --- 00:25:24.350 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.350 rtt min/avg/max/mdev = 0.316/0.316/0.316/0.000 ms 00:25:24.350 12:52:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:24.350 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:24.350 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:25:24.350 00:25:24.350 --- 10.0.0.1 ping statistics --- 00:25:24.350 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.350 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:25:24.350 12:52:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:24.350 12:52:57 -- nvmf/common.sh@410 -- # return 0 00:25:24.350 12:52:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:24.350 12:52:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:24.350 12:52:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:24.350 12:52:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:24.350 12:52:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:24.350 12:52:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:24.350 12:52:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:24.350 12:52:57 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:24.350 12:52:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:24.350 12:52:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:24.350 12:52:57 -- common/autotest_common.sh@10 -- # set +x 00:25:24.350 12:52:57 -- nvmf/common.sh@469 -- # nvmfpid=3625972 00:25:24.350 12:52:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:24.350 12:52:57 -- nvmf/common.sh@470 -- # waitforlisten 3625972 00:25:24.350 12:52:57 -- common/autotest_common.sh@829 -- # '[' -z 3625972 ']' 00:25:24.350 12:52:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:24.350 12:52:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.350 12:52:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:24.350 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:24.350 12:52:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.350 12:52:57 -- common/autotest_common.sh@10 -- # set +x 00:25:24.350 [2024-11-20 12:52:57.089091] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:24.350 [2024-11-20 12:52:57.089162] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:24.350 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.350 [2024-11-20 12:52:57.150223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:24.350 [2024-11-20 12:52:57.258600] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:24.350 [2024-11-20 12:52:57.258767] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:24.350 [2024-11-20 12:52:57.258786] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:24.350 [2024-11-20 12:52:57.258799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:24.350 [2024-11-20 12:52:57.258827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:25.287 12:52:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:25.287 12:52:58 -- common/autotest_common.sh@862 -- # return 0 00:25:25.287 12:52:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:25.287 12:52:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 12:52:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:25.287 12:52:58 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:25.287 12:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 [2024-11-20 12:52:58.114881] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:25.287 12:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.287 12:52:58 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:25.287 12:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 [2024-11-20 12:52:58.123082] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:25.287 12:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.287 12:52:58 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:25.287 12:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 null0 00:25:25.287 12:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.287 12:52:58 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:25.287 12:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 null1 00:25:25.287 12:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.287 12:52:58 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:25.287 12:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 12:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.287 12:52:58 -- host/discovery.sh@45 -- # hostpid=3626125 00:25:25.287 12:52:58 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:25.287 12:52:58 -- host/discovery.sh@46 -- # waitforlisten 3626125 /tmp/host.sock 00:25:25.287 12:52:58 -- common/autotest_common.sh@829 -- # '[' -z 3626125 ']' 00:25:25.287 12:52:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:25.287 12:52:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.287 12:52:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:25.287 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:25.287 12:52:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.287 12:52:58 -- common/autotest_common.sh@10 -- # set +x 00:25:25.287 [2024-11-20 12:52:58.192152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:25.287 [2024-11-20 12:52:58.192233] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3626125 ] 00:25:25.287 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.287 [2024-11-20 12:52:58.252805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:25.287 [2024-11-20 12:52:58.366490] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:25.287 [2024-11-20 12:52:58.366672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:26.224 12:52:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.224 12:52:59 -- common/autotest_common.sh@862 -- # return 0 00:25:26.224 12:52:59 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:26.224 12:52:59 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:26.224 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.224 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.224 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.224 12:52:59 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:26.224 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.224 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.224 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.224 12:52:59 -- host/discovery.sh@72 -- # notify_id=0 00:25:26.224 12:52:59 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:26.224 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:26.224 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # sort 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # xargs 00:25:26.224 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.224 12:52:59 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:26.224 12:52:59 -- host/discovery.sh@79 -- # get_bdev_list 00:25:26.224 12:52:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:26.224 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.224 12:52:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:26.224 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.224 12:52:59 -- host/discovery.sh@55 -- # sort 00:25:26.224 12:52:59 -- host/discovery.sh@55 -- # xargs 00:25:26.224 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.224 12:52:59 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:26.224 12:52:59 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:26.224 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.224 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.224 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.224 12:52:59 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:26.224 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.224 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # sort 00:25:26.224 12:52:59 -- host/discovery.sh@59 -- # xargs 00:25:26.224 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.482 12:52:59 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:26.482 12:52:59 -- host/discovery.sh@83 -- # get_bdev_list 00:25:26.482 12:52:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:26.482 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.482 12:52:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:26.482 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.482 12:52:59 -- host/discovery.sh@55 -- # sort 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # xargs 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:26.483 12:52:59 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # sort 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # xargs 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:26.483 12:52:59 -- host/discovery.sh@87 -- # get_bdev_list 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # sort 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # xargs 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:26.483 12:52:59 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 [2024-11-20 12:52:59.474794] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # sort 00:25:26.483 12:52:59 -- host/discovery.sh@59 -- # xargs 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:26.483 12:52:59 -- host/discovery.sh@93 -- # get_bdev_list 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # sort 00:25:26.483 12:52:59 -- host/discovery.sh@55 -- # xargs 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.483 12:52:59 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:26.483 12:52:59 -- host/discovery.sh@94 -- # get_notification_count 00:25:26.483 12:52:59 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:26.483 12:52:59 -- host/discovery.sh@74 -- # jq '. | length' 00:25:26.483 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.483 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.483 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.742 12:52:59 -- host/discovery.sh@74 -- # notification_count=0 00:25:26.742 12:52:59 -- host/discovery.sh@75 -- # notify_id=0 00:25:26.742 12:52:59 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:26.742 12:52:59 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:26.742 12:52:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.742 12:52:59 -- common/autotest_common.sh@10 -- # set +x 00:25:26.742 12:52:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.742 12:52:59 -- host/discovery.sh@100 -- # sleep 1 00:25:27.313 [2024-11-20 12:53:00.264224] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:27.313 [2024-11-20 12:53:00.264268] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:27.313 [2024-11-20 12:53:00.264298] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:27.313 [2024-11-20 12:53:00.351584] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:27.572 [2024-11-20 12:53:00.576865] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:27.572 [2024-11-20 12:53:00.576893] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:27.572 12:53:00 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:27.572 12:53:00 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:27.572 12:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.572 12:53:00 -- common/autotest_common.sh@10 -- # set +x 00:25:27.572 12:53:00 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:27.572 12:53:00 -- host/discovery.sh@59 -- # sort 00:25:27.572 12:53:00 -- host/discovery.sh@59 -- # xargs 00:25:27.572 12:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.572 12:53:00 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:27.572 12:53:00 -- host/discovery.sh@102 -- # get_bdev_list 00:25:27.572 12:53:00 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:27.572 12:53:00 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:27.572 12:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.572 12:53:00 -- common/autotest_common.sh@10 -- # set +x 00:25:27.572 12:53:00 -- host/discovery.sh@55 -- # sort 00:25:27.572 12:53:00 -- host/discovery.sh@55 -- # xargs 00:25:27.572 12:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.830 12:53:00 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:27.830 12:53:00 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:27.830 12:53:00 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:27.830 12:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.830 12:53:00 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:27.830 12:53:00 -- common/autotest_common.sh@10 -- # set +x 00:25:27.830 12:53:00 -- host/discovery.sh@63 -- # sort -n 00:25:27.830 12:53:00 -- host/discovery.sh@63 -- # xargs 00:25:27.830 12:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.831 12:53:00 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:27.831 12:53:00 -- host/discovery.sh@104 -- # get_notification_count 00:25:27.831 12:53:00 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:27.831 12:53:00 -- host/discovery.sh@74 -- # jq '. | length' 00:25:27.831 12:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.831 12:53:00 -- common/autotest_common.sh@10 -- # set +x 00:25:27.831 12:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.831 12:53:00 -- host/discovery.sh@74 -- # notification_count=1 00:25:27.831 12:53:00 -- host/discovery.sh@75 -- # notify_id=1 00:25:27.831 12:53:00 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:27.831 12:53:00 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:27.831 12:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.831 12:53:00 -- common/autotest_common.sh@10 -- # set +x 00:25:27.831 12:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.831 12:53:00 -- host/discovery.sh@109 -- # sleep 1 00:25:28.770 12:53:01 -- host/discovery.sh@110 -- # get_bdev_list 00:25:28.770 12:53:01 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:28.770 12:53:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.770 12:53:01 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:28.770 12:53:01 -- common/autotest_common.sh@10 -- # set +x 00:25:28.770 12:53:01 -- host/discovery.sh@55 -- # sort 00:25:28.770 12:53:01 -- host/discovery.sh@55 -- # xargs 00:25:28.770 12:53:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.770 12:53:01 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:28.770 12:53:01 -- host/discovery.sh@111 -- # get_notification_count 00:25:28.770 12:53:01 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:28.770 12:53:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.770 12:53:01 -- host/discovery.sh@74 -- # jq '. | length' 00:25:28.770 12:53:01 -- common/autotest_common.sh@10 -- # set +x 00:25:28.770 12:53:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.770 12:53:01 -- host/discovery.sh@74 -- # notification_count=1 00:25:28.770 12:53:01 -- host/discovery.sh@75 -- # notify_id=2 00:25:28.770 12:53:01 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:28.770 12:53:01 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:28.770 12:53:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.770 12:53:01 -- common/autotest_common.sh@10 -- # set +x 00:25:29.030 [2024-11-20 12:53:01.878184] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:29.030 [2024-11-20 12:53:01.878631] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:29.030 [2024-11-20 12:53:01.878669] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:29.030 12:53:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.030 12:53:01 -- host/discovery.sh@117 -- # sleep 1 00:25:29.030 [2024-11-20 12:53:02.005056] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:29.289 [2024-11-20 12:53:02.305493] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:29.289 [2024-11-20 12:53:02.305514] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:29.289 [2024-11-20 12:53:02.305523] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:29.855 12:53:02 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:29.855 12:53:02 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:29.855 12:53:02 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:29.855 12:53:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.855 12:53:02 -- host/discovery.sh@59 -- # sort 00:25:29.855 12:53:02 -- common/autotest_common.sh@10 -- # set +x 00:25:29.855 12:53:02 -- host/discovery.sh@59 -- # xargs 00:25:29.855 12:53:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.855 12:53:02 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:29.855 12:53:02 -- host/discovery.sh@119 -- # get_bdev_list 00:25:29.855 12:53:02 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:29.855 12:53:02 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:29.855 12:53:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.855 12:53:02 -- common/autotest_common.sh@10 -- # set +x 00:25:29.855 12:53:02 -- host/discovery.sh@55 -- # sort 00:25:29.855 12:53:02 -- host/discovery.sh@55 -- # xargs 00:25:29.855 12:53:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.119 12:53:02 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:30.119 12:53:02 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:30.119 12:53:02 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:30.119 12:53:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.119 12:53:02 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:30.119 12:53:02 -- common/autotest_common.sh@10 -- # set +x 00:25:30.119 12:53:02 -- host/discovery.sh@63 -- # sort -n 00:25:30.119 12:53:02 -- host/discovery.sh@63 -- # xargs 00:25:30.119 12:53:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.119 12:53:03 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:30.119 12:53:03 -- host/discovery.sh@121 -- # get_notification_count 00:25:30.119 12:53:03 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:30.119 12:53:03 -- host/discovery.sh@74 -- # jq '. | length' 00:25:30.119 12:53:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.119 12:53:03 -- common/autotest_common.sh@10 -- # set +x 00:25:30.119 12:53:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.119 12:53:03 -- host/discovery.sh@74 -- # notification_count=0 00:25:30.119 12:53:03 -- host/discovery.sh@75 -- # notify_id=2 00:25:30.119 12:53:03 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:30.119 12:53:03 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:30.119 12:53:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.119 12:53:03 -- common/autotest_common.sh@10 -- # set +x 00:25:30.119 [2024-11-20 12:53:03.061924] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:30.119 [2024-11-20 12:53:03.061965] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:30.119 12:53:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.119 12:53:03 -- host/discovery.sh@127 -- # sleep 1 00:25:30.119 [2024-11-20 12:53:03.070244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.119 [2024-11-20 12:53:03.070280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.119 [2024-11-20 12:53:03.070298] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.119 [2024-11-20 12:53:03.070312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.119 [2024-11-20 12:53:03.070326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.119 [2024-11-20 12:53:03.070339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.119 [2024-11-20 12:53:03.070354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.119 [2024-11-20 12:53:03.070367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.119 [2024-11-20 12:53:03.070384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.119 [2024-11-20 12:53:03.080233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.119 [2024-11-20 12:53:03.090280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:30.119 [2024-11-20 12:53:03.090558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.090696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.090722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c9e810 with addr=10.0.0.2, port=4420 00:25:30.119 [2024-11-20 12:53:03.090739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.119 [2024-11-20 12:53:03.090762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.119 [2024-11-20 12:53:03.090784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:30.119 [2024-11-20 12:53:03.090798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:30.119 [2024-11-20 12:53:03.090814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:30.119 [2024-11-20 12:53:03.090834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:30.119 [2024-11-20 12:53:03.100374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:30.119 [2024-11-20 12:53:03.100566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.100700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.100737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c9e810 with addr=10.0.0.2, port=4420 00:25:30.119 [2024-11-20 12:53:03.100752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.119 [2024-11-20 12:53:03.100774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.119 [2024-11-20 12:53:03.100794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:30.119 [2024-11-20 12:53:03.100808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:30.119 [2024-11-20 12:53:03.100820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:30.119 [2024-11-20 12:53:03.100839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:30.119 [2024-11-20 12:53:03.110444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:30.119 [2024-11-20 12:53:03.110671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.110821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.110846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c9e810 with addr=10.0.0.2, port=4420 00:25:30.119 [2024-11-20 12:53:03.110862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.119 [2024-11-20 12:53:03.110883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.119 [2024-11-20 12:53:03.110904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:30.119 [2024-11-20 12:53:03.110918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:30.119 [2024-11-20 12:53:03.110930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:30.119 [2024-11-20 12:53:03.110955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:30.119 [2024-11-20 12:53:03.120533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:30.119 [2024-11-20 12:53:03.120736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.120875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.119 [2024-11-20 12:53:03.120900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c9e810 with addr=10.0.0.2, port=4420 00:25:30.120 [2024-11-20 12:53:03.120915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.120 [2024-11-20 12:53:03.120937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.120 [2024-11-20 12:53:03.120956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:30.120 [2024-11-20 12:53:03.120969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:30.120 [2024-11-20 12:53:03.120982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:30.120 [2024-11-20 12:53:03.121000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:30.120 [2024-11-20 12:53:03.130616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:30.120 [2024-11-20 12:53:03.130836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.120 [2024-11-20 12:53:03.130963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.120 [2024-11-20 12:53:03.130989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c9e810 with addr=10.0.0.2, port=4420 00:25:30.120 [2024-11-20 12:53:03.131004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.120 [2024-11-20 12:53:03.131025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.120 [2024-11-20 12:53:03.131045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:30.120 [2024-11-20 12:53:03.131078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:30.120 [2024-11-20 12:53:03.131092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:30.120 [2024-11-20 12:53:03.131111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:30.120 [2024-11-20 12:53:03.140703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:30.120 [2024-11-20 12:53:03.140905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.120 [2024-11-20 12:53:03.141045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:30.120 [2024-11-20 12:53:03.141082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c9e810 with addr=10.0.0.2, port=4420 00:25:30.120 [2024-11-20 12:53:03.141107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c9e810 is same with the state(5) to be set 00:25:30.120 [2024-11-20 12:53:03.141130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c9e810 (9): Bad file descriptor 00:25:30.120 [2024-11-20 12:53:03.141150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:30.120 [2024-11-20 12:53:03.141163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:30.120 [2024-11-20 12:53:03.141176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:30.120 [2024-11-20 12:53:03.141195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:30.120 [2024-11-20 12:53:03.149257] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:30.120 [2024-11-20 12:53:03.149288] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:31.083 12:53:04 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:31.083 12:53:04 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:31.083 12:53:04 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:31.083 12:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.083 12:53:04 -- common/autotest_common.sh@10 -- # set +x 00:25:31.083 12:53:04 -- host/discovery.sh@59 -- # sort 00:25:31.083 12:53:04 -- host/discovery.sh@59 -- # xargs 00:25:31.083 12:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.083 12:53:04 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:31.083 12:53:04 -- host/discovery.sh@129 -- # get_bdev_list 00:25:31.083 12:53:04 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:31.083 12:53:04 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:31.083 12:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.083 12:53:04 -- host/discovery.sh@55 -- # sort 00:25:31.083 12:53:04 -- common/autotest_common.sh@10 -- # set +x 00:25:31.083 12:53:04 -- host/discovery.sh@55 -- # xargs 00:25:31.083 12:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.083 12:53:04 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:31.083 12:53:04 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:31.083 12:53:04 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:31.083 12:53:04 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:31.083 12:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.083 12:53:04 -- common/autotest_common.sh@10 -- # set +x 00:25:31.083 12:53:04 -- host/discovery.sh@63 -- # sort -n 00:25:31.083 12:53:04 -- host/discovery.sh@63 -- # xargs 00:25:31.083 12:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.341 12:53:04 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:31.341 12:53:04 -- host/discovery.sh@131 -- # get_notification_count 00:25:31.341 12:53:04 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:31.341 12:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.341 12:53:04 -- host/discovery.sh@74 -- # jq '. | length' 00:25:31.341 12:53:04 -- common/autotest_common.sh@10 -- # set +x 00:25:31.341 12:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.341 12:53:04 -- host/discovery.sh@74 -- # notification_count=0 00:25:31.341 12:53:04 -- host/discovery.sh@75 -- # notify_id=2 00:25:31.341 12:53:04 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:31.342 12:53:04 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:31.342 12:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.342 12:53:04 -- common/autotest_common.sh@10 -- # set +x 00:25:31.342 12:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.342 12:53:04 -- host/discovery.sh@135 -- # sleep 1 00:25:32.277 12:53:05 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:32.277 12:53:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:32.277 12:53:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:32.277 12:53:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.277 12:53:05 -- common/autotest_common.sh@10 -- # set +x 00:25:32.277 12:53:05 -- host/discovery.sh@59 -- # sort 00:25:32.277 12:53:05 -- host/discovery.sh@59 -- # xargs 00:25:32.277 12:53:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.277 12:53:05 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:32.277 12:53:05 -- host/discovery.sh@137 -- # get_bdev_list 00:25:32.277 12:53:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:32.277 12:53:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:32.277 12:53:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.277 12:53:05 -- host/discovery.sh@55 -- # sort 00:25:32.277 12:53:05 -- common/autotest_common.sh@10 -- # set +x 00:25:32.277 12:53:05 -- host/discovery.sh@55 -- # xargs 00:25:32.277 12:53:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.277 12:53:05 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:32.277 12:53:05 -- host/discovery.sh@138 -- # get_notification_count 00:25:32.277 12:53:05 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:32.277 12:53:05 -- host/discovery.sh@74 -- # jq '. | length' 00:25:32.277 12:53:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.277 12:53:05 -- common/autotest_common.sh@10 -- # set +x 00:25:32.277 12:53:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.277 12:53:05 -- host/discovery.sh@74 -- # notification_count=2 00:25:32.277 12:53:05 -- host/discovery.sh@75 -- # notify_id=4 00:25:32.277 12:53:05 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:32.277 12:53:05 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:32.277 12:53:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.277 12:53:05 -- common/autotest_common.sh@10 -- # set +x 00:25:33.656 [2024-11-20 12:53:06.440739] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:33.656 [2024-11-20 12:53:06.440767] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:33.656 [2024-11-20 12:53:06.440793] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:33.656 [2024-11-20 12:53:06.568217] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:33.656 [2024-11-20 12:53:06.635309] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:33.656 [2024-11-20 12:53:06.635343] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:33.656 12:53:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.656 12:53:06 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:33.656 12:53:06 -- common/autotest_common.sh@650 -- # local es=0 00:25:33.656 12:53:06 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:33.656 12:53:06 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:33.656 12:53:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:33.656 12:53:06 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:33.656 12:53:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:33.656 12:53:06 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:33.656 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.656 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:33.656 request: 00:25:33.656 { 00:25:33.656 "name": "nvme", 00:25:33.656 "trtype": "tcp", 00:25:33.656 "traddr": "10.0.0.2", 00:25:33.656 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:33.656 "adrfam": "ipv4", 00:25:33.656 "trsvcid": "8009", 00:25:33.656 "wait_for_attach": true, 00:25:33.656 "method": "bdev_nvme_start_discovery", 00:25:33.656 "req_id": 1 00:25:33.656 } 00:25:33.656 Got JSON-RPC error response 00:25:33.656 response: 00:25:33.656 { 00:25:33.656 "code": -17, 00:25:33.656 "message": "File exists" 00:25:33.656 } 00:25:33.656 12:53:06 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:33.656 12:53:06 -- common/autotest_common.sh@653 -- # es=1 00:25:33.656 12:53:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:33.656 12:53:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:33.656 12:53:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:33.656 12:53:06 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:33.656 12:53:06 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:33.656 12:53:06 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:33.656 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.656 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:33.656 12:53:06 -- host/discovery.sh@67 -- # sort 00:25:33.656 12:53:06 -- host/discovery.sh@67 -- # xargs 00:25:33.656 12:53:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.656 12:53:06 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:33.656 12:53:06 -- host/discovery.sh@147 -- # get_bdev_list 00:25:33.656 12:53:06 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:33.656 12:53:06 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:33.656 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.656 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:33.656 12:53:06 -- host/discovery.sh@55 -- # sort 00:25:33.656 12:53:06 -- host/discovery.sh@55 -- # xargs 00:25:33.656 12:53:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.656 12:53:06 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:33.656 12:53:06 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:33.656 12:53:06 -- common/autotest_common.sh@650 -- # local es=0 00:25:33.656 12:53:06 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:33.656 12:53:06 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:33.656 12:53:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:33.656 12:53:06 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:33.656 12:53:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:33.656 12:53:06 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:33.656 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.656 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:33.656 request: 00:25:33.656 { 00:25:33.656 "name": "nvme_second", 00:25:33.656 "trtype": "tcp", 00:25:33.656 "traddr": "10.0.0.2", 00:25:33.656 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:33.656 "adrfam": "ipv4", 00:25:33.656 "trsvcid": "8009", 00:25:33.656 "wait_for_attach": true, 00:25:33.656 "method": "bdev_nvme_start_discovery", 00:25:33.656 "req_id": 1 00:25:33.656 } 00:25:33.656 Got JSON-RPC error response 00:25:33.656 response: 00:25:33.656 { 00:25:33.656 "code": -17, 00:25:33.656 "message": "File exists" 00:25:33.656 } 00:25:33.656 12:53:06 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:33.656 12:53:06 -- common/autotest_common.sh@653 -- # es=1 00:25:33.656 12:53:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:33.656 12:53:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:33.656 12:53:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:33.657 12:53:06 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:33.657 12:53:06 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:33.657 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.657 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:33.657 12:53:06 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:33.657 12:53:06 -- host/discovery.sh@67 -- # sort 00:25:33.657 12:53:06 -- host/discovery.sh@67 -- # xargs 00:25:33.657 12:53:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.916 12:53:06 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:33.916 12:53:06 -- host/discovery.sh@153 -- # get_bdev_list 00:25:33.916 12:53:06 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:33.916 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.916 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:33.916 12:53:06 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:33.916 12:53:06 -- host/discovery.sh@55 -- # sort 00:25:33.916 12:53:06 -- host/discovery.sh@55 -- # xargs 00:25:33.916 12:53:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.916 12:53:06 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:33.916 12:53:06 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:33.916 12:53:06 -- common/autotest_common.sh@650 -- # local es=0 00:25:33.916 12:53:06 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:33.916 12:53:06 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:33.916 12:53:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:33.916 12:53:06 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:33.916 12:53:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:33.916 12:53:06 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:33.916 12:53:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.917 12:53:06 -- common/autotest_common.sh@10 -- # set +x 00:25:34.855 [2024-11-20 12:53:07.831582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.855 [2024-11-20 12:53:07.831765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.855 [2024-11-20 12:53:07.831795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cc23d0 with addr=10.0.0.2, port=8010 00:25:34.855 [2024-11-20 12:53:07.831821] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:34.855 [2024-11-20 12:53:07.831837] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:34.855 [2024-11-20 12:53:07.831851] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:35.803 [2024-11-20 12:53:08.834001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:35.803 [2024-11-20 12:53:08.834187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:35.803 [2024-11-20 12:53:08.834214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c8ed30 with addr=10.0.0.2, port=8010 00:25:35.803 [2024-11-20 12:53:08.834233] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:35.803 [2024-11-20 12:53:08.834246] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:35.803 [2024-11-20 12:53:08.834257] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:36.741 [2024-11-20 12:53:09.836266] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:36.741 request: 00:25:36.741 { 00:25:36.741 "name": "nvme_second", 00:25:36.741 "trtype": "tcp", 00:25:36.741 "traddr": "10.0.0.2", 00:25:36.741 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:36.741 "adrfam": "ipv4", 00:25:36.741 "trsvcid": "8010", 00:25:36.741 "attach_timeout_ms": 3000, 00:25:36.741 "method": "bdev_nvme_start_discovery", 00:25:36.741 "req_id": 1 00:25:36.741 } 00:25:36.741 Got JSON-RPC error response 00:25:36.741 response: 00:25:36.741 { 00:25:36.741 "code": -110, 00:25:36.741 "message": "Connection timed out" 00:25:36.741 } 00:25:36.741 12:53:09 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:36.741 12:53:09 -- common/autotest_common.sh@653 -- # es=1 00:25:36.741 12:53:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:36.741 12:53:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:36.741 12:53:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:36.741 12:53:09 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:36.741 12:53:09 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:36.741 12:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:36.741 12:53:09 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:36.741 12:53:09 -- common/autotest_common.sh@10 -- # set +x 00:25:36.741 12:53:09 -- host/discovery.sh@67 -- # sort 00:25:36.741 12:53:09 -- host/discovery.sh@67 -- # xargs 00:25:36.999 12:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:36.999 12:53:09 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:36.999 12:53:09 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:36.999 12:53:09 -- host/discovery.sh@162 -- # kill 3626125 00:25:36.999 12:53:09 -- host/discovery.sh@163 -- # nvmftestfini 00:25:36.999 12:53:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:36.999 12:53:09 -- nvmf/common.sh@116 -- # sync 00:25:36.999 12:53:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:36.999 12:53:09 -- nvmf/common.sh@119 -- # set +e 00:25:36.999 12:53:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:36.999 12:53:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:36.999 rmmod nvme_tcp 00:25:36.999 rmmod nvme_fabrics 00:25:36.999 rmmod nvme_keyring 00:25:36.999 12:53:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:36.999 12:53:09 -- nvmf/common.sh@123 -- # set -e 00:25:36.999 12:53:09 -- nvmf/common.sh@124 -- # return 0 00:25:36.999 12:53:09 -- nvmf/common.sh@477 -- # '[' -n 3625972 ']' 00:25:36.999 12:53:09 -- nvmf/common.sh@478 -- # killprocess 3625972 00:25:36.999 12:53:09 -- common/autotest_common.sh@936 -- # '[' -z 3625972 ']' 00:25:36.999 12:53:09 -- common/autotest_common.sh@940 -- # kill -0 3625972 00:25:36.999 12:53:09 -- common/autotest_common.sh@941 -- # uname 00:25:36.999 12:53:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:36.999 12:53:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3625972 00:25:36.999 12:53:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:36.999 12:53:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:36.999 12:53:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3625972' 00:25:36.999 killing process with pid 3625972 00:25:36.999 12:53:09 -- common/autotest_common.sh@955 -- # kill 3625972 00:25:36.999 12:53:09 -- common/autotest_common.sh@960 -- # wait 3625972 00:25:37.257 12:53:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:37.257 12:53:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:37.257 12:53:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:37.257 12:53:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:37.257 12:53:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:37.257 12:53:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:37.257 12:53:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:37.257 12:53:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:39.799 12:53:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:39.799 00:25:39.799 real 0m17.652s 00:25:39.799 user 0m27.279s 00:25:39.799 sys 0m3.001s 00:25:39.799 12:53:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:39.799 12:53:12 -- common/autotest_common.sh@10 -- # set +x 00:25:39.799 ************************************ 00:25:39.799 END TEST nvmf_discovery 00:25:39.799 ************************************ 00:25:39.799 12:53:12 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:39.799 12:53:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:39.799 12:53:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:39.799 12:53:12 -- common/autotest_common.sh@10 -- # set +x 00:25:39.799 ************************************ 00:25:39.799 START TEST nvmf_discovery_remove_ifc 00:25:39.799 ************************************ 00:25:39.799 12:53:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:39.799 * Looking for test storage... 00:25:39.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:39.799 12:53:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:39.799 12:53:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:39.799 12:53:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:39.799 12:53:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:39.799 12:53:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:39.799 12:53:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:39.799 12:53:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:39.799 12:53:12 -- scripts/common.sh@335 -- # IFS=.-: 00:25:39.799 12:53:12 -- scripts/common.sh@335 -- # read -ra ver1 00:25:39.799 12:53:12 -- scripts/common.sh@336 -- # IFS=.-: 00:25:39.799 12:53:12 -- scripts/common.sh@336 -- # read -ra ver2 00:25:39.799 12:53:12 -- scripts/common.sh@337 -- # local 'op=<' 00:25:39.799 12:53:12 -- scripts/common.sh@339 -- # ver1_l=2 00:25:39.799 12:53:12 -- scripts/common.sh@340 -- # ver2_l=1 00:25:39.799 12:53:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:39.799 12:53:12 -- scripts/common.sh@343 -- # case "$op" in 00:25:39.799 12:53:12 -- scripts/common.sh@344 -- # : 1 00:25:39.799 12:53:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:39.799 12:53:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:39.799 12:53:12 -- scripts/common.sh@364 -- # decimal 1 00:25:39.799 12:53:12 -- scripts/common.sh@352 -- # local d=1 00:25:39.799 12:53:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:39.799 12:53:12 -- scripts/common.sh@354 -- # echo 1 00:25:39.799 12:53:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:39.799 12:53:12 -- scripts/common.sh@365 -- # decimal 2 00:25:39.799 12:53:12 -- scripts/common.sh@352 -- # local d=2 00:25:39.799 12:53:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:39.799 12:53:12 -- scripts/common.sh@354 -- # echo 2 00:25:39.799 12:53:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:39.799 12:53:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:39.799 12:53:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:39.799 12:53:12 -- scripts/common.sh@367 -- # return 0 00:25:39.799 12:53:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:39.799 12:53:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.799 --rc genhtml_branch_coverage=1 00:25:39.799 --rc genhtml_function_coverage=1 00:25:39.799 --rc genhtml_legend=1 00:25:39.799 --rc geninfo_all_blocks=1 00:25:39.799 --rc geninfo_unexecuted_blocks=1 00:25:39.799 00:25:39.799 ' 00:25:39.799 12:53:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.799 --rc genhtml_branch_coverage=1 00:25:39.799 --rc genhtml_function_coverage=1 00:25:39.799 --rc genhtml_legend=1 00:25:39.799 --rc geninfo_all_blocks=1 00:25:39.799 --rc geninfo_unexecuted_blocks=1 00:25:39.799 00:25:39.799 ' 00:25:39.799 12:53:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.799 --rc genhtml_branch_coverage=1 00:25:39.799 --rc genhtml_function_coverage=1 00:25:39.799 --rc genhtml_legend=1 00:25:39.799 --rc geninfo_all_blocks=1 00:25:39.799 --rc geninfo_unexecuted_blocks=1 00:25:39.799 00:25:39.799 ' 00:25:39.799 12:53:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:39.799 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.799 --rc genhtml_branch_coverage=1 00:25:39.799 --rc genhtml_function_coverage=1 00:25:39.799 --rc genhtml_legend=1 00:25:39.799 --rc geninfo_all_blocks=1 00:25:39.799 --rc geninfo_unexecuted_blocks=1 00:25:39.799 00:25:39.799 ' 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:39.799 12:53:12 -- nvmf/common.sh@7 -- # uname -s 00:25:39.799 12:53:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:39.799 12:53:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:39.799 12:53:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:39.799 12:53:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:39.799 12:53:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:39.799 12:53:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:39.799 12:53:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:39.799 12:53:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:39.799 12:53:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:39.799 12:53:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:39.799 12:53:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:39.799 12:53:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:39.799 12:53:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:39.799 12:53:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:39.799 12:53:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:39.799 12:53:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:39.799 12:53:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:39.799 12:53:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:39.799 12:53:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:39.799 12:53:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.799 12:53:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.799 12:53:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.799 12:53:12 -- paths/export.sh@5 -- # export PATH 00:25:39.799 12:53:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.799 12:53:12 -- nvmf/common.sh@46 -- # : 0 00:25:39.799 12:53:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:39.799 12:53:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:39.799 12:53:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:39.799 12:53:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:39.799 12:53:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:39.799 12:53:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:39.799 12:53:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:39.799 12:53:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:25:39.799 12:53:12 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:25:39.799 12:53:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:39.799 12:53:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:39.799 12:53:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:39.799 12:53:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:39.799 12:53:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:39.799 12:53:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.799 12:53:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.799 12:53:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:39.799 12:53:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:39.799 12:53:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:39.799 12:53:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:39.799 12:53:12 -- common/autotest_common.sh@10 -- # set +x 00:25:41.777 12:53:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:41.777 12:53:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:41.777 12:53:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:41.777 12:53:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:41.777 12:53:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:41.777 12:53:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:41.777 12:53:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:41.777 12:53:14 -- nvmf/common.sh@294 -- # net_devs=() 00:25:41.777 12:53:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:41.777 12:53:14 -- nvmf/common.sh@295 -- # e810=() 00:25:41.777 12:53:14 -- nvmf/common.sh@295 -- # local -ga e810 00:25:41.777 12:53:14 -- nvmf/common.sh@296 -- # x722=() 00:25:41.777 12:53:14 -- nvmf/common.sh@296 -- # local -ga x722 00:25:41.777 12:53:14 -- nvmf/common.sh@297 -- # mlx=() 00:25:41.777 12:53:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:41.777 12:53:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:41.777 12:53:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:41.777 12:53:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:41.777 12:53:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:41.777 12:53:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.777 12:53:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:41.777 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:41.777 12:53:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.777 12:53:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:41.777 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:41.777 12:53:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:41.777 12:53:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.777 12:53:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.777 12:53:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.777 12:53:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.777 12:53:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:41.777 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:41.777 12:53:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.777 12:53:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.777 12:53:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.777 12:53:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.777 12:53:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.777 12:53:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:41.777 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:41.777 12:53:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.777 12:53:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:41.777 12:53:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:41.777 12:53:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:41.777 12:53:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:41.777 12:53:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:41.777 12:53:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:41.777 12:53:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:41.777 12:53:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:41.777 12:53:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:41.777 12:53:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:41.777 12:53:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:41.777 12:53:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:41.777 12:53:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:41.777 12:53:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:41.777 12:53:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:41.777 12:53:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:41.777 12:53:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:41.777 12:53:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:41.777 12:53:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:41.777 12:53:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:41.777 12:53:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:41.777 12:53:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:41.777 12:53:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:41.777 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:41.777 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:25:41.777 00:25:41.777 --- 10.0.0.2 ping statistics --- 00:25:41.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.777 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:25:41.777 12:53:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:41.777 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:41.777 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:25:41.777 00:25:41.777 --- 10.0.0.1 ping statistics --- 00:25:41.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.777 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:25:41.777 12:53:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:41.777 12:53:14 -- nvmf/common.sh@410 -- # return 0 00:25:41.777 12:53:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:41.777 12:53:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:41.777 12:53:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:41.777 12:53:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:41.777 12:53:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:41.777 12:53:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:41.778 12:53:14 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:25:41.778 12:53:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:41.778 12:53:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:41.778 12:53:14 -- common/autotest_common.sh@10 -- # set +x 00:25:41.778 12:53:14 -- nvmf/common.sh@469 -- # nvmfpid=3629720 00:25:41.778 12:53:14 -- nvmf/common.sh@470 -- # waitforlisten 3629720 00:25:41.778 12:53:14 -- common/autotest_common.sh@829 -- # '[' -z 3629720 ']' 00:25:41.778 12:53:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:41.778 12:53:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:41.778 12:53:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.778 12:53:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:41.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:41.778 12:53:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.778 12:53:14 -- common/autotest_common.sh@10 -- # set +x 00:25:41.778 [2024-11-20 12:53:14.711280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:41.778 [2024-11-20 12:53:14.711356] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:41.778 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.778 [2024-11-20 12:53:14.781820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:42.036 [2024-11-20 12:53:14.890130] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:42.036 [2024-11-20 12:53:14.890274] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:42.036 [2024-11-20 12:53:14.890290] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:42.036 [2024-11-20 12:53:14.890302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:42.036 [2024-11-20 12:53:14.890329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.602 12:53:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.602 12:53:15 -- common/autotest_common.sh@862 -- # return 0 00:25:42.602 12:53:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:42.602 12:53:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.602 12:53:15 -- common/autotest_common.sh@10 -- # set +x 00:25:42.602 12:53:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:42.602 12:53:15 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:25:42.602 12:53:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.602 12:53:15 -- common/autotest_common.sh@10 -- # set +x 00:25:42.602 [2024-11-20 12:53:15.708584] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:42.860 [2024-11-20 12:53:15.716782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:42.860 null0 00:25:42.860 [2024-11-20 12:53:15.748732] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:42.860 12:53:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.860 12:53:15 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3629879 00:25:42.860 12:53:15 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:25:42.860 12:53:15 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3629879 /tmp/host.sock 00:25:42.860 12:53:15 -- common/autotest_common.sh@829 -- # '[' -z 3629879 ']' 00:25:42.860 12:53:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:42.860 12:53:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:42.860 12:53:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:42.860 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:42.860 12:53:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:42.860 12:53:15 -- common/autotest_common.sh@10 -- # set +x 00:25:42.860 [2024-11-20 12:53:15.808875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:42.860 [2024-11-20 12:53:15.808955] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3629879 ] 00:25:42.860 EAL: No free 2048 kB hugepages reported on node 1 00:25:42.860 [2024-11-20 12:53:15.870451] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:43.120 [2024-11-20 12:53:15.984901] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.120 [2024-11-20 12:53:15.985084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:43.120 12:53:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:43.120 12:53:16 -- common/autotest_common.sh@862 -- # return 0 00:25:43.120 12:53:16 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:43.120 12:53:16 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:25:43.120 12:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.120 12:53:16 -- common/autotest_common.sh@10 -- # set +x 00:25:43.120 12:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.120 12:53:16 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:25:43.120 12:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.120 12:53:16 -- common/autotest_common.sh@10 -- # set +x 00:25:43.120 12:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.120 12:53:16 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:25:43.120 12:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.120 12:53:16 -- common/autotest_common.sh@10 -- # set +x 00:25:44.496 [2024-11-20 12:53:17.186223] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:44.496 [2024-11-20 12:53:17.186253] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:44.496 [2024-11-20 12:53:17.186279] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:44.496 [2024-11-20 12:53:17.272562] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:44.496 [2024-11-20 12:53:17.336942] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:25:44.496 [2024-11-20 12:53:17.336997] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:25:44.496 [2024-11-20 12:53:17.337039] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:25:44.496 [2024-11-20 12:53:17.337064] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:44.496 [2024-11-20 12:53:17.337100] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:44.496 12:53:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:44.496 12:53:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.496 12:53:17 -- common/autotest_common.sh@10 -- # set +x 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:44.496 [2024-11-20 12:53:17.344424] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x24f7d40 was disconnected and freed. delete nvme_qpair. 00:25:44.496 12:53:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:44.496 12:53:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.496 12:53:17 -- common/autotest_common.sh@10 -- # set +x 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:44.496 12:53:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:44.496 12:53:17 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:45.434 12:53:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.434 12:53:18 -- common/autotest_common.sh@10 -- # set +x 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:45.434 12:53:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:45.434 12:53:18 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:46.812 12:53:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:46.812 12:53:19 -- common/autotest_common.sh@10 -- # set +x 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:46.812 12:53:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:46.812 12:53:19 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:47.750 12:53:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.750 12:53:20 -- common/autotest_common.sh@10 -- # set +x 00:25:47.750 12:53:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:47.750 12:53:20 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:48.684 12:53:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:48.684 12:53:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.685 12:53:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:48.685 12:53:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.685 12:53:21 -- common/autotest_common.sh@10 -- # set +x 00:25:48.685 12:53:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:48.685 12:53:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:48.685 12:53:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.685 12:53:21 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:48.685 12:53:21 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:49.622 12:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:49.622 12:53:22 -- common/autotest_common.sh@10 -- # set +x 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:49.622 12:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:49.622 12:53:22 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:49.881 [2024-11-20 12:53:22.778799] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:25:49.881 [2024-11-20 12:53:22.778864] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:49.881 [2024-11-20 12:53:22.778889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:49.881 [2024-11-20 12:53:22.778909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:49.881 [2024-11-20 12:53:22.778924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:49.881 [2024-11-20 12:53:22.778949] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:49.881 [2024-11-20 12:53:22.778965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:49.881 [2024-11-20 12:53:22.778980] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:49.881 [2024-11-20 12:53:22.778995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:49.881 [2024-11-20 12:53:22.779010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:49.881 [2024-11-20 12:53:22.779024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:49.881 [2024-11-20 12:53:22.779039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24be430 is same with the state(5) to be set 00:25:49.881 [2024-11-20 12:53:22.788819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24be430 (9): Bad file descriptor 00:25:49.881 [2024-11-20 12:53:22.798870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:50.815 12:53:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:50.815 12:53:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.815 12:53:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:50.815 12:53:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.816 12:53:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:50.816 12:53:23 -- common/autotest_common.sh@10 -- # set +x 00:25:50.816 12:53:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:50.816 [2024-11-20 12:53:23.839099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:25:52.192 [2024-11-20 12:53:24.863104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:25:52.192 [2024-11-20 12:53:24.863150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x24be430 with addr=10.0.0.2, port=4420 00:25:52.192 [2024-11-20 12:53:24.863173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24be430 is same with the state(5) to be set 00:25:52.192 [2024-11-20 12:53:24.863204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:52.192 [2024-11-20 12:53:24.863222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:52.192 [2024-11-20 12:53:24.863236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:52.192 [2024-11-20 12:53:24.863252] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:25:52.192 [2024-11-20 12:53:24.863618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24be430 (9): Bad file descriptor 00:25:52.192 [2024-11-20 12:53:24.863657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:52.192 [2024-11-20 12:53:24.863700] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:25:52.192 [2024-11-20 12:53:24.863735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.192 [2024-11-20 12:53:24.863758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.192 [2024-11-20 12:53:24.863775] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.192 [2024-11-20 12:53:24.863790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.192 [2024-11-20 12:53:24.863805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.192 [2024-11-20 12:53:24.863826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.192 [2024-11-20 12:53:24.863842] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.192 [2024-11-20 12:53:24.863856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.192 [2024-11-20 12:53:24.863871] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.193 [2024-11-20 12:53:24.863884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.193 [2024-11-20 12:53:24.863899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:25:52.193 [2024-11-20 12:53:24.864206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24be840 (9): Bad file descriptor 00:25:52.193 [2024-11-20 12:53:24.865228] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:25:52.193 [2024-11-20 12:53:24.865249] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:25:52.193 12:53:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.193 12:53:24 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:52.193 12:53:24 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:53.132 12:53:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.132 12:53:25 -- common/autotest_common.sh@10 -- # set +x 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:53.132 12:53:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:53.132 12:53:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:53.132 12:53:25 -- common/autotest_common.sh@10 -- # set +x 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:53.132 12:53:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:25:53.132 12:53:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:54.067 [2024-11-20 12:53:26.921779] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:54.067 [2024-11-20 12:53:26.921802] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:54.067 [2024-11-20 12:53:26.921823] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:54.067 12:53:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:54.067 12:53:27 -- common/autotest_common.sh@10 -- # set +x 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:54.067 12:53:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:25:54.067 12:53:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:54.067 [2024-11-20 12:53:27.049270] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:25:54.328 [2024-11-20 12:53:27.234535] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:25:54.328 [2024-11-20 12:53:27.234589] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:25:54.328 [2024-11-20 12:53:27.234624] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:25:54.328 [2024-11-20 12:53:27.234651] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:25:54.328 [2024-11-20 12:53:27.234666] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:54.328 [2024-11-20 12:53:27.240737] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x24ccef0 was disconnected and freed. delete nvme_qpair. 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:55.265 12:53:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.265 12:53:28 -- common/autotest_common.sh@10 -- # set +x 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:55.265 12:53:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3629879 00:25:55.265 12:53:28 -- common/autotest_common.sh@936 -- # '[' -z 3629879 ']' 00:25:55.265 12:53:28 -- common/autotest_common.sh@940 -- # kill -0 3629879 00:25:55.265 12:53:28 -- common/autotest_common.sh@941 -- # uname 00:25:55.265 12:53:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.265 12:53:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3629879 00:25:55.265 12:53:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:55.265 12:53:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:55.265 12:53:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3629879' 00:25:55.265 killing process with pid 3629879 00:25:55.265 12:53:28 -- common/autotest_common.sh@955 -- # kill 3629879 00:25:55.265 12:53:28 -- common/autotest_common.sh@960 -- # wait 3629879 00:25:55.265 12:53:28 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:25:55.265 12:53:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:55.265 12:53:28 -- nvmf/common.sh@116 -- # sync 00:25:55.523 12:53:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:55.523 12:53:28 -- nvmf/common.sh@119 -- # set +e 00:25:55.523 12:53:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:55.523 12:53:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:55.523 rmmod nvme_tcp 00:25:55.523 rmmod nvme_fabrics 00:25:55.523 rmmod nvme_keyring 00:25:55.523 12:53:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:55.523 12:53:28 -- nvmf/common.sh@123 -- # set -e 00:25:55.523 12:53:28 -- nvmf/common.sh@124 -- # return 0 00:25:55.523 12:53:28 -- nvmf/common.sh@477 -- # '[' -n 3629720 ']' 00:25:55.523 12:53:28 -- nvmf/common.sh@478 -- # killprocess 3629720 00:25:55.523 12:53:28 -- common/autotest_common.sh@936 -- # '[' -z 3629720 ']' 00:25:55.523 12:53:28 -- common/autotest_common.sh@940 -- # kill -0 3629720 00:25:55.523 12:53:28 -- common/autotest_common.sh@941 -- # uname 00:25:55.523 12:53:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.523 12:53:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3629720 00:25:55.523 12:53:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:55.523 12:53:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:55.523 12:53:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3629720' 00:25:55.523 killing process with pid 3629720 00:25:55.523 12:53:28 -- common/autotest_common.sh@955 -- # kill 3629720 00:25:55.523 12:53:28 -- common/autotest_common.sh@960 -- # wait 3629720 00:25:55.781 12:53:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:55.781 12:53:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:55.781 12:53:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:55.781 12:53:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:55.781 12:53:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:55.781 12:53:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.781 12:53:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.781 12:53:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.688 12:53:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:57.688 00:25:57.688 real 0m18.462s 00:25:57.688 user 0m25.541s 00:25:57.688 sys 0m2.959s 00:25:57.688 12:53:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:57.688 12:53:30 -- common/autotest_common.sh@10 -- # set +x 00:25:57.688 ************************************ 00:25:57.688 END TEST nvmf_discovery_remove_ifc 00:25:57.688 ************************************ 00:25:57.948 12:53:30 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:25:57.948 12:53:30 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:25:57.948 12:53:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:57.948 12:53:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:57.948 12:53:30 -- common/autotest_common.sh@10 -- # set +x 00:25:57.948 ************************************ 00:25:57.948 START TEST nvmf_digest 00:25:57.948 ************************************ 00:25:57.948 12:53:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:25:57.948 * Looking for test storage... 00:25:57.948 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:57.948 12:53:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:57.948 12:53:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:57.948 12:53:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:57.948 12:53:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:57.948 12:53:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:57.948 12:53:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:57.948 12:53:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:57.948 12:53:30 -- scripts/common.sh@335 -- # IFS=.-: 00:25:57.948 12:53:30 -- scripts/common.sh@335 -- # read -ra ver1 00:25:57.948 12:53:30 -- scripts/common.sh@336 -- # IFS=.-: 00:25:57.948 12:53:30 -- scripts/common.sh@336 -- # read -ra ver2 00:25:57.948 12:53:30 -- scripts/common.sh@337 -- # local 'op=<' 00:25:57.948 12:53:30 -- scripts/common.sh@339 -- # ver1_l=2 00:25:57.948 12:53:30 -- scripts/common.sh@340 -- # ver2_l=1 00:25:57.948 12:53:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:57.948 12:53:30 -- scripts/common.sh@343 -- # case "$op" in 00:25:57.948 12:53:30 -- scripts/common.sh@344 -- # : 1 00:25:57.948 12:53:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:57.948 12:53:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:57.948 12:53:30 -- scripts/common.sh@364 -- # decimal 1 00:25:57.948 12:53:30 -- scripts/common.sh@352 -- # local d=1 00:25:57.948 12:53:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:57.948 12:53:30 -- scripts/common.sh@354 -- # echo 1 00:25:57.948 12:53:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:57.948 12:53:30 -- scripts/common.sh@365 -- # decimal 2 00:25:57.948 12:53:30 -- scripts/common.sh@352 -- # local d=2 00:25:57.948 12:53:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:57.948 12:53:30 -- scripts/common.sh@354 -- # echo 2 00:25:57.948 12:53:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:57.948 12:53:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:57.948 12:53:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:57.948 12:53:30 -- scripts/common.sh@367 -- # return 0 00:25:57.948 12:53:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:57.948 12:53:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:57.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.948 --rc genhtml_branch_coverage=1 00:25:57.948 --rc genhtml_function_coverage=1 00:25:57.948 --rc genhtml_legend=1 00:25:57.948 --rc geninfo_all_blocks=1 00:25:57.948 --rc geninfo_unexecuted_blocks=1 00:25:57.948 00:25:57.948 ' 00:25:57.948 12:53:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:57.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.948 --rc genhtml_branch_coverage=1 00:25:57.948 --rc genhtml_function_coverage=1 00:25:57.948 --rc genhtml_legend=1 00:25:57.948 --rc geninfo_all_blocks=1 00:25:57.948 --rc geninfo_unexecuted_blocks=1 00:25:57.948 00:25:57.948 ' 00:25:57.948 12:53:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:57.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.948 --rc genhtml_branch_coverage=1 00:25:57.948 --rc genhtml_function_coverage=1 00:25:57.948 --rc genhtml_legend=1 00:25:57.948 --rc geninfo_all_blocks=1 00:25:57.948 --rc geninfo_unexecuted_blocks=1 00:25:57.948 00:25:57.948 ' 00:25:57.948 12:53:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:57.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.948 --rc genhtml_branch_coverage=1 00:25:57.948 --rc genhtml_function_coverage=1 00:25:57.948 --rc genhtml_legend=1 00:25:57.948 --rc geninfo_all_blocks=1 00:25:57.948 --rc geninfo_unexecuted_blocks=1 00:25:57.948 00:25:57.948 ' 00:25:57.948 12:53:30 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:57.948 12:53:30 -- nvmf/common.sh@7 -- # uname -s 00:25:57.948 12:53:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:57.948 12:53:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:57.948 12:53:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:57.948 12:53:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:57.948 12:53:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:57.948 12:53:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:57.948 12:53:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:57.948 12:53:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:57.948 12:53:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:57.948 12:53:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:57.948 12:53:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.948 12:53:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.948 12:53:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:57.948 12:53:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:57.948 12:53:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:57.948 12:53:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:57.948 12:53:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:57.948 12:53:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:57.948 12:53:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:57.948 12:53:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.948 12:53:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.948 12:53:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.948 12:53:30 -- paths/export.sh@5 -- # export PATH 00:25:57.948 12:53:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.948 12:53:30 -- nvmf/common.sh@46 -- # : 0 00:25:57.948 12:53:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:57.948 12:53:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:57.948 12:53:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:57.948 12:53:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:57.948 12:53:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:57.948 12:53:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:57.948 12:53:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:57.948 12:53:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:57.948 12:53:30 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:25:57.948 12:53:30 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:25:57.948 12:53:30 -- host/digest.sh@16 -- # runtime=2 00:25:57.948 12:53:30 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:25:57.948 12:53:30 -- host/digest.sh@132 -- # nvmftestinit 00:25:57.948 12:53:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:57.948 12:53:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:57.949 12:53:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:57.949 12:53:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:57.949 12:53:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:57.949 12:53:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.949 12:53:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.949 12:53:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.949 12:53:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:57.949 12:53:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:57.949 12:53:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:57.949 12:53:30 -- common/autotest_common.sh@10 -- # set +x 00:25:59.853 12:53:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:59.853 12:53:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:59.853 12:53:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:59.853 12:53:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:59.853 12:53:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:59.853 12:53:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:59.853 12:53:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:59.853 12:53:32 -- nvmf/common.sh@294 -- # net_devs=() 00:25:59.853 12:53:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:59.853 12:53:32 -- nvmf/common.sh@295 -- # e810=() 00:25:59.853 12:53:32 -- nvmf/common.sh@295 -- # local -ga e810 00:25:59.853 12:53:32 -- nvmf/common.sh@296 -- # x722=() 00:25:59.853 12:53:32 -- nvmf/common.sh@296 -- # local -ga x722 00:25:59.853 12:53:32 -- nvmf/common.sh@297 -- # mlx=() 00:25:59.853 12:53:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:59.853 12:53:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:59.853 12:53:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:59.854 12:53:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:59.854 12:53:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:59.854 12:53:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.854 12:53:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:59.854 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:59.854 12:53:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.854 12:53:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:59.854 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:59.854 12:53:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:59.854 12:53:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.854 12:53:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.854 12:53:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.854 12:53:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.854 12:53:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:59.854 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:59.854 12:53:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.854 12:53:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.854 12:53:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.854 12:53:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.854 12:53:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.854 12:53:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:59.854 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:59.854 12:53:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.854 12:53:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:59.854 12:53:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:59.854 12:53:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:59.854 12:53:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:59.854 12:53:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:59.854 12:53:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:59.854 12:53:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:59.854 12:53:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:59.854 12:53:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:59.854 12:53:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:59.854 12:53:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:59.854 12:53:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:59.854 12:53:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:59.854 12:53:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:59.854 12:53:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:59.854 12:53:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:59.854 12:53:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:59.854 12:53:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:59.854 12:53:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:00.114 12:53:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:00.114 12:53:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:00.114 12:53:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:00.114 12:53:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:00.114 12:53:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:00.114 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:00.114 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:26:00.114 00:26:00.114 --- 10.0.0.2 ping statistics --- 00:26:00.114 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:00.114 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:26:00.114 12:53:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:00.114 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:00.114 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:26:00.114 00:26:00.114 --- 10.0.0.1 ping statistics --- 00:26:00.114 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:00.114 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:26:00.114 12:53:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:00.115 12:53:33 -- nvmf/common.sh@410 -- # return 0 00:26:00.115 12:53:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:00.115 12:53:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:00.115 12:53:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:00.115 12:53:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:00.115 12:53:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:00.115 12:53:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:00.115 12:53:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:00.115 12:53:33 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:00.115 12:53:33 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:00.115 12:53:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:00.115 12:53:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:00.115 12:53:33 -- common/autotest_common.sh@10 -- # set +x 00:26:00.115 ************************************ 00:26:00.115 START TEST nvmf_digest_clean 00:26:00.115 ************************************ 00:26:00.115 12:53:33 -- common/autotest_common.sh@1114 -- # run_digest 00:26:00.115 12:53:33 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:00.115 12:53:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:00.115 12:53:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:00.115 12:53:33 -- common/autotest_common.sh@10 -- # set +x 00:26:00.115 12:53:33 -- nvmf/common.sh@469 -- # nvmfpid=3633408 00:26:00.115 12:53:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:00.115 12:53:33 -- nvmf/common.sh@470 -- # waitforlisten 3633408 00:26:00.115 12:53:33 -- common/autotest_common.sh@829 -- # '[' -z 3633408 ']' 00:26:00.115 12:53:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:00.115 12:53:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:00.115 12:53:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:00.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:00.115 12:53:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:00.115 12:53:33 -- common/autotest_common.sh@10 -- # set +x 00:26:00.115 [2024-11-20 12:53:33.100842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:00.115 [2024-11-20 12:53:33.100935] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:00.115 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.115 [2024-11-20 12:53:33.166366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:00.375 [2024-11-20 12:53:33.275814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:00.375 [2024-11-20 12:53:33.275981] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:00.375 [2024-11-20 12:53:33.275997] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:00.375 [2024-11-20 12:53:33.276009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:00.375 [2024-11-20 12:53:33.276050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.375 12:53:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.375 12:53:33 -- common/autotest_common.sh@862 -- # return 0 00:26:00.375 12:53:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:00.375 12:53:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:00.375 12:53:33 -- common/autotest_common.sh@10 -- # set +x 00:26:00.375 12:53:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:00.375 12:53:33 -- host/digest.sh@120 -- # common_target_config 00:26:00.375 12:53:33 -- host/digest.sh@43 -- # rpc_cmd 00:26:00.375 12:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.375 12:53:33 -- common/autotest_common.sh@10 -- # set +x 00:26:00.375 null0 00:26:00.375 [2024-11-20 12:53:33.459774] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:00.634 [2024-11-20 12:53:33.484058] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:00.634 12:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.634 12:53:33 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:00.634 12:53:33 -- host/digest.sh@77 -- # local rw bs qd 00:26:00.634 12:53:33 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:00.634 12:53:33 -- host/digest.sh@80 -- # rw=randread 00:26:00.634 12:53:33 -- host/digest.sh@80 -- # bs=4096 00:26:00.634 12:53:33 -- host/digest.sh@80 -- # qd=128 00:26:00.634 12:53:33 -- host/digest.sh@82 -- # bperfpid=3633432 00:26:00.634 12:53:33 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:00.634 12:53:33 -- host/digest.sh@83 -- # waitforlisten 3633432 /var/tmp/bperf.sock 00:26:00.634 12:53:33 -- common/autotest_common.sh@829 -- # '[' -z 3633432 ']' 00:26:00.634 12:53:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:00.634 12:53:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:00.634 12:53:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:00.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:00.634 12:53:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:00.634 12:53:33 -- common/autotest_common.sh@10 -- # set +x 00:26:00.634 [2024-11-20 12:53:33.527346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:00.634 [2024-11-20 12:53:33.527434] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3633432 ] 00:26:00.634 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.634 [2024-11-20 12:53:33.588467] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:00.634 [2024-11-20 12:53:33.702147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:00.892 12:53:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.892 12:53:33 -- common/autotest_common.sh@862 -- # return 0 00:26:00.892 12:53:33 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:00.892 12:53:33 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:00.892 12:53:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:01.150 12:53:34 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:01.150 12:53:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:01.720 nvme0n1 00:26:01.720 12:53:34 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:01.720 12:53:34 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:01.720 Running I/O for 2 seconds... 00:26:04.256 00:26:04.256 Latency(us) 00:26:04.256 [2024-11-20T11:53:37.364Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:04.256 [2024-11-20T11:53:37.364Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:04.256 nvme0n1 : 2.04 14727.45 57.53 0.00 0.00 8513.43 2949.12 43496.49 00:26:04.256 [2024-11-20T11:53:37.364Z] =================================================================================================================== 00:26:04.256 [2024-11-20T11:53:37.364Z] Total : 14727.45 57.53 0.00 0.00 8513.43 2949.12 43496.49 00:26:04.256 0 00:26:04.256 12:53:36 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:04.256 12:53:36 -- host/digest.sh@92 -- # get_accel_stats 00:26:04.256 12:53:36 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:04.256 12:53:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:04.256 12:53:36 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:04.256 | select(.opcode=="crc32c") 00:26:04.256 | "\(.module_name) \(.executed)"' 00:26:04.256 12:53:37 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:04.256 12:53:37 -- host/digest.sh@93 -- # exp_module=software 00:26:04.256 12:53:37 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:04.256 12:53:37 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:04.256 12:53:37 -- host/digest.sh@97 -- # killprocess 3633432 00:26:04.256 12:53:37 -- common/autotest_common.sh@936 -- # '[' -z 3633432 ']' 00:26:04.256 12:53:37 -- common/autotest_common.sh@940 -- # kill -0 3633432 00:26:04.256 12:53:37 -- common/autotest_common.sh@941 -- # uname 00:26:04.256 12:53:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:04.256 12:53:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3633432 00:26:04.256 12:53:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:04.256 12:53:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:04.256 12:53:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3633432' 00:26:04.256 killing process with pid 3633432 00:26:04.256 12:53:37 -- common/autotest_common.sh@955 -- # kill 3633432 00:26:04.256 Received shutdown signal, test time was about 2.000000 seconds 00:26:04.256 00:26:04.256 Latency(us) 00:26:04.256 [2024-11-20T11:53:37.364Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:04.256 [2024-11-20T11:53:37.364Z] =================================================================================================================== 00:26:04.256 [2024-11-20T11:53:37.364Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:04.256 12:53:37 -- common/autotest_common.sh@960 -- # wait 3633432 00:26:04.256 12:53:37 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:04.256 12:53:37 -- host/digest.sh@77 -- # local rw bs qd 00:26:04.256 12:53:37 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:04.256 12:53:37 -- host/digest.sh@80 -- # rw=randread 00:26:04.256 12:53:37 -- host/digest.sh@80 -- # bs=131072 00:26:04.256 12:53:37 -- host/digest.sh@80 -- # qd=16 00:26:04.256 12:53:37 -- host/digest.sh@82 -- # bperfpid=3633973 00:26:04.256 12:53:37 -- host/digest.sh@83 -- # waitforlisten 3633973 /var/tmp/bperf.sock 00:26:04.256 12:53:37 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:04.256 12:53:37 -- common/autotest_common.sh@829 -- # '[' -z 3633973 ']' 00:26:04.256 12:53:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:04.256 12:53:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:04.256 12:53:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:04.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:04.256 12:53:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:04.256 12:53:37 -- common/autotest_common.sh@10 -- # set +x 00:26:04.515 [2024-11-20 12:53:37.385485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:04.515 [2024-11-20 12:53:37.385558] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3633973 ] 00:26:04.515 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:04.515 Zero copy mechanism will not be used. 00:26:04.515 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.515 [2024-11-20 12:53:37.446595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:04.515 [2024-11-20 12:53:37.557840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:04.515 12:53:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.515 12:53:37 -- common/autotest_common.sh@862 -- # return 0 00:26:04.515 12:53:37 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:04.515 12:53:37 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:04.515 12:53:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:05.084 12:53:37 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:05.084 12:53:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:05.361 nvme0n1 00:26:05.361 12:53:38 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:05.361 12:53:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:05.645 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:05.645 Zero copy mechanism will not be used. 00:26:05.645 Running I/O for 2 seconds... 00:26:07.550 00:26:07.550 Latency(us) 00:26:07.550 [2024-11-20T11:53:40.658Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:07.550 [2024-11-20T11:53:40.658Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:07.550 nvme0n1 : 2.00 5512.82 689.10 0.00 0.00 2898.35 758.52 6747.78 00:26:07.550 [2024-11-20T11:53:40.658Z] =================================================================================================================== 00:26:07.550 [2024-11-20T11:53:40.658Z] Total : 5512.82 689.10 0.00 0.00 2898.35 758.52 6747.78 00:26:07.550 0 00:26:07.550 12:53:40 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:07.550 12:53:40 -- host/digest.sh@92 -- # get_accel_stats 00:26:07.550 12:53:40 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:07.550 12:53:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:07.550 12:53:40 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:07.550 | select(.opcode=="crc32c") 00:26:07.550 | "\(.module_name) \(.executed)"' 00:26:07.810 12:53:40 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:07.810 12:53:40 -- host/digest.sh@93 -- # exp_module=software 00:26:07.810 12:53:40 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:07.810 12:53:40 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:07.810 12:53:40 -- host/digest.sh@97 -- # killprocess 3633973 00:26:07.810 12:53:40 -- common/autotest_common.sh@936 -- # '[' -z 3633973 ']' 00:26:07.810 12:53:40 -- common/autotest_common.sh@940 -- # kill -0 3633973 00:26:07.810 12:53:40 -- common/autotest_common.sh@941 -- # uname 00:26:07.810 12:53:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:07.810 12:53:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3633973 00:26:07.810 12:53:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:07.810 12:53:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:07.810 12:53:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3633973' 00:26:07.810 killing process with pid 3633973 00:26:07.810 12:53:40 -- common/autotest_common.sh@955 -- # kill 3633973 00:26:07.810 Received shutdown signal, test time was about 2.000000 seconds 00:26:07.810 00:26:07.810 Latency(us) 00:26:07.810 [2024-11-20T11:53:40.918Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:07.810 [2024-11-20T11:53:40.918Z] =================================================================================================================== 00:26:07.810 [2024-11-20T11:53:40.918Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:07.810 12:53:40 -- common/autotest_common.sh@960 -- # wait 3633973 00:26:08.069 12:53:41 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:08.069 12:53:41 -- host/digest.sh@77 -- # local rw bs qd 00:26:08.069 12:53:41 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:08.069 12:53:41 -- host/digest.sh@80 -- # rw=randwrite 00:26:08.069 12:53:41 -- host/digest.sh@80 -- # bs=4096 00:26:08.069 12:53:41 -- host/digest.sh@80 -- # qd=128 00:26:08.069 12:53:41 -- host/digest.sh@82 -- # bperfpid=3634398 00:26:08.069 12:53:41 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:08.069 12:53:41 -- host/digest.sh@83 -- # waitforlisten 3634398 /var/tmp/bperf.sock 00:26:08.069 12:53:41 -- common/autotest_common.sh@829 -- # '[' -z 3634398 ']' 00:26:08.069 12:53:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:08.069 12:53:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:08.069 12:53:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:08.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:08.069 12:53:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:08.069 12:53:41 -- common/autotest_common.sh@10 -- # set +x 00:26:08.327 [2024-11-20 12:53:41.183785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:08.327 [2024-11-20 12:53:41.183856] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3634398 ] 00:26:08.328 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.328 [2024-11-20 12:53:41.244390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:08.328 [2024-11-20 12:53:41.355149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:08.328 12:53:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:08.328 12:53:41 -- common/autotest_common.sh@862 -- # return 0 00:26:08.328 12:53:41 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:08.328 12:53:41 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:08.328 12:53:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:08.897 12:53:41 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:08.897 12:53:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:09.154 nvme0n1 00:26:09.154 12:53:42 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:09.154 12:53:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:09.413 Running I/O for 2 seconds... 00:26:11.319 00:26:11.319 Latency(us) 00:26:11.319 [2024-11-20T11:53:44.427Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:11.319 [2024-11-20T11:53:44.427Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:11.319 nvme0n1 : 2.01 19704.46 76.97 0.00 0.00 6482.22 3106.89 11408.12 00:26:11.319 [2024-11-20T11:53:44.427Z] =================================================================================================================== 00:26:11.319 [2024-11-20T11:53:44.427Z] Total : 19704.46 76.97 0.00 0.00 6482.22 3106.89 11408.12 00:26:11.319 0 00:26:11.319 12:53:44 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:11.319 12:53:44 -- host/digest.sh@92 -- # get_accel_stats 00:26:11.319 12:53:44 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:11.319 12:53:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:11.319 12:53:44 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:11.319 | select(.opcode=="crc32c") 00:26:11.319 | "\(.module_name) \(.executed)"' 00:26:11.579 12:53:44 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:11.579 12:53:44 -- host/digest.sh@93 -- # exp_module=software 00:26:11.579 12:53:44 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:11.579 12:53:44 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:11.579 12:53:44 -- host/digest.sh@97 -- # killprocess 3634398 00:26:11.579 12:53:44 -- common/autotest_common.sh@936 -- # '[' -z 3634398 ']' 00:26:11.579 12:53:44 -- common/autotest_common.sh@940 -- # kill -0 3634398 00:26:11.579 12:53:44 -- common/autotest_common.sh@941 -- # uname 00:26:11.579 12:53:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:11.579 12:53:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3634398 00:26:11.579 12:53:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:11.579 12:53:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:11.579 12:53:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3634398' 00:26:11.579 killing process with pid 3634398 00:26:11.579 12:53:44 -- common/autotest_common.sh@955 -- # kill 3634398 00:26:11.579 Received shutdown signal, test time was about 2.000000 seconds 00:26:11.579 00:26:11.579 Latency(us) 00:26:11.579 [2024-11-20T11:53:44.687Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:11.579 [2024-11-20T11:53:44.687Z] =================================================================================================================== 00:26:11.579 [2024-11-20T11:53:44.687Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:11.579 12:53:44 -- common/autotest_common.sh@960 -- # wait 3634398 00:26:11.838 12:53:44 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:11.838 12:53:44 -- host/digest.sh@77 -- # local rw bs qd 00:26:11.838 12:53:44 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:11.838 12:53:44 -- host/digest.sh@80 -- # rw=randwrite 00:26:11.838 12:53:44 -- host/digest.sh@80 -- # bs=131072 00:26:11.838 12:53:44 -- host/digest.sh@80 -- # qd=16 00:26:11.838 12:53:44 -- host/digest.sh@82 -- # bperfpid=3634820 00:26:11.838 12:53:44 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:11.838 12:53:44 -- host/digest.sh@83 -- # waitforlisten 3634820 /var/tmp/bperf.sock 00:26:11.838 12:53:44 -- common/autotest_common.sh@829 -- # '[' -z 3634820 ']' 00:26:11.838 12:53:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:11.838 12:53:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:11.838 12:53:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:11.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:11.838 12:53:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:11.838 12:53:44 -- common/autotest_common.sh@10 -- # set +x 00:26:11.838 [2024-11-20 12:53:44.927578] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:11.838 [2024-11-20 12:53:44.927654] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3634820 ] 00:26:11.838 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:11.838 Zero copy mechanism will not be used. 00:26:12.096 EAL: No free 2048 kB hugepages reported on node 1 00:26:12.096 [2024-11-20 12:53:44.990053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:12.096 [2024-11-20 12:53:45.102476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:12.096 12:53:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:12.096 12:53:45 -- common/autotest_common.sh@862 -- # return 0 00:26:12.096 12:53:45 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:12.096 12:53:45 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:12.096 12:53:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:12.663 12:53:45 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:12.663 12:53:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:12.922 nvme0n1 00:26:12.922 12:53:45 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:12.922 12:53:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:12.922 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:12.922 Zero copy mechanism will not be used. 00:26:12.922 Running I/O for 2 seconds... 00:26:15.460 00:26:15.460 Latency(us) 00:26:15.460 [2024-11-20T11:53:48.568Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:15.460 [2024-11-20T11:53:48.568Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:15.460 nvme0n1 : 2.00 6841.97 855.25 0.00 0.00 2330.99 1808.31 10582.85 00:26:15.460 [2024-11-20T11:53:48.568Z] =================================================================================================================== 00:26:15.460 [2024-11-20T11:53:48.568Z] Total : 6841.97 855.25 0.00 0.00 2330.99 1808.31 10582.85 00:26:15.460 0 00:26:15.460 12:53:48 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:15.460 12:53:48 -- host/digest.sh@92 -- # get_accel_stats 00:26:15.460 12:53:48 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:15.460 12:53:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:15.460 12:53:48 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:15.460 | select(.opcode=="crc32c") 00:26:15.460 | "\(.module_name) \(.executed)"' 00:26:15.460 12:53:48 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:15.460 12:53:48 -- host/digest.sh@93 -- # exp_module=software 00:26:15.460 12:53:48 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:15.460 12:53:48 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:15.460 12:53:48 -- host/digest.sh@97 -- # killprocess 3634820 00:26:15.460 12:53:48 -- common/autotest_common.sh@936 -- # '[' -z 3634820 ']' 00:26:15.460 12:53:48 -- common/autotest_common.sh@940 -- # kill -0 3634820 00:26:15.460 12:53:48 -- common/autotest_common.sh@941 -- # uname 00:26:15.460 12:53:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:15.460 12:53:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3634820 00:26:15.460 12:53:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:15.460 12:53:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:15.460 12:53:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3634820' 00:26:15.460 killing process with pid 3634820 00:26:15.460 12:53:48 -- common/autotest_common.sh@955 -- # kill 3634820 00:26:15.460 Received shutdown signal, test time was about 2.000000 seconds 00:26:15.460 00:26:15.460 Latency(us) 00:26:15.460 [2024-11-20T11:53:48.568Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:15.461 [2024-11-20T11:53:48.569Z] =================================================================================================================== 00:26:15.461 [2024-11-20T11:53:48.569Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:15.461 12:53:48 -- common/autotest_common.sh@960 -- # wait 3634820 00:26:15.720 12:53:48 -- host/digest.sh@126 -- # killprocess 3633408 00:26:15.721 12:53:48 -- common/autotest_common.sh@936 -- # '[' -z 3633408 ']' 00:26:15.721 12:53:48 -- common/autotest_common.sh@940 -- # kill -0 3633408 00:26:15.721 12:53:48 -- common/autotest_common.sh@941 -- # uname 00:26:15.721 12:53:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:15.721 12:53:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3633408 00:26:15.721 12:53:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:15.721 12:53:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:15.721 12:53:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3633408' 00:26:15.721 killing process with pid 3633408 00:26:15.721 12:53:48 -- common/autotest_common.sh@955 -- # kill 3633408 00:26:15.721 12:53:48 -- common/autotest_common.sh@960 -- # wait 3633408 00:26:15.980 00:26:15.980 real 0m15.866s 00:26:15.980 user 0m31.033s 00:26:15.980 sys 0m4.558s 00:26:15.980 12:53:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:15.980 12:53:48 -- common/autotest_common.sh@10 -- # set +x 00:26:15.980 ************************************ 00:26:15.980 END TEST nvmf_digest_clean 00:26:15.980 ************************************ 00:26:15.980 12:53:48 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:15.980 12:53:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:15.980 12:53:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:15.980 12:53:48 -- common/autotest_common.sh@10 -- # set +x 00:26:15.980 ************************************ 00:26:15.980 START TEST nvmf_digest_error 00:26:15.980 ************************************ 00:26:15.980 12:53:48 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:15.980 12:53:48 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:15.980 12:53:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:15.980 12:53:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:15.980 12:53:48 -- common/autotest_common.sh@10 -- # set +x 00:26:15.980 12:53:48 -- nvmf/common.sh@469 -- # nvmfpid=3635399 00:26:15.980 12:53:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:15.980 12:53:48 -- nvmf/common.sh@470 -- # waitforlisten 3635399 00:26:15.980 12:53:48 -- common/autotest_common.sh@829 -- # '[' -z 3635399 ']' 00:26:15.980 12:53:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:15.980 12:53:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:15.980 12:53:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:15.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:15.980 12:53:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:15.980 12:53:48 -- common/autotest_common.sh@10 -- # set +x 00:26:15.980 [2024-11-20 12:53:48.999246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:15.980 [2024-11-20 12:53:48.999321] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:15.980 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.980 [2024-11-20 12:53:49.067162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.240 [2024-11-20 12:53:49.182207] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:16.240 [2024-11-20 12:53:49.182383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:16.240 [2024-11-20 12:53:49.182400] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:16.240 [2024-11-20 12:53:49.182428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:16.240 [2024-11-20 12:53:49.182460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:16.240 12:53:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:16.240 12:53:49 -- common/autotest_common.sh@862 -- # return 0 00:26:16.240 12:53:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:16.240 12:53:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:16.240 12:53:49 -- common/autotest_common.sh@10 -- # set +x 00:26:16.240 12:53:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:16.240 12:53:49 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:16.240 12:53:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.240 12:53:49 -- common/autotest_common.sh@10 -- # set +x 00:26:16.240 [2024-11-20 12:53:49.243040] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:16.240 12:53:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.240 12:53:49 -- host/digest.sh@104 -- # common_target_config 00:26:16.240 12:53:49 -- host/digest.sh@43 -- # rpc_cmd 00:26:16.240 12:53:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.240 12:53:49 -- common/autotest_common.sh@10 -- # set +x 00:26:16.499 null0 00:26:16.499 [2024-11-20 12:53:49.368304] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.499 [2024-11-20 12:53:49.392548] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.499 12:53:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.499 12:53:49 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:16.499 12:53:49 -- host/digest.sh@54 -- # local rw bs qd 00:26:16.499 12:53:49 -- host/digest.sh@56 -- # rw=randread 00:26:16.499 12:53:49 -- host/digest.sh@56 -- # bs=4096 00:26:16.499 12:53:49 -- host/digest.sh@56 -- # qd=128 00:26:16.499 12:53:49 -- host/digest.sh@58 -- # bperfpid=3635431 00:26:16.499 12:53:49 -- host/digest.sh@60 -- # waitforlisten 3635431 /var/tmp/bperf.sock 00:26:16.499 12:53:49 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:16.499 12:53:49 -- common/autotest_common.sh@829 -- # '[' -z 3635431 ']' 00:26:16.499 12:53:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:16.499 12:53:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:16.499 12:53:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:16.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:16.499 12:53:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:16.499 12:53:49 -- common/autotest_common.sh@10 -- # set +x 00:26:16.499 [2024-11-20 12:53:49.434484] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:16.499 [2024-11-20 12:53:49.434562] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3635431 ] 00:26:16.499 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.499 [2024-11-20 12:53:49.497875] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.759 [2024-11-20 12:53:49.620492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:17.386 12:53:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:17.386 12:53:50 -- common/autotest_common.sh@862 -- # return 0 00:26:17.386 12:53:50 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:17.386 12:53:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:17.645 12:53:50 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:17.645 12:53:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.645 12:53:50 -- common/autotest_common.sh@10 -- # set +x 00:26:17.645 12:53:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.645 12:53:50 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:17.645 12:53:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:18.214 nvme0n1 00:26:18.214 12:53:51 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:18.214 12:53:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.214 12:53:51 -- common/autotest_common.sh@10 -- # set +x 00:26:18.214 12:53:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.214 12:53:51 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:18.214 12:53:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:18.214 Running I/O for 2 seconds... 00:26:18.214 [2024-11-20 12:53:51.228855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.214 [2024-11-20 12:53:51.228907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.214 [2024-11-20 12:53:51.228929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.214 [2024-11-20 12:53:51.245686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.215 [2024-11-20 12:53:51.245721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.215 [2024-11-20 12:53:51.245742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.215 [2024-11-20 12:53:51.261045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.215 [2024-11-20 12:53:51.261099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.215 [2024-11-20 12:53:51.261134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.215 [2024-11-20 12:53:51.274015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.215 [2024-11-20 12:53:51.274049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.215 [2024-11-20 12:53:51.274081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.215 [2024-11-20 12:53:51.290975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.215 [2024-11-20 12:53:51.291011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:17048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.215 [2024-11-20 12:53:51.291047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.215 [2024-11-20 12:53:51.307314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.215 [2024-11-20 12:53:51.307346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15808 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.215 [2024-11-20 12:53:51.307363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.215 [2024-11-20 12:53:51.320177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.215 [2024-11-20 12:53:51.320206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.215 [2024-11-20 12:53:51.320237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.338237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.338275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:6163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.338292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.349517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.349551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:19662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.349571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.366009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.366044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.366063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.383444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.383491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:2499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.383511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.394675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.394708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:11053 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.394727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.411245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.411276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18546 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.411299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.427319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.427372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14997 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.427389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.439932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.439965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:3863 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.439984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.456969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.457003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:20909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.457022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.468709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.468743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1324 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.468762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.485154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.485199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.485216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.501572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.501610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:12118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.501630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.514977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.515010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:11313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.515029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.525682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.525715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.525734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.543018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.543052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.543087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.560157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.560185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.560215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.474 [2024-11-20 12:53:51.577187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.474 [2024-11-20 12:53:51.577216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.474 [2024-11-20 12:53:51.577248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.594569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.594604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:19696 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.594622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.612627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.612662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.612694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.628862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.628890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:4869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.628921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.640865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.640907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:11935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.640923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.658832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.658867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.658886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.675729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.675764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:738 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.675784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.692432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.692472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:10082 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.692492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.709079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.709113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:22704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.709145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.725781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.725816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:4884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.725835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.742805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.742840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:16866 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.742858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.759924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.759959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:11402 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.759979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.776511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.776545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:16147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.776564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.793337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.793387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20253 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.793406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.810347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.810401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:530 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.810421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.734 [2024-11-20 12:53:51.827177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.734 [2024-11-20 12:53:51.827207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.734 [2024-11-20 12:53:51.827239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.995 [2024-11-20 12:53:51.844120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.995 [2024-11-20 12:53:51.844153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-11-20 12:53:51.844171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.995 [2024-11-20 12:53:51.861112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.995 [2024-11-20 12:53:51.861141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-11-20 12:53:51.861157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.995 [2024-11-20 12:53:51.878158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.995 [2024-11-20 12:53:51.878187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:14934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-11-20 12:53:51.878218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.895221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.895250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:24230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.895282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.912280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.912309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.912340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.929292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.929320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22011 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.929351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.946092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.946136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.946152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.962143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.962172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24071 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.962187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.979037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.979078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22658 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.979119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:51.995879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:51.995913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:3442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:51.995931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:52.012661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:52.012695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23193 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:52.012713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:52.029301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:52.029329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:14097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:52.029344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:52.046204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:52.046232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:24443 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:52.046264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:52.063154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:52.063182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:13522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:52.063213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:52.079803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:52.079837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:590 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:52.079856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:18.996 [2024-11-20 12:53:52.096439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:18.996 [2024-11-20 12:53:52.096474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12722 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-11-20 12:53:52.096492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.112976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.113011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:1118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.113029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.129727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.129767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:21155 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.129787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.146358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.146405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.146424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.163372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.163406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:3720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.163425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.180300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.180328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:24487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.180358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.197139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.197168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.197199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.213831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.213865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:3348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.213884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.230652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.230686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.230705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.247698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.247732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:16898 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.247751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.264433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.264467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.264486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.281486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.281521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:13563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.281541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.257 [2024-11-20 12:53:52.298566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.257 [2024-11-20 12:53:52.298600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:10439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.257 [2024-11-20 12:53:52.298619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.258 [2024-11-20 12:53:52.315308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.258 [2024-11-20 12:53:52.315337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21066 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.258 [2024-11-20 12:53:52.315367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.258 [2024-11-20 12:53:52.331849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.258 [2024-11-20 12:53:52.331877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:5973 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.258 [2024-11-20 12:53:52.331907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.258 [2024-11-20 12:53:52.347147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.258 [2024-11-20 12:53:52.347176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.258 [2024-11-20 12:53:52.347207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.364193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.364223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:12511 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.364255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.381195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.381224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:14218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.381257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.397894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.397927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:18419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.397946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.415728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.415763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:4562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.415789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.431573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.431608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:1163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.431627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.448648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.448682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25342 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.448701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.465451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.465485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.465504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.482186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.482215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:3257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.482246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.499364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.499412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:11739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.499431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.516417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.516452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:10770 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.516470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.533274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.533302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:19211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.533331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.550057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.550099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:20455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.550132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.567137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.567164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15247 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.567196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.584191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.584218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:3168 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.584248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.601316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.601361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:6788 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.601379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.519 [2024-11-20 12:53:52.618518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.519 [2024-11-20 12:53:52.618552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17744 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.519 [2024-11-20 12:53:52.618571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.779 [2024-11-20 12:53:52.635471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.779 [2024-11-20 12:53:52.635506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.779 [2024-11-20 12:53:52.635525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.779 [2024-11-20 12:53:52.652603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.779 [2024-11-20 12:53:52.652638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:14772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.779 [2024-11-20 12:53:52.652657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.779 [2024-11-20 12:53:52.669643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.779 [2024-11-20 12:53:52.669677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:8553 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.779 [2024-11-20 12:53:52.669696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.779 [2024-11-20 12:53:52.686633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.779 [2024-11-20 12:53:52.686667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.779 [2024-11-20 12:53:52.686686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.779 [2024-11-20 12:53:52.711085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.779 [2024-11-20 12:53:52.711120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.779 [2024-11-20 12:53:52.711158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.779 [2024-11-20 12:53:52.728189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.779 [2024-11-20 12:53:52.728217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:17419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.728249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.745192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.745220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:25458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.745251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.762243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.762271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:15505 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.762303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.779634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.779668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.779686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.796480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.796514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:3471 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.796533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.813599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.813633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.813653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.830767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.830802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24127 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.830821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.847928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.847961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.847981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.865199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.865232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:15004 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.865264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:19.780 [2024-11-20 12:53:52.882149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:19.780 [2024-11-20 12:53:52.882178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:13887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.780 [2024-11-20 12:53:52.882209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.898225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.898256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:13782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.898288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.913886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.913914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:10804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.913946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.930268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.930298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:13246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.930330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.946688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.946725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:21219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.946743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.963544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.963584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:11577 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.963603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.980773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.980808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:20083 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.980826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:52.998480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:52.998522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10159 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.039 [2024-11-20 12:53:52.998542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.039 [2024-11-20 12:53:53.015791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.039 [2024-11-20 12:53:53.015826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10856 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.015845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.032978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.033014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:18299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.033033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.050316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.050345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9617 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.050376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.067444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.067479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.067498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.084303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.084331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:22775 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.084362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.101368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.101397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.101428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.117961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.117995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:22479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.118014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.040 [2024-11-20 12:53:53.134855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.040 [2024-11-20 12:53:53.134889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:5599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.040 [2024-11-20 12:53:53.134908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.299 [2024-11-20 12:53:53.152177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.299 [2024-11-20 12:53:53.152205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:19049 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.299 [2024-11-20 12:53:53.152246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.299 [2024-11-20 12:53:53.163210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.299 [2024-11-20 12:53:53.163238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.299 [2024-11-20 12:53:53.163270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.299 [2024-11-20 12:53:53.179418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.299 [2024-11-20 12:53:53.179446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:3101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.299 [2024-11-20 12:53:53.179478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.299 [2024-11-20 12:53:53.196428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.299 [2024-11-20 12:53:53.196463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:3718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.299 [2024-11-20 12:53:53.196481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.299 [2024-11-20 12:53:53.212769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1543bb0) 00:26:20.299 [2024-11-20 12:53:53.212803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:20.299 [2024-11-20 12:53:53.212822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:20.299 00:26:20.299 Latency(us) 00:26:20.299 [2024-11-20T11:53:53.407Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:20.299 [2024-11-20T11:53:53.407Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:20.299 nvme0n1 : 2.05 15092.57 58.96 0.00 0.00 8306.96 3762.25 49321.91 00:26:20.299 [2024-11-20T11:53:53.407Z] =================================================================================================================== 00:26:20.299 [2024-11-20T11:53:53.407Z] Total : 15092.57 58.96 0.00 0.00 8306.96 3762.25 49321.91 00:26:20.299 0 00:26:20.299 12:53:53 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:20.299 12:53:53 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:20.299 12:53:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:20.299 12:53:53 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:20.299 | .driver_specific 00:26:20.299 | .nvme_error 00:26:20.299 | .status_code 00:26:20.299 | .command_transient_transport_error' 00:26:20.558 12:53:53 -- host/digest.sh@71 -- # (( 121 > 0 )) 00:26:20.558 12:53:53 -- host/digest.sh@73 -- # killprocess 3635431 00:26:20.558 12:53:53 -- common/autotest_common.sh@936 -- # '[' -z 3635431 ']' 00:26:20.558 12:53:53 -- common/autotest_common.sh@940 -- # kill -0 3635431 00:26:20.558 12:53:53 -- common/autotest_common.sh@941 -- # uname 00:26:20.558 12:53:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:20.558 12:53:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3635431 00:26:20.558 12:53:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:20.558 12:53:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:20.558 12:53:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3635431' 00:26:20.558 killing process with pid 3635431 00:26:20.558 12:53:53 -- common/autotest_common.sh@955 -- # kill 3635431 00:26:20.558 Received shutdown signal, test time was about 2.000000 seconds 00:26:20.558 00:26:20.558 Latency(us) 00:26:20.558 [2024-11-20T11:53:53.666Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:20.558 [2024-11-20T11:53:53.666Z] =================================================================================================================== 00:26:20.558 [2024-11-20T11:53:53.666Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:20.558 12:53:53 -- common/autotest_common.sh@960 -- # wait 3635431 00:26:20.817 12:53:53 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:20.817 12:53:53 -- host/digest.sh@54 -- # local rw bs qd 00:26:20.817 12:53:53 -- host/digest.sh@56 -- # rw=randread 00:26:20.817 12:53:53 -- host/digest.sh@56 -- # bs=131072 00:26:20.817 12:53:53 -- host/digest.sh@56 -- # qd=16 00:26:20.817 12:53:53 -- host/digest.sh@58 -- # bperfpid=3635981 00:26:20.817 12:53:53 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:20.817 12:53:53 -- host/digest.sh@60 -- # waitforlisten 3635981 /var/tmp/bperf.sock 00:26:20.817 12:53:53 -- common/autotest_common.sh@829 -- # '[' -z 3635981 ']' 00:26:20.817 12:53:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:20.817 12:53:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:20.817 12:53:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:20.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:20.817 12:53:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:20.817 12:53:53 -- common/autotest_common.sh@10 -- # set +x 00:26:20.817 [2024-11-20 12:53:53.853067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:20.817 [2024-11-20 12:53:53.853153] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3635981 ] 00:26:20.817 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:20.817 Zero copy mechanism will not be used. 00:26:20.817 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.817 [2024-11-20 12:53:53.913720] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:21.075 [2024-11-20 12:53:54.027987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:22.012 12:53:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.013 12:53:54 -- common/autotest_common.sh@862 -- # return 0 00:26:22.013 12:53:54 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:22.013 12:53:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:22.271 12:53:55 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:22.271 12:53:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.271 12:53:55 -- common/autotest_common.sh@10 -- # set +x 00:26:22.271 12:53:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.271 12:53:55 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:22.271 12:53:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:22.840 nvme0n1 00:26:22.840 12:53:55 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:22.840 12:53:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.840 12:53:55 -- common/autotest_common.sh@10 -- # set +x 00:26:22.840 12:53:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.840 12:53:55 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:22.840 12:53:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:22.840 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:22.840 Zero copy mechanism will not be used. 00:26:22.840 Running I/O for 2 seconds... 00:26:22.840 [2024-11-20 12:53:55.834055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.840 [2024-11-20 12:53:55.834148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.840 [2024-11-20 12:53:55.834172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:22.840 [2024-11-20 12:53:55.840031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.840 [2024-11-20 12:53:55.840067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.840 [2024-11-20 12:53:55.840111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:22.840 [2024-11-20 12:53:55.845578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.840 [2024-11-20 12:53:55.845613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.840 [2024-11-20 12:53:55.845633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:22.840 [2024-11-20 12:53:55.851142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.840 [2024-11-20 12:53:55.851173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.840 [2024-11-20 12:53:55.851190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:22.840 [2024-11-20 12:53:55.856423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.840 [2024-11-20 12:53:55.856457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.840 [2024-11-20 12:53:55.856476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:22.840 [2024-11-20 12:53:55.862148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.840 [2024-11-20 12:53:55.862178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.862196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.867869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.867902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.867922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.873573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.873605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.873624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.879310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.879340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.879365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.885452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.885486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.885505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.890991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.891024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.891043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.896475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.896509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.896527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.901753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.901786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.901805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.906407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.906454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.906473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.912356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.912402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.912419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.918632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.918667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.918686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.924483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.924520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.924540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.929681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.929720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.929740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.935428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.935461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.935480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:22.841 [2024-11-20 12:53:55.941235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:22.841 [2024-11-20 12:53:55.941265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:22.841 [2024-11-20 12:53:55.941282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.946976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.947011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.947030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.952548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.952583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.952601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.958197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.958227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.958258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.963489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.963521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.963539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.969306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.969335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.969351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.974911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.974944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.974963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.980399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.980432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.980451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.985783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.985817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.985835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.991139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.991167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.103 [2024-11-20 12:53:55.991183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.103 [2024-11-20 12:53:55.996521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.103 [2024-11-20 12:53:55.996554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:55.996572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.002067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.002122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.002138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.007478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.007511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.007529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.013094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.013138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.013156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.018402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.018436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.018455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.023836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.023870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.023894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.029494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.029526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.029544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.034321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.034352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.034369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.038606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.038638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.038656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.043114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.043143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.043159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.047728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.047760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.047778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.052633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.052665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.052684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.058373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.058417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.058436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.064739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.064772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.064791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.072454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.072494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.072514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.080065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.080121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.080139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.087036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.087079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.087100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.093136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.093183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.093200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.098775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.098808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.098826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.104078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.104133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.104150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.110121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.110152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.110169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.116709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.116742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.116762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.122919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.122951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.104 [2024-11-20 12:53:56.122970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.104 [2024-11-20 12:53:56.129310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.104 [2024-11-20 12:53:56.129341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.129358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.135467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.135500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.135519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.142291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.142322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.142340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.149598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.149632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.149652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.156611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.156645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.156664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.162476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.162509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.162528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.167063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.167118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.167136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.171707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.171740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.171758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.176245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.176282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.176307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.180023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.180055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.180091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.184017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.184047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.184066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.187965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.187997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.188015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.191746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.191778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.191796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.196540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.196574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.196592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.202518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.202553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.202572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.105 [2024-11-20 12:53:56.208403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.105 [2024-11-20 12:53:56.208451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.105 [2024-11-20 12:53:56.208469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.214146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.214191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.214208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.219725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.219757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.219775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.225539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.225570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.225589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.231267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.231295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.231328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.236644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.236689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.236709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.242235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.242264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.242297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.247804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.247837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.247855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.253270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.253297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.253328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.259241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.259268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.259299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.265064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.265104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.265129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.270848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.270882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.270901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.276495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.276529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.276548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.281988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.282020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.282038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.287702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.287735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.287753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.293294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.293322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.293353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.298904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.298937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.298954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.304660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.304693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.304711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.310354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.310383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.310417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.315895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.315935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.315954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.321547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.321580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.321599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.327118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.327149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.327165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.332619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.332651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.332670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.338078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.367 [2024-11-20 12:53:56.338122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.367 [2024-11-20 12:53:56.338138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.367 [2024-11-20 12:53:56.343637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.343680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.343698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.349240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.349270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.349286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.354855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.354887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.354905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.360424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.360453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.360487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.366118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.366168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.366185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.371716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.371748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.371766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.377509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.377543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.377567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.383284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.383315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.383331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.388604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.388638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.388656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.394275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.394306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.394323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.399616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.399648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.399666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.404795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.404828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.404846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.410474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.410507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.410532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.416361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.416399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.416416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.422129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.422161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.422178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.427900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.427934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.427952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.433557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.433589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.433608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.438884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.438916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.438935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.444545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.444578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.444596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.449058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.449115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.449133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.453804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.453837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.453864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.458317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.458352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.458369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.464015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.464048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.464067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.368 [2024-11-20 12:53:56.468703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.368 [2024-11-20 12:53:56.468735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.368 [2024-11-20 12:53:56.468754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.474327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.474373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.474389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.480207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.480252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.480268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.486144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.486174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.486191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.491776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.491808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.491826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.497639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.497673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.497692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.503288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.503333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.503350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.508978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.509007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.509039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.514410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.514442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.514460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.520109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.520158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.520176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.524831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.524863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.524881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.529482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.529528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.529546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.533857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.533889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.533907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.538641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.538674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.538693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.544198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.544229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.544246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.549884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.549918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.549942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.555596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.555629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.555648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.560765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.560798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.560817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.565825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.565858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.565877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.571319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.571348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.571380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.576861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.576894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.576913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.582848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.582881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.582899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.588064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.588110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.588143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.592641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.592674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.592692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.629 [2024-11-20 12:53:56.597378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.629 [2024-11-20 12:53:56.597413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.629 [2024-11-20 12:53:56.597431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.601698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.601731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.601749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.606534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.606567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.606586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.611312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.611344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.611362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.616134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.616163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.616180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.620592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.620625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.620644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.625152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.625181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.625198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.629727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.629759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.629777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.634079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.634108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.634124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.639519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.639552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.639571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.645106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.645156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.645172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.650823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.650855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.650873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.656692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.656726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.656744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.662461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.662494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.662513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.668124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.668158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.668177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.674081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.674113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.674131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.681030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.681064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.681093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.688777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.688810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.688835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.696437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.696471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.696490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.704154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.704187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.704205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.711093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.711162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.711181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.718990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.719025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.719045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.630 [2024-11-20 12:53:56.726736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.630 [2024-11-20 12:53:56.726769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.630 [2024-11-20 12:53:56.726788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.889 [2024-11-20 12:53:56.734411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.889 [2024-11-20 12:53:56.734448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.889 [2024-11-20 12:53:56.734468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.889 [2024-11-20 12:53:56.742208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.742239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.742256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.750114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.750148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.750167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.758027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.758067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.758097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.765781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.765815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.765834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.773356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.773386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.773403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.781281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.781311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.781328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.788977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.789011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.789030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.797182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.797213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.797230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.804494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.804529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.804547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.812594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.812627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.812646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.819841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.819875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.819906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.827740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.827774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.827794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.834386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.834435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.834454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.840935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.840969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.840988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.846866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.846899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.846918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.853643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.853676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.853695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.860322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.860353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.860370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.866964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.866998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.867016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.873831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.873866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.873885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.880763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.880802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.880822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.887908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.887943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.887961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.894582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.894616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.894640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.900831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.900865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.900884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.890 [2024-11-20 12:53:56.908025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.890 [2024-11-20 12:53:56.908059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.890 [2024-11-20 12:53:56.908086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.914433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.914466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.914485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.921169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.921200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.921217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.927588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.927622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.927641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.934581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.934615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.934634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.941137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.941167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.941185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.947309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.947340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.947357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.953443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.953487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.953505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.959635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.959672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.959691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.966965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.966999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.967018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.973445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.973478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.973497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.978409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.978442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.978460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.983176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.983206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.983223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.986766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.986798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.986822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:23.891 [2024-11-20 12:53:56.991971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:23.891 [2024-11-20 12:53:56.992004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:23.891 [2024-11-20 12:53:56.992023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.151 [2024-11-20 12:53:56.997641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.151 [2024-11-20 12:53:56.997676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.151 [2024-11-20 12:53:56.997694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.151 [2024-11-20 12:53:57.003540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.151 [2024-11-20 12:53:57.003573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.151 [2024-11-20 12:53:57.003592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.151 [2024-11-20 12:53:57.009378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.151 [2024-11-20 12:53:57.009425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.151 [2024-11-20 12:53:57.009444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.151 [2024-11-20 12:53:57.015424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.151 [2024-11-20 12:53:57.015459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.151 [2024-11-20 12:53:57.015478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.151 [2024-11-20 12:53:57.021654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.021688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.021707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.027799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.027833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.027852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.033431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.033464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.033482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.039030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.039077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.039098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.044997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.045030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.045049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.050621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.050654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.050673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.056251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.056285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.056303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.061454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.061486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.061505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.065946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.065987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.066007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.070573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.070605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.070624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.075159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.075188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.075205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.079728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.079760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.079779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.084564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.084596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.084614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.088663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.088694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.088722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.093176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.093212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.093230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.097663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.097695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.097713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.102397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.102430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.102449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.107010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.107043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.107079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.111909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.111941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.111959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.116546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.116579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.116597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.120916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.120948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.120973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.125303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.125332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.125349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.129868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.129901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.152 [2024-11-20 12:53:57.129920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.152 [2024-11-20 12:53:57.135536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.152 [2024-11-20 12:53:57.135569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.135588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.141561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.141594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.141614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.147634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.147667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.147685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.153353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.153400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.153419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.158955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.158988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.159007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.164465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.164498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.164517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.170145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.170180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.170198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.174985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.175018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.175037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.179786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.179818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.179836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.185224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.185255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.185272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.191939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.191978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.191997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.197021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.197054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.197081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.201938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.201971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.201989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.206796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.206828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.206847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.212302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.212332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.212349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.218496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.218530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.218549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.224290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.224321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.224337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.229920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.229953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.229972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.235536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.235570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.235588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.241123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.241152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.241168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.246257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.246287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.246304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.153 [2024-11-20 12:53:57.251714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.153 [2024-11-20 12:53:57.251747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.153 [2024-11-20 12:53:57.251766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.413 [2024-11-20 12:53:57.257626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.413 [2024-11-20 12:53:57.257661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.413 [2024-11-20 12:53:57.257679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.413 [2024-11-20 12:53:57.263031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.413 [2024-11-20 12:53:57.263064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.413 [2024-11-20 12:53:57.263103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.413 [2024-11-20 12:53:57.268647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.413 [2024-11-20 12:53:57.268685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.413 [2024-11-20 12:53:57.268705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.413 [2024-11-20 12:53:57.274151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.413 [2024-11-20 12:53:57.274180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.413 [2024-11-20 12:53:57.274196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.279594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.279627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.279646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.285096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.285140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.285156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.290412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.290441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.290457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.295967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.296000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.296018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.301540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.301573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.301591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.307377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.307405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.307437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.313337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.313372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.313390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.318838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.318870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.318889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.324327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.324356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.324372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.329977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.330008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.330027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.335794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.335828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.335847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.341453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.341488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.341507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.347027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.347060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.347089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.352628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.352661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.352680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.358141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.358170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.358186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.363755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.363788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.363806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.369260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.369289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.369305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.374900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.374932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.374950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.380384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.380430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.380449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.385805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.385838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.385857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.392017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.392050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.414 [2024-11-20 12:53:57.392078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.414 [2024-11-20 12:53:57.399685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.414 [2024-11-20 12:53:57.399719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.399738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.407222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.407252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.407270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.414968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.415006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.415033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.422653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.422687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.422706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.430261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.430307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.430324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.437780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.437816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.437834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.445411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.445445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.445465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.452960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.452994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.453013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.460610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.460645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.460664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.468253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.468285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.468302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.475748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.475782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.475802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.483438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.483468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.483500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.491046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.491097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.491115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.498481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.498522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.498554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.505810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.505840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.505872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.415 [2024-11-20 12:53:57.512694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.415 [2024-11-20 12:53:57.512723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.415 [2024-11-20 12:53:57.512756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.520132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.520164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.520181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.527502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.527549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.527567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.535315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.535345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.535382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.543372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.543425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.543463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.550617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.550651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.550670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.558183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.558214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.558231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.565360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.565421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.565445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.571691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.571724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.571743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.577667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.577700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.577719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.584307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.584337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.584354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.591472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.591506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.591524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.598758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.598791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.598810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.606469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.606509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.606528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.614201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.677 [2024-11-20 12:53:57.614236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.677 [2024-11-20 12:53:57.614253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.677 [2024-11-20 12:53:57.621732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.621765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.621784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.627134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.627164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.627185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.633878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.633910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.633929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.640738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.640771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.640789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.646548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.646582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.646601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.652444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.652478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.652496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.658343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.658388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.658408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.664237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.664267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.664284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.669961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.669994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.670013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.675575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.675608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.675627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.680641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.680671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.680688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.686342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.686387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.686406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.692078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.692111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.692129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.697717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.697749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.697768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.703290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.703319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.703336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.708949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.708981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.709006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.714670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.714704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.714722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.720307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.720337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.720353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.725989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.726022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.726040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.730577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.730609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.730627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.735580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.735612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.735630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.739676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.739709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.739727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.745164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.745194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.745211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.751197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.751226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.751243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.756982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.757022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.757041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.762780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.762813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.762831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.768390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.678 [2024-11-20 12:53:57.768423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.678 [2024-11-20 12:53:57.768441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.678 [2024-11-20 12:53:57.774455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.679 [2024-11-20 12:53:57.774489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.679 [2024-11-20 12:53:57.774508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.679 [2024-11-20 12:53:57.780406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.679 [2024-11-20 12:53:57.780436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.679 [2024-11-20 12:53:57.780468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.938 [2024-11-20 12:53:57.786692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.938 [2024-11-20 12:53:57.786726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.938 [2024-11-20 12:53:57.786745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.938 [2024-11-20 12:53:57.792908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.938 [2024-11-20 12:53:57.792941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.938 [2024-11-20 12:53:57.792960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.938 [2024-11-20 12:53:57.798660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.938 [2024-11-20 12:53:57.798693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.938 [2024-11-20 12:53:57.798712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.938 [2024-11-20 12:53:57.804366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.938 [2024-11-20 12:53:57.804413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.938 [2024-11-20 12:53:57.804432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.938 [2024-11-20 12:53:57.809798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.938 [2024-11-20 12:53:57.809830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.938 [2024-11-20 12:53:57.809847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:24.938 [2024-11-20 12:53:57.815107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.938 [2024-11-20 12:53:57.815154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.939 [2024-11-20 12:53:57.815171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:24.939 [2024-11-20 12:53:57.820960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.939 [2024-11-20 12:53:57.820994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.939 [2024-11-20 12:53:57.821012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:24.939 [2024-11-20 12:53:57.826521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb45bb0) 00:26:24.939 [2024-11-20 12:53:57.826554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:24.939 [2024-11-20 12:53:57.826573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:24.939 00:26:24.939 Latency(us) 00:26:24.939 [2024-11-20T11:53:58.047Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:24.939 [2024-11-20T11:53:58.047Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:24.939 nvme0n1 : 2.00 5292.66 661.58 0.00 0.00 3018.88 892.02 8301.23 00:26:24.939 [2024-11-20T11:53:58.047Z] =================================================================================================================== 00:26:24.939 [2024-11-20T11:53:58.047Z] Total : 5292.66 661.58 0.00 0.00 3018.88 892.02 8301.23 00:26:24.939 0 00:26:24.939 12:53:57 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:24.939 12:53:57 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:24.939 12:53:57 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:24.939 | .driver_specific 00:26:24.939 | .nvme_error 00:26:24.939 | .status_code 00:26:24.939 | .command_transient_transport_error' 00:26:24.939 12:53:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:25.199 12:53:58 -- host/digest.sh@71 -- # (( 341 > 0 )) 00:26:25.199 12:53:58 -- host/digest.sh@73 -- # killprocess 3635981 00:26:25.199 12:53:58 -- common/autotest_common.sh@936 -- # '[' -z 3635981 ']' 00:26:25.199 12:53:58 -- common/autotest_common.sh@940 -- # kill -0 3635981 00:26:25.199 12:53:58 -- common/autotest_common.sh@941 -- # uname 00:26:25.199 12:53:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:25.199 12:53:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3635981 00:26:25.199 12:53:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:25.199 12:53:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:25.199 12:53:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3635981' 00:26:25.199 killing process with pid 3635981 00:26:25.199 12:53:58 -- common/autotest_common.sh@955 -- # kill 3635981 00:26:25.199 Received shutdown signal, test time was about 2.000000 seconds 00:26:25.199 00:26:25.200 Latency(us) 00:26:25.200 [2024-11-20T11:53:58.308Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:25.200 [2024-11-20T11:53:58.308Z] =================================================================================================================== 00:26:25.200 [2024-11-20T11:53:58.308Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:25.200 12:53:58 -- common/autotest_common.sh@960 -- # wait 3635981 00:26:25.459 12:53:58 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:25.459 12:53:58 -- host/digest.sh@54 -- # local rw bs qd 00:26:25.459 12:53:58 -- host/digest.sh@56 -- # rw=randwrite 00:26:25.459 12:53:58 -- host/digest.sh@56 -- # bs=4096 00:26:25.459 12:53:58 -- host/digest.sh@56 -- # qd=128 00:26:25.459 12:53:58 -- host/digest.sh@58 -- # bperfpid=3636536 00:26:25.459 12:53:58 -- host/digest.sh@60 -- # waitforlisten 3636536 /var/tmp/bperf.sock 00:26:25.459 12:53:58 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:25.459 12:53:58 -- common/autotest_common.sh@829 -- # '[' -z 3636536 ']' 00:26:25.459 12:53:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:25.459 12:53:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:25.459 12:53:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:25.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:25.459 12:53:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:25.459 12:53:58 -- common/autotest_common.sh@10 -- # set +x 00:26:25.459 [2024-11-20 12:53:58.461107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:25.459 [2024-11-20 12:53:58.461199] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3636536 ] 00:26:25.459 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.459 [2024-11-20 12:53:58.526494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:25.720 [2024-11-20 12:53:58.638365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:26.656 12:53:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:26.656 12:53:59 -- common/autotest_common.sh@862 -- # return 0 00:26:26.656 12:53:59 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:26.656 12:53:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:26.915 12:53:59 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:26.915 12:53:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.915 12:53:59 -- common/autotest_common.sh@10 -- # set +x 00:26:26.915 12:53:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.915 12:53:59 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:26.915 12:53:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:27.173 nvme0n1 00:26:27.173 12:54:00 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:27.173 12:54:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.173 12:54:00 -- common/autotest_common.sh@10 -- # set +x 00:26:27.173 12:54:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.173 12:54:00 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:27.173 12:54:00 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:27.432 Running I/O for 2 seconds... 00:26:27.432 [2024-11-20 12:54:00.404275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f6890 00:26:27.432 [2024-11-20 12:54:00.404812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:11528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.404856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.417915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190eff18 00:26:27.432 [2024-11-20 12:54:00.418613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:18409 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.418647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.430418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fac10 00:26:27.432 [2024-11-20 12:54:00.431272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.431302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.442218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df550 00:26:27.432 [2024-11-20 12:54:00.443255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:5201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.443290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.454907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fdeb0 00:26:27.432 [2024-11-20 12:54:00.455644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.455678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.467189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ec408 00:26:27.432 [2024-11-20 12:54:00.468915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:11672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.468961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.479000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f31b8 00:26:27.432 [2024-11-20 12:54:00.479964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12369 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.432 [2024-11-20 12:54:00.479998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:27.432 [2024-11-20 12:54:00.491741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f9b30 00:26:27.432 [2024-11-20 12:54:00.493315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:9435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.433 [2024-11-20 12:54:00.493343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:27.433 [2024-11-20 12:54:00.503904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190de470 00:26:27.433 [2024-11-20 12:54:00.505456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:9339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.433 [2024-11-20 12:54:00.505506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:27.433 [2024-11-20 12:54:00.515963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f4f40 00:26:27.433 [2024-11-20 12:54:00.517524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:3387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.433 [2024-11-20 12:54:00.517560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:27.433 [2024-11-20 12:54:00.527569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e9168 00:26:27.433 [2024-11-20 12:54:00.529017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:10648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.433 [2024-11-20 12:54:00.529048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:27.433 [2024-11-20 12:54:00.538986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ec840 00:26:27.693 [2024-11-20 12:54:00.540451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:8779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.540483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.551117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fbcf0 00:26:27.693 [2024-11-20 12:54:00.552596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:21871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.552627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.562694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e99d8 00:26:27.693 [2024-11-20 12:54:00.563766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:17793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.563796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.572940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f9f68 00:26:27.693 [2024-11-20 12:54:00.574047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.574086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.585396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190eaef0 00:26:27.693 [2024-11-20 12:54:00.587244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:1700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.587285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.595879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fc560 00:26:27.693 [2024-11-20 12:54:00.596672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:21240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.596716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.608558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fc998 00:26:27.693 [2024-11-20 12:54:00.609911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:21315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.609944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.620320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f4f40 00:26:27.693 [2024-11-20 12:54:00.621423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16799 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.621464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.632271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f4f40 00:26:27.693 [2024-11-20 12:54:00.633611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.633642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.643970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f5378 00:26:27.693 [2024-11-20 12:54:00.645411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:12742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.645442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.655890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f5be8 00:26:27.693 [2024-11-20 12:54:00.657309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:3981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.693 [2024-11-20 12:54:00.657339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:27.693 [2024-11-20 12:54:00.667765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ef270 00:26:27.693 [2024-11-20 12:54:00.669146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:18748 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.669176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.680245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ed920 00:26:27.694 [2024-11-20 12:54:00.681236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:18449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.681265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.690579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f0788 00:26:27.694 [2024-11-20 12:54:00.691756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:15161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.691787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.702335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f0788 00:26:27.694 [2024-11-20 12:54:00.703545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:14747 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.703575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.714154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190eff18 00:26:27.694 [2024-11-20 12:54:00.715385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:16208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.715430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.725688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190f4b08 00:26:27.694 [2024-11-20 12:54:00.726736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:6938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.726764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.736844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fbcf0 00:26:27.694 [2024-11-20 12:54:00.738039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:19295 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.738091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.747630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fc128 00:26:27.694 [2024-11-20 12:54:00.748342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:10458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.748376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.759696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fc560 00:26:27.694 [2024-11-20 12:54:00.760673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:130 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.760704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.771668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ef6a8 00:26:27.694 [2024-11-20 12:54:00.772708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:2299 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.772738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.783621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.694 [2024-11-20 12:54:00.784604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:17145 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.784634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:27.694 [2024-11-20 12:54:00.795482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.694 [2024-11-20 12:54:00.796477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.694 [2024-11-20 12:54:00.796508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.807560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.808582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:18728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.808612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.819525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.820829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:13735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.820867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.831530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.832579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14711 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.832611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.843534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.844634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.844666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.855481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.856553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:843 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.856584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.867457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.868559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.868588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.879478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.955 [2024-11-20 12:54:00.880575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:10999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.955 [2024-11-20 12:54:00.880619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:27.955 [2024-11-20 12:54:00.891454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.892573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:22707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.892601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.903427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.904572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:10403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.904609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.915417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.916579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:3356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.916622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.927365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.928539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.928576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.939082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.940171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:5282 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.940202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.950573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.951667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15511 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.951696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.962223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.963471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:19388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.963498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.973918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:00.975092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.975121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.984977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190eff18 00:26:27.956 [2024-11-20 12:54:00.985242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:11177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.985271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:00.996974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190fb8b8 00:26:27.956 [2024-11-20 12:54:00.997931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:5694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:00.997961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:01.008350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ed920 00:26:27.956 [2024-11-20 12:54:01.009642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4310 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:01.009684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:01.019724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190ea248 00:26:27.956 [2024-11-20 12:54:01.021020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:14096 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:01.021062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:01.031010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e01f8 00:26:27.956 [2024-11-20 12:54:01.031942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:5205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:01.031972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:01.042337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190df118 00:26:27.956 [2024-11-20 12:54:01.043265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:2656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:01.043295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0038 p:0 m:0 dnr:0 00:26:27.956 [2024-11-20 12:54:01.055357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:27.956 [2024-11-20 12:54:01.055650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:17484 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:27.956 [2024-11-20 12:54:01.055679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.068535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.068755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:4501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.068783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.081667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.081919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:8033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.081947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.095198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.095488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:14708 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.095516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.108479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.108703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:17201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.108746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.121943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.122243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:5130 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.122272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.135234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.135498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:440 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.135526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.148799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.149036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.149085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.161990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.162194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:5577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.162223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.175330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.175615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:17582 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.175643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.188508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.188790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:1655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.188819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.201814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.202033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:8384 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.202084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.215249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.215482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:14728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.215510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.228872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.229135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:13426 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.229164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.242225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.242460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24808 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.242488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.255762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.256021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.256080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.269326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.269564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:18193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.269593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.282891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.283135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.283164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.296533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.296761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9862 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.296789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.309744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.252 [2024-11-20 12:54:01.310025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4513 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.252 [2024-11-20 12:54:01.310054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.252 [2024-11-20 12:54:01.323005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.253 [2024-11-20 12:54:01.323279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:11320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.253 [2024-11-20 12:54:01.323308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.253 [2024-11-20 12:54:01.336578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.253 [2024-11-20 12:54:01.336792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:1669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.253 [2024-11-20 12:54:01.336820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.535 [2024-11-20 12:54:01.350100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.535 [2024-11-20 12:54:01.350348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:17662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.535 [2024-11-20 12:54:01.350377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.535 [2024-11-20 12:54:01.363624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.535 [2024-11-20 12:54:01.363898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:10112 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.535 [2024-11-20 12:54:01.363926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.376715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.376953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:1536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.376981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.389830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.390059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:21026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.390105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.402734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.402966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.402993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.416153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.416375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:4240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.416423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.429256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.429494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.429521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.442380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.442626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:2941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.442654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.455647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.455885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:12312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.455913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.469439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.469691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:19222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.469723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.483232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.483486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:17265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.483518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.496953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.497205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.497234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.510787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.511020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:15105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.511051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.524596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.524832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:18699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.524864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.538294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.538538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16146 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.538569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.552031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.552270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.552298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.565812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.566049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:5970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.566088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.579654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.579863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:4629 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.579894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.593267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.593517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:13121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.593548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.607127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.607364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:14630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.607414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.620891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.621149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.621185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.536 [2024-11-20 12:54:01.634598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.536 [2024-11-20 12:54:01.634833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9612 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.536 [2024-11-20 12:54:01.634865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.648342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.794 [2024-11-20 12:54:01.648594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:22260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.794 [2024-11-20 12:54:01.648625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.662140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.794 [2024-11-20 12:54:01.662357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:23057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.794 [2024-11-20 12:54:01.662403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.675774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.794 [2024-11-20 12:54:01.676007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:16071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.794 [2024-11-20 12:54:01.676039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.689544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.794 [2024-11-20 12:54:01.689778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:16504 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.794 [2024-11-20 12:54:01.689809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.703183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.794 [2024-11-20 12:54:01.703474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:24653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.794 [2024-11-20 12:54:01.703505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.716932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.794 [2024-11-20 12:54:01.717192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.794 [2024-11-20 12:54:01.717223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.794 [2024-11-20 12:54:01.730596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.730836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:11699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.730868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.744159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.744376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:10129 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.744422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.757750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.757985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.758017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.771353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.771596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:13604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.771627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.785155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.785434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:3477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.785466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.798697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.798942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:21821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.798974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.812510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.812744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:8302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.812775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.826244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.826519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:20380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.826550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.839972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.840224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.840253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.853699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.853934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:21397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.853965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.867482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.867717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:14702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.867748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.881210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.881587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:17933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.881618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:28.795 [2024-11-20 12:54:01.894990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:28.795 [2024-11-20 12:54:01.895244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10710 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:28.795 [2024-11-20 12:54:01.895272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.908720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.908958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.908989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.922404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.922640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:15491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.922673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.936134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.936356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.936404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.949816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.950052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:13180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.950092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.963287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.963545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.963582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.976719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.976955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.976986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:01.990323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:01.990585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:16648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:01.990616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.004042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.004304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:17574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.004333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.017768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.017989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.018017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.031229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.031502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:16485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.031534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.044642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.044874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:13153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.044905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.058382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.058661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.058692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.072050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.072309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.072337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.085923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.086190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:6379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.086219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.099702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.099937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.099969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.113477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.113714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:4642 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.113756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.127129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.127387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:17580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.127419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.140867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.141128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10995 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.141157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.055 [2024-11-20 12:54:02.154647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.055 [2024-11-20 12:54:02.154884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:2936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.055 [2024-11-20 12:54:02.154916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.168439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.168678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.168709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.182223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.182475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:13684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.182507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.195993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.196250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:12113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.196279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.209746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.209983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:20773 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.210015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.223508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.223747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:7527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.223778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.237267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.237483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:17613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.237515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.251018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.251289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:13831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.251317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.314 [2024-11-20 12:54:02.264758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.314 [2024-11-20 12:54:02.264991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:22104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.314 [2024-11-20 12:54:02.265021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.278537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.278769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:23934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.278800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.292196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.292446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:8781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.292477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.305956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.306218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:10315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.306247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.319669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.319903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:8639 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.319946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.333355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.333604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:9358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.333636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.347094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.347363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:3900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.347410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.360753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.360989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:14974 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.361021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.374413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.374657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:19131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.374689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 [2024-11-20 12:54:02.387982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271ad0) with pdu=0x2000190e95a0 00:26:29.315 [2024-11-20 12:54:02.388233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:20434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:29.315 [2024-11-20 12:54:02.388263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:29.315 00:26:29.315 Latency(us) 00:26:29.315 [2024-11-20T11:54:02.423Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:29.315 [2024-11-20T11:54:02.423Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:29.315 nvme0n1 : 2.01 19670.30 76.84 0.00 0.00 6492.97 2852.03 13883.92 00:26:29.315 [2024-11-20T11:54:02.423Z] =================================================================================================================== 00:26:29.315 [2024-11-20T11:54:02.423Z] Total : 19670.30 76.84 0.00 0.00 6492.97 2852.03 13883.92 00:26:29.315 0 00:26:29.315 12:54:02 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:29.315 12:54:02 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:29.315 12:54:02 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:29.315 | .driver_specific 00:26:29.315 | .nvme_error 00:26:29.315 | .status_code 00:26:29.315 | .command_transient_transport_error' 00:26:29.315 12:54:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:29.573 12:54:02 -- host/digest.sh@71 -- # (( 154 > 0 )) 00:26:29.573 12:54:02 -- host/digest.sh@73 -- # killprocess 3636536 00:26:29.573 12:54:02 -- common/autotest_common.sh@936 -- # '[' -z 3636536 ']' 00:26:29.573 12:54:02 -- common/autotest_common.sh@940 -- # kill -0 3636536 00:26:29.573 12:54:02 -- common/autotest_common.sh@941 -- # uname 00:26:29.573 12:54:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:29.573 12:54:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3636536 00:26:29.832 12:54:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:29.832 12:54:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:29.832 12:54:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3636536' 00:26:29.832 killing process with pid 3636536 00:26:29.832 12:54:02 -- common/autotest_common.sh@955 -- # kill 3636536 00:26:29.832 Received shutdown signal, test time was about 2.000000 seconds 00:26:29.832 00:26:29.832 Latency(us) 00:26:29.832 [2024-11-20T11:54:02.940Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:29.832 [2024-11-20T11:54:02.940Z] =================================================================================================================== 00:26:29.832 [2024-11-20T11:54:02.940Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:29.832 12:54:02 -- common/autotest_common.sh@960 -- # wait 3636536 00:26:30.091 12:54:02 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:30.091 12:54:02 -- host/digest.sh@54 -- # local rw bs qd 00:26:30.091 12:54:02 -- host/digest.sh@56 -- # rw=randwrite 00:26:30.091 12:54:02 -- host/digest.sh@56 -- # bs=131072 00:26:30.091 12:54:02 -- host/digest.sh@56 -- # qd=16 00:26:30.091 12:54:02 -- host/digest.sh@58 -- # bperfpid=3637206 00:26:30.091 12:54:02 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:30.091 12:54:02 -- host/digest.sh@60 -- # waitforlisten 3637206 /var/tmp/bperf.sock 00:26:30.091 12:54:02 -- common/autotest_common.sh@829 -- # '[' -z 3637206 ']' 00:26:30.091 12:54:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:30.091 12:54:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:30.091 12:54:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:30.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:30.091 12:54:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:30.091 12:54:02 -- common/autotest_common.sh@10 -- # set +x 00:26:30.091 [2024-11-20 12:54:03.031574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:30.091 [2024-11-20 12:54:03.031657] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3637206 ] 00:26:30.091 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:30.091 Zero copy mechanism will not be used. 00:26:30.091 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.091 [2024-11-20 12:54:03.097652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:30.351 [2024-11-20 12:54:03.214971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:31.288 12:54:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:31.288 12:54:04 -- common/autotest_common.sh@862 -- # return 0 00:26:31.288 12:54:04 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:31.288 12:54:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:31.288 12:54:04 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:31.288 12:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.288 12:54:04 -- common/autotest_common.sh@10 -- # set +x 00:26:31.288 12:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.288 12:54:04 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:31.288 12:54:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:31.859 nvme0n1 00:26:31.859 12:54:04 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:31.859 12:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.859 12:54:04 -- common/autotest_common.sh@10 -- # set +x 00:26:31.859 12:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.859 12:54:04 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:31.859 12:54:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:31.859 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:31.859 Zero copy mechanism will not be used. 00:26:31.859 Running I/O for 2 seconds... 00:26:31.859 [2024-11-20 12:54:04.881637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.859 [2024-11-20 12:54:04.881962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.859 [2024-11-20 12:54:04.882006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.859 [2024-11-20 12:54:04.887287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.859 [2024-11-20 12:54:04.887513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.859 [2024-11-20 12:54:04.887546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.859 [2024-11-20 12:54:04.892545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.892747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.892784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.897882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.898052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.898091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.903335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.903494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.903523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.908810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.908936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.908966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.913243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.913419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.913450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.917864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.918101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.918132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.922158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.922346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.922379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.927001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.927187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.927217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.932690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.932865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.932909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.938408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.938532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.938575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.944459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.944597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.944631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.950102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.950247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.950276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.955704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.955865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.955895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.860 [2024-11-20 12:54:04.960664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:31.860 [2024-11-20 12:54:04.960852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.860 [2024-11-20 12:54:04.960889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.121 [2024-11-20 12:54:04.966698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.121 [2024-11-20 12:54:04.966987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.121 [2024-11-20 12:54:04.967024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.121 [2024-11-20 12:54:04.973226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.121 [2024-11-20 12:54:04.973363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.121 [2024-11-20 12:54:04.973392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.121 [2024-11-20 12:54:04.978480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.121 [2024-11-20 12:54:04.978651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.121 [2024-11-20 12:54:04.978682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.121 [2024-11-20 12:54:04.982851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.121 [2024-11-20 12:54:04.982978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.121 [2024-11-20 12:54:04.983007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.121 [2024-11-20 12:54:04.987293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.121 [2024-11-20 12:54:04.987422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.121 [2024-11-20 12:54:04.987451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.121 [2024-11-20 12:54:04.991557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.121 [2024-11-20 12:54:04.991746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.121 [2024-11-20 12:54:04.991777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:04.996287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:04.996449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:04.996479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.002036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.002366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.002396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.007515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.007755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.007785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.014055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.014264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.014294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.020312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.020576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.020606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.026558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.026720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.026749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.031926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.032007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.032036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.036748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.036897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.036927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.040941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.041100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.041132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.045243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.045472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.045501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.049449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.049659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.049687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.053659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.053820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.053849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.057828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.057954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.057983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.061949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.062078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.062107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.066122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.066220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.066251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.070348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.070541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.070588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.074570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.074704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.074734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.078848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.079089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.079120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.082930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.083125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.083165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.087292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.087447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.087480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.091384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.091516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.091555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.095507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.095632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.095665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.099573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.099678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.099707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.103730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.103883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.103915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.107895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.108034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.108067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.112047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.112286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.112319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.116197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.122 [2024-11-20 12:54:05.116392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.122 [2024-11-20 12:54:05.116424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.122 [2024-11-20 12:54:05.120343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.120493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.120523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.124473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.124592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.124623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.128555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.128681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.128713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.132605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.132720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.132764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.136814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.136990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.137020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.140892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.141053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.141099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.145153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.145360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.145391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.149325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.149544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.149574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.153569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.153746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.153776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.157666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.157780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.157818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.161884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.162044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.162081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.166551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.166703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.166735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.170908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.171117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.171150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.176028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.176216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.176247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.181643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.182001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.182031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.187094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.187392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.187423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.192483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.192752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.192782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.197738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.197930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.197959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.202858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.203017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.203047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.208337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.208480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.208525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.213744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.213996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.214025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.219940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.220167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.220197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.123 [2024-11-20 12:54:05.226119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.123 [2024-11-20 12:54:05.226404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.123 [2024-11-20 12:54:05.226433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.232357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.232646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.232675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.238284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.238475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.238505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.243334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.243493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.243529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.247498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.247613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.247646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.251607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.251720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.251756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.256149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.256333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.256362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.260800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.260976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.261015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.265538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.265763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.265796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.271330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.271559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.271592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.384 [2024-11-20 12:54:05.276220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.384 [2024-11-20 12:54:05.276404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.384 [2024-11-20 12:54:05.276433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.280687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.280829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.280862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.285242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.285355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.285414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.289746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.289875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.289910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.294281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.294476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.294509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.298843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.298987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.299023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.303553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.303815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.303847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.308031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.308290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.308321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.312635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.312842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.312874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.317144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.317266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.317295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.321617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.321742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.321779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.326108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.326244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.326274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.330600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.330783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.330828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.335094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.335232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.335270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.339767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.340022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.340056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.344275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.344537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.344570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.348846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.349015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.349047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.353359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.353507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.353546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.357875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.358017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.358050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.362338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.362460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.362493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.366969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.367171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.367209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.371606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.371765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.371798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.376292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.376569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.376603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.380885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.381173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.381203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.385460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.385635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.385668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.389983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.390140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.390176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.394486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.394611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.385 [2024-11-20 12:54:05.394642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.385 [2024-11-20 12:54:05.399019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.385 [2024-11-20 12:54:05.399152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.399182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.403544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.403730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.403766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.408045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.408207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.408246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.412733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.412991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.413023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.417258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.417516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.417558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.421849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.422012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.422044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.426429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.426583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.426619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.430893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.431007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.431044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.435367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.435488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.435521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.440098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.440289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.440322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.444623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.444766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.444796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.448930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.449177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.449207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.453026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.453228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.453263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.458084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.458241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.458271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.462877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.463019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.463053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.467001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.467120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.467149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.471111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.471231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.471263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.475234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.475379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.475408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.479333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.479452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.479487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.483624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.483856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.483887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.386 [2024-11-20 12:54:05.487844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.386 [2024-11-20 12:54:05.488030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.386 [2024-11-20 12:54:05.488062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.646 [2024-11-20 12:54:05.492128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.646 [2024-11-20 12:54:05.492322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.646 [2024-11-20 12:54:05.492352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.646 [2024-11-20 12:54:05.496330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.646 [2024-11-20 12:54:05.496450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.646 [2024-11-20 12:54:05.496479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.646 [2024-11-20 12:54:05.500394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.646 [2024-11-20 12:54:05.500506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.646 [2024-11-20 12:54:05.500536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.646 [2024-11-20 12:54:05.504479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.646 [2024-11-20 12:54:05.504587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.646 [2024-11-20 12:54:05.504623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.646 [2024-11-20 12:54:05.508585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.646 [2024-11-20 12:54:05.508760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.646 [2024-11-20 12:54:05.508790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.512729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.512838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.512875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.516983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.517220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.517257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.521175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.521399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.521431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.525242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.525395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.525425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.529348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.529494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.529523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.533385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.533517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.533546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.537579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.537720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.537750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.541813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.541980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.542017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.545902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.546042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.546079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.550094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.550328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.550358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.554137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.554333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.554363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.558232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.558384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.558418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.562289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.562439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.562474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.566387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.566499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.566537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.570389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.570502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.570531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.574646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.574835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.574868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.579168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.579313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.579343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.583771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.584010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.584047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.588252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.588446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.588486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.592789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.592965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.592998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.597280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.597458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.597498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.601765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.601890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.601922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.606313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.606455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.606489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.610908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.611105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.611155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.616593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.616757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.616789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.621281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.621547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.621582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.647 [2024-11-20 12:54:05.625829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.647 [2024-11-20 12:54:05.626038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.647 [2024-11-20 12:54:05.626078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.630323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.630467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.630499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.634890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.635079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.635111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.639347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.639478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.639527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.643770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.643889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.643921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.648317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.648527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.648561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.652859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.653031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.653063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.657422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.657668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.657701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.661943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.662144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.662177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.666461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.666638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.666670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.670952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.671146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.671175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.675425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.675538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.675569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.679883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.680007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.680050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.684481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.684674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.684706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.688969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.689155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.689185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.693579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.693845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.693878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.698043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.698243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.698273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.702515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.702682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.702721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.707029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.707207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.707237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.711536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.711671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.711706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.715975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.716123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.716159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.720479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.720669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.720702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.724979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.725176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.725206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.729556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.729809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.729841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.734055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.734253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.734282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.738536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.738706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.738739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.743000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.743182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.743212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.747504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.648 [2024-11-20 12:54:05.747631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.648 [2024-11-20 12:54:05.747664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.648 [2024-11-20 12:54:05.751952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.649 [2024-11-20 12:54:05.752089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.649 [2024-11-20 12:54:05.752121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.909 [2024-11-20 12:54:05.756450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.909 [2024-11-20 12:54:05.756637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.909 [2024-11-20 12:54:05.756675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.909 [2024-11-20 12:54:05.760943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.909 [2024-11-20 12:54:05.761149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.909 [2024-11-20 12:54:05.761179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.909 [2024-11-20 12:54:05.765646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.909 [2024-11-20 12:54:05.765887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.909 [2024-11-20 12:54:05.765922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.909 [2024-11-20 12:54:05.770095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.909 [2024-11-20 12:54:05.770287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.909 [2024-11-20 12:54:05.770324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.909 [2024-11-20 12:54:05.774676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.909 [2024-11-20 12:54:05.774854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.909 [2024-11-20 12:54:05.774886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.909 [2024-11-20 12:54:05.779173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.779327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.779364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.783625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.783746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.783780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.788100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.788234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.788263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.792615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.792778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.792810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.797148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.797304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.797339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.801753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.801987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.802020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.806249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.806453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.806485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.810753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.810925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.810958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.815301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.815491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.815523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.819764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.819908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.819943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.824229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.824344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.824373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.828717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.828905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.828941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.833313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.833506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.833546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.838010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.838269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.838299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.842527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.842736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.842772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.847348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.847549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.847583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.853447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.853624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.853659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.860004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.860159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.860188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.866764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.866988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.867018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.873735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.873975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.874009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.880854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.881101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.881146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.887877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.888085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.888131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.894755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.894996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.895028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.901988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.902163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.902197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.908946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.909132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.909162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.916028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.916233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.916269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.923209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.923350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.910 [2024-11-20 12:54:05.923380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.910 [2024-11-20 12:54:05.930458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.910 [2024-11-20 12:54:05.930656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.930689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.937473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.937685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.937723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.944432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.944600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.944633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.951393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.951486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.951529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.958129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.958291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.958320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.965193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.965415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.965452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.972244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.972425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.972470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.979437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.979612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.979650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.986425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.986622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.986660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:05.993500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:05.993714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:05.993747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:06.000166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:06.000261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:06.000298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:06.005839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:06.005943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:06.005981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:06.010736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:32.911 [2024-11-20 12:54:06.010914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.911 [2024-11-20 12:54:06.010951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.911 [2024-11-20 12:54:06.015255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.015414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.015456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.019707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.019857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.019892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.024256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.024456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.024491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.029102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.029294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.029322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.035405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.035690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.035723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.041106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.041291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.041321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.046164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.046317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.046346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.050950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.051153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.051183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.055573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.055715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.055748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.060119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.060259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.060289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.065710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.065998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.066030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.071315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.071566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.071602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.078013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.078350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.078397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.084313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.084481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.084516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.091139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.091252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.091281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.096979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.097112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.097168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.102625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.102772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.102812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.108252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.108332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.108377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.113843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.113942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.113974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.119455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.119607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.119640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.125265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.125464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.171 [2024-11-20 12:54:06.125497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.171 [2024-11-20 12:54:06.130842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.171 [2024-11-20 12:54:06.130961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.131001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.136436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.136579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.136611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.142166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.142309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.142339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.147901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.148024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.148056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.153225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.153343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.153393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.157817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.158007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.158040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.162289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.162471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.162506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.166900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.167175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.167205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.171399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.171601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.171634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.175897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.176061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.176107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.180357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.180538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.180571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.184910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.185050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.185097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.189408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.189526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.189560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.193954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.194163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.194195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.198505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.198682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.198716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.203111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.203351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.203396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.207588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.207780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.207814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.212081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.212256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.212289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.216637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.216801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.216833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.221096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.221198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.221227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.225534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.225659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.225691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.230125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.230291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.230332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.234702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.234895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.234930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.239282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.239537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.239571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.243850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.244067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.244125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.248626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.248799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.248832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.253146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.253300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.253329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.172 [2024-11-20 12:54:06.257598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.172 [2024-11-20 12:54:06.257741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.172 [2024-11-20 12:54:06.257773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.173 [2024-11-20 12:54:06.261792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.173 [2024-11-20 12:54:06.261916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.173 [2024-11-20 12:54:06.261953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.173 [2024-11-20 12:54:06.266311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.173 [2024-11-20 12:54:06.266514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.173 [2024-11-20 12:54:06.266546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.173 [2024-11-20 12:54:06.270890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.173 [2024-11-20 12:54:06.271057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.173 [2024-11-20 12:54:06.271099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.173 [2024-11-20 12:54:06.275457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.173 [2024-11-20 12:54:06.275705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.173 [2024-11-20 12:54:06.275739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.279982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.280202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.280233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.284375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.284553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.284595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.288935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.289133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.289163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.293499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.293658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.293692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.298356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.298512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.298545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.302986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.303211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.303241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.308345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.308658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.308688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.313989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.314239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.314275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.320296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.320497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.320532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.325746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.325965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.325997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.331911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.332083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.332115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.336863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.337034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.337067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.341362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.341492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.341526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.345905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.346121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.432 [2024-11-20 12:54:06.346151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.432 [2024-11-20 12:54:06.350452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.432 [2024-11-20 12:54:06.350638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.350670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.355012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.355267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.355307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.359497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.359711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.359747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.363980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.364168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.364198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.369583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.369699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.369735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.374321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.374452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.374484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.378848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.378974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.379007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.383401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.383598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.383633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.387911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.388117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.388148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.392451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.392718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.392751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.396971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.397182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.397212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.401496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.401669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.401701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.406051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.406239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.406271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.410626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.410766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.410800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.415080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.415222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.415252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.419663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.419856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.419889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.424240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.424428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.424461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.428825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.429093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.429126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.433330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.433532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.433577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.437842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.438014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.438048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.442381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.442548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.442578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.446844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.446974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.433 [2024-11-20 12:54:06.447015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.433 [2024-11-20 12:54:06.451291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.433 [2024-11-20 12:54:06.451434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.451472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.455794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.455979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.456019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.460144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.460319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.460364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.465035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.465205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.465235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.469369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.469545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.469573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.473538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.473674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.473712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.477728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.477876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.477904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.481939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.482060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.482105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.486123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.486247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.486278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.490614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.490805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.490837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.495104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.495266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.495295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.499759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.500002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.500041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.504223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.504420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.504453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.508648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.508826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.508859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.513184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.513346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.513393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.517441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.517615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.517643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.522412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.522526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.522555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.526749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.526949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.526980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.532169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.434 [2024-11-20 12:54:06.532421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.434 [2024-11-20 12:54:06.532449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.434 [2024-11-20 12:54:06.537782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.693 [2024-11-20 12:54:06.538024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.693 [2024-11-20 12:54:06.538057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.693 [2024-11-20 12:54:06.544267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.693 [2024-11-20 12:54:06.544489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.693 [2024-11-20 12:54:06.544520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.693 [2024-11-20 12:54:06.550047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.693 [2024-11-20 12:54:06.550226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.693 [2024-11-20 12:54:06.550264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.693 [2024-11-20 12:54:06.554525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.693 [2024-11-20 12:54:06.554685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.693 [2024-11-20 12:54:06.554714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.559050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.559197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.559228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.563585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.563709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.563744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.568209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.568396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.568430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.573767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.573918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.573950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.578456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.578716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.578751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.582905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.583142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.583172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.587085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.587241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.587271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.591273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.591442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.591470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.595456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.595564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.595600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.599481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.599604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.599632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.603619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.603781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.603809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.607977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.608174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.608204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.612568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.612814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.612846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.617091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.617254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.617283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.621556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.621720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.621759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.626103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.626278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.626308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.630637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.630775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.630814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.635137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.635261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.635294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.639680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.639867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.639900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.644237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.644411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.644444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.648823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.649056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.649097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.653290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.653488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.653526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.657782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.694 [2024-11-20 12:54:06.657949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.694 [2024-11-20 12:54:06.657984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.694 [2024-11-20 12:54:06.662397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.662576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.662608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.666866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.666998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.667026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.671384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.671520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.671553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.675962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.676170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.676205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.680497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.680667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.680700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.685083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.685328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.685358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.689547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.689723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.689755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.694015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.694178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.694210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.698559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.698729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.698760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.703027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.703176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.703204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.707484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.707612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.707645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.712050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.712247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.712281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.716568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.716747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.716780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.721199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.721441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.721476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.725695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.725890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.725922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.730254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.730392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.730438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.734795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.734961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.734994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.739279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.739394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.739440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.743718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.743831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.743865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.748260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.748427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.748473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.752763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.752940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.752979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.757340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.695 [2024-11-20 12:54:06.757577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.695 [2024-11-20 12:54:06.757615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.695 [2024-11-20 12:54:06.761814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.762000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.762031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.766308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.766467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.766513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.770826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.770996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.771036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.775294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.775432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.775463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.779760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.779880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.779912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.784360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.784559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.784591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.788857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.789036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.789084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.793502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.793748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.793780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.696 [2024-11-20 12:54:06.797934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.696 [2024-11-20 12:54:06.798164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.696 [2024-11-20 12:54:06.798196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.954 [2024-11-20 12:54:06.802430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.954 [2024-11-20 12:54:06.802607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.954 [2024-11-20 12:54:06.802639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.954 [2024-11-20 12:54:06.806922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.954 [2024-11-20 12:54:06.807077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.954 [2024-11-20 12:54:06.807109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.954 [2024-11-20 12:54:06.811413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.954 [2024-11-20 12:54:06.811540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.954 [2024-11-20 12:54:06.811571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.954 [2024-11-20 12:54:06.815866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.954 [2024-11-20 12:54:06.815996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.954 [2024-11-20 12:54:06.816028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.954 [2024-11-20 12:54:06.820328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.954 [2024-11-20 12:54:06.820519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.954 [2024-11-20 12:54:06.820550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.954 [2024-11-20 12:54:06.824875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.954 [2024-11-20 12:54:06.825053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.825099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.829407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.829650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.829689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.833866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.834058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.834099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.838390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.838553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.838586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.842903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.843084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.843116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.847432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.847560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.847593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.851833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.851964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.851993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.856406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.856604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.856636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.860919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.861105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.861151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.865539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.865795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.865827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.870029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.870241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.870270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.955 [2024-11-20 12:54:06.874606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1271fb0) with pdu=0x2000190fef90 00:26:33.955 [2024-11-20 12:54:06.874778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.955 [2024-11-20 12:54:06.874810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:33.955 00:26:33.955 Latency(us) 00:26:33.955 [2024-11-20T11:54:07.063Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:33.955 [2024-11-20T11:54:07.063Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:33.955 nvme0n1 : 2.00 6471.63 808.95 0.00 0.00 2464.85 1735.49 7524.50 00:26:33.955 [2024-11-20T11:54:07.063Z] =================================================================================================================== 00:26:33.955 [2024-11-20T11:54:07.063Z] Total : 6471.63 808.95 0.00 0.00 2464.85 1735.49 7524.50 00:26:33.955 0 00:26:33.955 12:54:06 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:33.955 12:54:06 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:33.955 12:54:06 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:33.955 | .driver_specific 00:26:33.955 | .nvme_error 00:26:33.955 | .status_code 00:26:33.955 | .command_transient_transport_error' 00:26:33.955 12:54:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:34.213 12:54:07 -- host/digest.sh@71 -- # (( 417 > 0 )) 00:26:34.213 12:54:07 -- host/digest.sh@73 -- # killprocess 3637206 00:26:34.213 12:54:07 -- common/autotest_common.sh@936 -- # '[' -z 3637206 ']' 00:26:34.213 12:54:07 -- common/autotest_common.sh@940 -- # kill -0 3637206 00:26:34.213 12:54:07 -- common/autotest_common.sh@941 -- # uname 00:26:34.213 12:54:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:34.214 12:54:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3637206 00:26:34.214 12:54:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:34.214 12:54:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:34.214 12:54:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3637206' 00:26:34.214 killing process with pid 3637206 00:26:34.214 12:54:07 -- common/autotest_common.sh@955 -- # kill 3637206 00:26:34.214 Received shutdown signal, test time was about 2.000000 seconds 00:26:34.214 00:26:34.214 Latency(us) 00:26:34.214 [2024-11-20T11:54:07.322Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:34.214 [2024-11-20T11:54:07.322Z] =================================================================================================================== 00:26:34.214 [2024-11-20T11:54:07.322Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:34.214 12:54:07 -- common/autotest_common.sh@960 -- # wait 3637206 00:26:34.473 12:54:07 -- host/digest.sh@115 -- # killprocess 3635399 00:26:34.473 12:54:07 -- common/autotest_common.sh@936 -- # '[' -z 3635399 ']' 00:26:34.473 12:54:07 -- common/autotest_common.sh@940 -- # kill -0 3635399 00:26:34.473 12:54:07 -- common/autotest_common.sh@941 -- # uname 00:26:34.473 12:54:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:34.473 12:54:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3635399 00:26:34.473 12:54:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:34.473 12:54:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:34.473 12:54:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3635399' 00:26:34.473 killing process with pid 3635399 00:26:34.473 12:54:07 -- common/autotest_common.sh@955 -- # kill 3635399 00:26:34.473 12:54:07 -- common/autotest_common.sh@960 -- # wait 3635399 00:26:34.733 00:26:34.733 real 0m18.817s 00:26:34.733 user 0m38.199s 00:26:34.733 sys 0m4.665s 00:26:34.733 12:54:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:34.733 12:54:07 -- common/autotest_common.sh@10 -- # set +x 00:26:34.733 ************************************ 00:26:34.733 END TEST nvmf_digest_error 00:26:34.733 ************************************ 00:26:34.733 12:54:07 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:34.733 12:54:07 -- host/digest.sh@139 -- # nvmftestfini 00:26:34.733 12:54:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:34.733 12:54:07 -- nvmf/common.sh@116 -- # sync 00:26:34.733 12:54:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:34.733 12:54:07 -- nvmf/common.sh@119 -- # set +e 00:26:34.733 12:54:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:34.733 12:54:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:34.733 rmmod nvme_tcp 00:26:34.733 rmmod nvme_fabrics 00:26:34.733 rmmod nvme_keyring 00:26:34.994 12:54:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:34.994 12:54:07 -- nvmf/common.sh@123 -- # set -e 00:26:34.994 12:54:07 -- nvmf/common.sh@124 -- # return 0 00:26:34.994 12:54:07 -- nvmf/common.sh@477 -- # '[' -n 3635399 ']' 00:26:34.994 12:54:07 -- nvmf/common.sh@478 -- # killprocess 3635399 00:26:34.994 12:54:07 -- common/autotest_common.sh@936 -- # '[' -z 3635399 ']' 00:26:34.994 12:54:07 -- common/autotest_common.sh@940 -- # kill -0 3635399 00:26:34.994 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3635399) - No such process 00:26:34.994 12:54:07 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3635399 is not found' 00:26:34.994 Process with pid 3635399 is not found 00:26:34.994 12:54:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:34.994 12:54:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:34.994 12:54:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:34.994 12:54:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:34.994 12:54:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:34.994 12:54:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:34.994 12:54:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:34.994 12:54:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:36.897 12:54:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:36.897 00:26:36.897 real 0m39.082s 00:26:36.897 user 1m10.094s 00:26:36.897 sys 0m10.752s 00:26:36.897 12:54:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:36.897 12:54:09 -- common/autotest_common.sh@10 -- # set +x 00:26:36.897 ************************************ 00:26:36.897 END TEST nvmf_digest 00:26:36.897 ************************************ 00:26:36.897 12:54:09 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:36.897 12:54:09 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:36.897 12:54:09 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:36.897 12:54:09 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:36.897 12:54:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:36.897 12:54:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:36.897 12:54:09 -- common/autotest_common.sh@10 -- # set +x 00:26:36.897 ************************************ 00:26:36.897 START TEST nvmf_bdevperf 00:26:36.897 ************************************ 00:26:36.897 12:54:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:36.897 * Looking for test storage... 00:26:36.897 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:36.897 12:54:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:36.897 12:54:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:36.897 12:54:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:37.156 12:54:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:37.156 12:54:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:37.156 12:54:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:37.156 12:54:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:37.156 12:54:10 -- scripts/common.sh@335 -- # IFS=.-: 00:26:37.156 12:54:10 -- scripts/common.sh@335 -- # read -ra ver1 00:26:37.156 12:54:10 -- scripts/common.sh@336 -- # IFS=.-: 00:26:37.156 12:54:10 -- scripts/common.sh@336 -- # read -ra ver2 00:26:37.156 12:54:10 -- scripts/common.sh@337 -- # local 'op=<' 00:26:37.156 12:54:10 -- scripts/common.sh@339 -- # ver1_l=2 00:26:37.156 12:54:10 -- scripts/common.sh@340 -- # ver2_l=1 00:26:37.156 12:54:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:37.156 12:54:10 -- scripts/common.sh@343 -- # case "$op" in 00:26:37.156 12:54:10 -- scripts/common.sh@344 -- # : 1 00:26:37.156 12:54:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:37.156 12:54:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:37.156 12:54:10 -- scripts/common.sh@364 -- # decimal 1 00:26:37.156 12:54:10 -- scripts/common.sh@352 -- # local d=1 00:26:37.156 12:54:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:37.156 12:54:10 -- scripts/common.sh@354 -- # echo 1 00:26:37.156 12:54:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:37.156 12:54:10 -- scripts/common.sh@365 -- # decimal 2 00:26:37.156 12:54:10 -- scripts/common.sh@352 -- # local d=2 00:26:37.156 12:54:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:37.156 12:54:10 -- scripts/common.sh@354 -- # echo 2 00:26:37.156 12:54:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:37.156 12:54:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:37.156 12:54:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:37.156 12:54:10 -- scripts/common.sh@367 -- # return 0 00:26:37.156 12:54:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:37.156 12:54:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:37.156 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.156 --rc genhtml_branch_coverage=1 00:26:37.156 --rc genhtml_function_coverage=1 00:26:37.156 --rc genhtml_legend=1 00:26:37.156 --rc geninfo_all_blocks=1 00:26:37.156 --rc geninfo_unexecuted_blocks=1 00:26:37.156 00:26:37.156 ' 00:26:37.156 12:54:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:37.156 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.156 --rc genhtml_branch_coverage=1 00:26:37.156 --rc genhtml_function_coverage=1 00:26:37.156 --rc genhtml_legend=1 00:26:37.156 --rc geninfo_all_blocks=1 00:26:37.156 --rc geninfo_unexecuted_blocks=1 00:26:37.156 00:26:37.156 ' 00:26:37.156 12:54:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:37.156 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.156 --rc genhtml_branch_coverage=1 00:26:37.156 --rc genhtml_function_coverage=1 00:26:37.156 --rc genhtml_legend=1 00:26:37.156 --rc geninfo_all_blocks=1 00:26:37.156 --rc geninfo_unexecuted_blocks=1 00:26:37.156 00:26:37.156 ' 00:26:37.156 12:54:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:37.156 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.156 --rc genhtml_branch_coverage=1 00:26:37.156 --rc genhtml_function_coverage=1 00:26:37.156 --rc genhtml_legend=1 00:26:37.156 --rc geninfo_all_blocks=1 00:26:37.156 --rc geninfo_unexecuted_blocks=1 00:26:37.156 00:26:37.156 ' 00:26:37.156 12:54:10 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:37.156 12:54:10 -- nvmf/common.sh@7 -- # uname -s 00:26:37.156 12:54:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:37.156 12:54:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:37.156 12:54:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:37.156 12:54:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:37.156 12:54:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:37.156 12:54:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:37.156 12:54:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:37.156 12:54:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:37.156 12:54:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:37.156 12:54:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:37.156 12:54:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.156 12:54:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.156 12:54:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:37.156 12:54:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:37.156 12:54:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:37.156 12:54:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:37.156 12:54:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:37.156 12:54:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:37.157 12:54:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:37.157 12:54:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.157 12:54:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.157 12:54:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.157 12:54:10 -- paths/export.sh@5 -- # export PATH 00:26:37.157 12:54:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.157 12:54:10 -- nvmf/common.sh@46 -- # : 0 00:26:37.157 12:54:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:37.157 12:54:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:37.157 12:54:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:37.157 12:54:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:37.157 12:54:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:37.157 12:54:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:37.157 12:54:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:37.157 12:54:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:37.157 12:54:10 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:37.157 12:54:10 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:37.157 12:54:10 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:37.157 12:54:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:37.157 12:54:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:37.157 12:54:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:37.157 12:54:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:37.157 12:54:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:37.157 12:54:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.157 12:54:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.157 12:54:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.157 12:54:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:37.157 12:54:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:37.157 12:54:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:37.157 12:54:10 -- common/autotest_common.sh@10 -- # set +x 00:26:39.057 12:54:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:39.057 12:54:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:39.057 12:54:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:39.057 12:54:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:39.057 12:54:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:39.057 12:54:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:39.058 12:54:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:39.058 12:54:11 -- nvmf/common.sh@294 -- # net_devs=() 00:26:39.058 12:54:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:39.058 12:54:11 -- nvmf/common.sh@295 -- # e810=() 00:26:39.058 12:54:11 -- nvmf/common.sh@295 -- # local -ga e810 00:26:39.058 12:54:11 -- nvmf/common.sh@296 -- # x722=() 00:26:39.058 12:54:11 -- nvmf/common.sh@296 -- # local -ga x722 00:26:39.058 12:54:11 -- nvmf/common.sh@297 -- # mlx=() 00:26:39.058 12:54:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:39.058 12:54:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:39.058 12:54:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:39.058 12:54:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:39.058 12:54:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:39.058 12:54:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.058 12:54:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:39.058 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:39.058 12:54:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.058 12:54:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:39.058 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:39.058 12:54:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:39.058 12:54:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.058 12:54:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.058 12:54:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.058 12:54:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.058 12:54:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:39.058 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:39.058 12:54:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.058 12:54:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.058 12:54:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.058 12:54:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.058 12:54:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.058 12:54:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:39.058 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:39.058 12:54:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.058 12:54:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:39.058 12:54:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:39.058 12:54:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:39.058 12:54:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:39.058 12:54:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:39.058 12:54:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:39.058 12:54:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:39.058 12:54:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:39.058 12:54:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:39.058 12:54:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:39.058 12:54:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:39.058 12:54:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:39.058 12:54:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:39.058 12:54:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:39.058 12:54:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:39.058 12:54:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:39.058 12:54:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:39.058 12:54:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:39.058 12:54:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:39.058 12:54:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:39.058 12:54:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:39.058 12:54:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:39.058 12:54:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:39.058 12:54:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:39.058 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:39.058 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:26:39.058 00:26:39.058 --- 10.0.0.2 ping statistics --- 00:26:39.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.058 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:26:39.058 12:54:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:39.058 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:39.058 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.169 ms 00:26:39.058 00:26:39.058 --- 10.0.0.1 ping statistics --- 00:26:39.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.058 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:26:39.058 12:54:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:39.058 12:54:12 -- nvmf/common.sh@410 -- # return 0 00:26:39.058 12:54:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:39.058 12:54:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:39.058 12:54:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:39.058 12:54:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:39.058 12:54:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:39.058 12:54:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:39.058 12:54:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:39.058 12:54:12 -- host/bdevperf.sh@25 -- # tgt_init 00:26:39.058 12:54:12 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:39.058 12:54:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:39.058 12:54:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:39.058 12:54:12 -- common/autotest_common.sh@10 -- # set +x 00:26:39.058 12:54:12 -- nvmf/common.sh@469 -- # nvmfpid=3640227 00:26:39.058 12:54:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:39.058 12:54:12 -- nvmf/common.sh@470 -- # waitforlisten 3640227 00:26:39.058 12:54:12 -- common/autotest_common.sh@829 -- # '[' -z 3640227 ']' 00:26:39.058 12:54:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:39.058 12:54:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:39.058 12:54:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:39.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:39.058 12:54:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:39.058 12:54:12 -- common/autotest_common.sh@10 -- # set +x 00:26:39.316 [2024-11-20 12:54:12.181136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:39.316 [2024-11-20 12:54:12.181212] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:39.316 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.317 [2024-11-20 12:54:12.248450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:39.317 [2024-11-20 12:54:12.366284] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:39.317 [2024-11-20 12:54:12.366429] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:39.317 [2024-11-20 12:54:12.366445] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:39.317 [2024-11-20 12:54:12.366457] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:39.317 [2024-11-20 12:54:12.366531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:39.317 [2024-11-20 12:54:12.366611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:39.317 [2024-11-20 12:54:12.366613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:40.252 12:54:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.252 12:54:13 -- common/autotest_common.sh@862 -- # return 0 00:26:40.252 12:54:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:40.252 12:54:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:40.252 12:54:13 -- common/autotest_common.sh@10 -- # set +x 00:26:40.252 12:54:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:40.252 12:54:13 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:40.252 12:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.252 12:54:13 -- common/autotest_common.sh@10 -- # set +x 00:26:40.252 [2024-11-20 12:54:13.171139] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:40.252 12:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.252 12:54:13 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:40.252 12:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.252 12:54:13 -- common/autotest_common.sh@10 -- # set +x 00:26:40.252 Malloc0 00:26:40.252 12:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.252 12:54:13 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:40.252 12:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.252 12:54:13 -- common/autotest_common.sh@10 -- # set +x 00:26:40.252 12:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.252 12:54:13 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:40.252 12:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.252 12:54:13 -- common/autotest_common.sh@10 -- # set +x 00:26:40.252 12:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.252 12:54:13 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:40.252 12:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.252 12:54:13 -- common/autotest_common.sh@10 -- # set +x 00:26:40.252 [2024-11-20 12:54:13.229932] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:40.252 12:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.252 12:54:13 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:26:40.252 12:54:13 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:26:40.252 12:54:13 -- nvmf/common.sh@520 -- # config=() 00:26:40.252 12:54:13 -- nvmf/common.sh@520 -- # local subsystem config 00:26:40.252 12:54:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:40.252 12:54:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:40.252 { 00:26:40.252 "params": { 00:26:40.252 "name": "Nvme$subsystem", 00:26:40.252 "trtype": "$TEST_TRANSPORT", 00:26:40.252 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:40.252 "adrfam": "ipv4", 00:26:40.252 "trsvcid": "$NVMF_PORT", 00:26:40.252 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:40.252 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:40.252 "hdgst": ${hdgst:-false}, 00:26:40.252 "ddgst": ${ddgst:-false} 00:26:40.252 }, 00:26:40.252 "method": "bdev_nvme_attach_controller" 00:26:40.252 } 00:26:40.252 EOF 00:26:40.252 )") 00:26:40.252 12:54:13 -- nvmf/common.sh@542 -- # cat 00:26:40.252 12:54:13 -- nvmf/common.sh@544 -- # jq . 00:26:40.252 12:54:13 -- nvmf/common.sh@545 -- # IFS=, 00:26:40.252 12:54:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:40.252 "params": { 00:26:40.252 "name": "Nvme1", 00:26:40.252 "trtype": "tcp", 00:26:40.252 "traddr": "10.0.0.2", 00:26:40.252 "adrfam": "ipv4", 00:26:40.252 "trsvcid": "4420", 00:26:40.252 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:40.252 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:40.252 "hdgst": false, 00:26:40.252 "ddgst": false 00:26:40.252 }, 00:26:40.252 "method": "bdev_nvme_attach_controller" 00:26:40.252 }' 00:26:40.252 [2024-11-20 12:54:13.273544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:40.252 [2024-11-20 12:54:13.273610] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3640382 ] 00:26:40.252 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.252 [2024-11-20 12:54:13.332775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.512 [2024-11-20 12:54:13.443061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.770 Running I/O for 1 seconds... 00:26:41.706 00:26:41.706 Latency(us) 00:26:41.706 [2024-11-20T11:54:14.814Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:41.706 [2024-11-20T11:54:14.814Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:41.706 Verification LBA range: start 0x0 length 0x4000 00:26:41.706 Nvme1n1 : 1.01 12931.35 50.51 0.00 0.00 9857.57 1219.70 15728.64 00:26:41.706 [2024-11-20T11:54:14.814Z] =================================================================================================================== 00:26:41.706 [2024-11-20T11:54:14.814Z] Total : 12931.35 50.51 0.00 0.00 9857.57 1219.70 15728.64 00:26:41.965 12:54:15 -- host/bdevperf.sh@30 -- # bdevperfpid=3640654 00:26:41.965 12:54:15 -- host/bdevperf.sh@32 -- # sleep 3 00:26:41.965 12:54:15 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:26:41.965 12:54:15 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:26:41.965 12:54:15 -- nvmf/common.sh@520 -- # config=() 00:26:41.965 12:54:15 -- nvmf/common.sh@520 -- # local subsystem config 00:26:41.965 12:54:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:41.965 12:54:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:41.965 { 00:26:41.965 "params": { 00:26:41.965 "name": "Nvme$subsystem", 00:26:41.965 "trtype": "$TEST_TRANSPORT", 00:26:41.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.965 "adrfam": "ipv4", 00:26:41.965 "trsvcid": "$NVMF_PORT", 00:26:41.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.965 "hdgst": ${hdgst:-false}, 00:26:41.965 "ddgst": ${ddgst:-false} 00:26:41.965 }, 00:26:41.965 "method": "bdev_nvme_attach_controller" 00:26:41.965 } 00:26:41.965 EOF 00:26:41.965 )") 00:26:41.965 12:54:15 -- nvmf/common.sh@542 -- # cat 00:26:41.965 12:54:15 -- nvmf/common.sh@544 -- # jq . 00:26:41.965 12:54:15 -- nvmf/common.sh@545 -- # IFS=, 00:26:41.965 12:54:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:41.965 "params": { 00:26:41.965 "name": "Nvme1", 00:26:41.965 "trtype": "tcp", 00:26:41.965 "traddr": "10.0.0.2", 00:26:41.965 "adrfam": "ipv4", 00:26:41.965 "trsvcid": "4420", 00:26:41.965 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:41.965 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:41.965 "hdgst": false, 00:26:41.965 "ddgst": false 00:26:41.965 }, 00:26:41.965 "method": "bdev_nvme_attach_controller" 00:26:41.965 }' 00:26:42.225 [2024-11-20 12:54:15.101794] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:42.225 [2024-11-20 12:54:15.101867] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3640654 ] 00:26:42.225 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.225 [2024-11-20 12:54:15.161686] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:42.226 [2024-11-20 12:54:15.269809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:42.484 Running I/O for 15 seconds... 00:26:45.022 12:54:18 -- host/bdevperf.sh@33 -- # kill -9 3640227 00:26:45.022 12:54:18 -- host/bdevperf.sh@35 -- # sleep 3 00:26:45.022 [2024-11-20 12:54:18.072302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:127768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:127776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:127792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:127800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:127832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:127840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:127856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:127864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:128464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:128480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:128488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.022 [2024-11-20 12:54:18.072715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.022 [2024-11-20 12:54:18.072730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:128496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:128504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:128512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:128560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:128584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:127872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:127880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.072969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.072987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:127888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:127896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:127912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:127920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:127952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:127960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:128632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:128640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:128656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:128672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.073307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:128680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.073341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:128688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:128696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.073422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:127992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:128000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:128008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:128016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:128024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:128032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:128048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:128056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:128704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:128712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:128720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.073789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:128728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:128736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:128744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.073887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:128752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.073920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:128760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.073970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:128768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.023 [2024-11-20 12:54:18.073986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.074003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:128776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.074019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.074036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:128784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.074053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.023 [2024-11-20 12:54:18.074077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:128792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.023 [2024-11-20 12:54:18.074096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:128800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:128808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:128816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:128104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:128112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:128120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:128144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:128152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:128160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:128168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:128192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:128824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:128832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:128848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:128856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:128864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.074670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:128208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:128224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:128272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:128288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:128296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:128336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:128344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:128352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:128872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.074981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:128880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.074997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:128888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:128896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:128904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.024 [2024-11-20 12:54:18.075129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:128456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:128472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:128520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:128528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:128536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:128544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:128552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:128568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:128912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.024 [2024-11-20 12:54:18.075406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.024 [2024-11-20 12:54:18.075439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:128920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:128928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:128936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:128944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:128952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:128960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:128968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:128976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:128984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:128992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:129000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:129008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.075818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:129016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:129024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:129032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:129040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.075972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:129048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.075987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:129056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:129064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:129072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:129080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:129088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:129096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:129104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:129112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:129120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:129128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:129136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:129144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:129152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.025 [2024-11-20 12:54:18.076450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:128576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:128592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:128600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:128608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:128616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:128624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:128648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.025 [2024-11-20 12:54:18.076679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1238740 is same with the state(5) to be set 00:26:45.025 [2024-11-20 12:54:18.076715] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:45.025 [2024-11-20 12:54:18.076727] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:45.025 [2024-11-20 12:54:18.076748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:128664 len:8 PRP1 0x0 PRP2 0x0 00:26:45.025 [2024-11-20 12:54:18.076764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.025 [2024-11-20 12:54:18.076841] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1238740 was disconnected and freed. reset controller. 00:26:45.025 [2024-11-20 12:54:18.076918] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.026 [2024-11-20 12:54:18.076943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.026 [2024-11-20 12:54:18.076961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.026 [2024-11-20 12:54:18.076976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.026 [2024-11-20 12:54:18.076992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.026 [2024-11-20 12:54:18.077006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.026 [2024-11-20 12:54:18.077022] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.026 [2024-11-20 12:54:18.077036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.026 [2024-11-20 12:54:18.077051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.026 [2024-11-20 12:54:18.079449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.026 [2024-11-20 12:54:18.079490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.026 [2024-11-20 12:54:18.080023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.080204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.080231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.026 [2024-11-20 12:54:18.080248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.026 [2024-11-20 12:54:18.080423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.026 [2024-11-20 12:54:18.080612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.026 [2024-11-20 12:54:18.080635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.026 [2024-11-20 12:54:18.080654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.026 [2024-11-20 12:54:18.083274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.026 [2024-11-20 12:54:18.092427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.026 [2024-11-20 12:54:18.092728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.092904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.092934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.026 [2024-11-20 12:54:18.092952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.026 [2024-11-20 12:54:18.093150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.026 [2024-11-20 12:54:18.093341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.026 [2024-11-20 12:54:18.093371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.026 [2024-11-20 12:54:18.093388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.026 [2024-11-20 12:54:18.095534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.026 [2024-11-20 12:54:18.105017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.026 [2024-11-20 12:54:18.105383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.105550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.105579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.026 [2024-11-20 12:54:18.105597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.026 [2024-11-20 12:54:18.105781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.026 [2024-11-20 12:54:18.105952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.026 [2024-11-20 12:54:18.105976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.026 [2024-11-20 12:54:18.105991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.026 [2024-11-20 12:54:18.108328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.026 [2024-11-20 12:54:18.117663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.026 [2024-11-20 12:54:18.117997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.118132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.026 [2024-11-20 12:54:18.118164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.026 [2024-11-20 12:54:18.118181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.026 [2024-11-20 12:54:18.118330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.026 [2024-11-20 12:54:18.118519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.026 [2024-11-20 12:54:18.118543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.026 [2024-11-20 12:54:18.118558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.026 [2024-11-20 12:54:18.121046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.286 [2024-11-20 12:54:18.130452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.286 [2024-11-20 12:54:18.130918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.131085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.131115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.286 [2024-11-20 12:54:18.131133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.286 [2024-11-20 12:54:18.131299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.286 [2024-11-20 12:54:18.131469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.286 [2024-11-20 12:54:18.131493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.286 [2024-11-20 12:54:18.131515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.286 [2024-11-20 12:54:18.133643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.286 [2024-11-20 12:54:18.143061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.286 [2024-11-20 12:54:18.143395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.143532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.143574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.286 [2024-11-20 12:54:18.143590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.286 [2024-11-20 12:54:18.143706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.286 [2024-11-20 12:54:18.143905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.286 [2024-11-20 12:54:18.143929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.286 [2024-11-20 12:54:18.143944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.286 [2024-11-20 12:54:18.146100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.286 [2024-11-20 12:54:18.155561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.286 [2024-11-20 12:54:18.155856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.156037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.156063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.286 [2024-11-20 12:54:18.156089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.286 [2024-11-20 12:54:18.156289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.286 [2024-11-20 12:54:18.156477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.286 [2024-11-20 12:54:18.156501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.286 [2024-11-20 12:54:18.156517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.286 [2024-11-20 12:54:18.158998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.286 [2024-11-20 12:54:18.167980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.286 [2024-11-20 12:54:18.168252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.286 [2024-11-20 12:54:18.168393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.168422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.168439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.168641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.168829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.168853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.168868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.171278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.180682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.180993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.181130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.181160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.181177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.181325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.181460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.181483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.181498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.184033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.193337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.193650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.193837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.193863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.193879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.194088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.194294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.194318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.194334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.196726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.205792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.206149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.206268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.206313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.206330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.206496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.206673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.206697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.206712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.208950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.218130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.218441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.218590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.218619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.218637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.218749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.218900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.218923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.218939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.221180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.230686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.231046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.231228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.231257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.231275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.231423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.231593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.231616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.231631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.233953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.243390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.243753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.243892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.243920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.243938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.244153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.244324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.244348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.244363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.246688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.255904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.256212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.256332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.256360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.256378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.256471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.256604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.256627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.256643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.259037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.268696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.269018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.269170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.269199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.269216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.269364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.269515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.287 [2024-11-20 12:54:18.269538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.287 [2024-11-20 12:54:18.269554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.287 [2024-11-20 12:54:18.272000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.287 [2024-11-20 12:54:18.281117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.287 [2024-11-20 12:54:18.281429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.281536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.287 [2024-11-20 12:54:18.281564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.287 [2024-11-20 12:54:18.281582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.287 [2024-11-20 12:54:18.281729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.287 [2024-11-20 12:54:18.281900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.281923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.281938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.284214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.293552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.293888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.294016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.294046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.294062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.294235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.294405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.294429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.294445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.296981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.306106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.306424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.306588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.306616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.306633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.306834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.307039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.307063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.307092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.309562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.318677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.319003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.319141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.319171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.319189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.319409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.319543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.319567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.319582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.321756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.331346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.331663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.331831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.331861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.331884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.332079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.332269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.332293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.332309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.334702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.343915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.344258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.344394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.344420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.344436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.344633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.344823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.344856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.344872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.347112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.356395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.356793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.357002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.357028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.357045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.357186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.357412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.357436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.357452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.359699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.368980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.369298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.369513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.369568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.369586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.369793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.369946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.369969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.369985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.372423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.288 [2024-11-20 12:54:18.381570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.288 [2024-11-20 12:54:18.381896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.382013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.288 [2024-11-20 12:54:18.382042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.288 [2024-11-20 12:54:18.382060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.288 [2024-11-20 12:54:18.382219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.288 [2024-11-20 12:54:18.382336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.288 [2024-11-20 12:54:18.382369] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.288 [2024-11-20 12:54:18.382384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.288 [2024-11-20 12:54:18.384813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.394026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.394390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.394533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.394563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.394582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.394748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.394918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.394941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.394956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.397361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.406512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.406890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.407111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.407137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.407153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.407346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.407567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.407591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.407607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.409986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.419250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.419535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.419714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.419764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.419782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.419948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.420128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.420153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.420168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.422396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.431839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.432174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.432320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.432349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.432366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.432514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.432649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.432672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.432687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.435045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.444569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.444868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.445022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.445048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.445064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.445223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.445402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.445432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.445448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.447738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.457039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.457381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.457522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.457565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.457581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.457746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.457908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.457932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.457948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.460433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.469626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.469944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.470143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.470170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.470185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.470368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.470556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.470580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.470596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.472775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.482205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.482530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.482635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.482664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.482682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.482810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.482999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.483023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.483044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.485419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.550 [2024-11-20 12:54:18.494859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.550 [2024-11-20 12:54:18.495143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.495259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.550 [2024-11-20 12:54:18.495288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.550 [2024-11-20 12:54:18.495306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.550 [2024-11-20 12:54:18.495489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.550 [2024-11-20 12:54:18.495695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.550 [2024-11-20 12:54:18.495718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.550 [2024-11-20 12:54:18.495734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.550 [2024-11-20 12:54:18.498183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.507307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.507684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.507853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.507893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.507911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.508059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.508205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.508226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.508239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.510463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.519951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.520292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.520458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.520486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.520503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.520740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.520893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.520916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.520932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.523180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.532402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.532694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.532875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.532904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.532921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.533032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.533230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.533255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.533271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.535467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.544860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.545128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.545297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.545326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.545344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.545528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.545699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.545722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.545738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.548200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.557590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.557927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.558113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.558156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.558172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.558273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.558431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.558454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.558470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.560649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.570306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.570597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.570738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.570766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.570783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.570949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.571113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.571138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.571154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.573584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.582812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.583099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.583305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.583356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.583374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.583576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.583746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.583770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.583785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.585893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.595353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.595674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.595838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.595867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.595885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.596033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.596176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.596202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.596218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.598561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.607909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.608222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.608367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.608396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.551 [2024-11-20 12:54:18.608414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.551 [2024-11-20 12:54:18.608579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.551 [2024-11-20 12:54:18.608750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.551 [2024-11-20 12:54:18.608773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.551 [2024-11-20 12:54:18.608789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.551 [2024-11-20 12:54:18.611052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.551 [2024-11-20 12:54:18.620540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.551 [2024-11-20 12:54:18.620830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.620998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.551 [2024-11-20 12:54:18.621028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.552 [2024-11-20 12:54:18.621046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.552 [2024-11-20 12:54:18.621243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.552 [2024-11-20 12:54:18.621450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.552 [2024-11-20 12:54:18.621475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.552 [2024-11-20 12:54:18.621491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.552 [2024-11-20 12:54:18.623855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.552 [2024-11-20 12:54:18.633328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.552 [2024-11-20 12:54:18.633727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.552 [2024-11-20 12:54:18.633896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.552 [2024-11-20 12:54:18.633924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.552 [2024-11-20 12:54:18.633942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.552 [2024-11-20 12:54:18.634119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.552 [2024-11-20 12:54:18.634263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.552 [2024-11-20 12:54:18.634286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.552 [2024-11-20 12:54:18.634301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.552 [2024-11-20 12:54:18.636693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.552 [2024-11-20 12:54:18.645806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.552 [2024-11-20 12:54:18.646170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.552 [2024-11-20 12:54:18.646332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.552 [2024-11-20 12:54:18.646364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.552 [2024-11-20 12:54:18.646380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.552 [2024-11-20 12:54:18.646575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.552 [2024-11-20 12:54:18.646727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.552 [2024-11-20 12:54:18.646751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.552 [2024-11-20 12:54:18.646766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.552 [2024-11-20 12:54:18.649151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.658222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.658641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.658835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.658861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.658877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.659010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.659206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.659231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.659246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.661682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.670674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.671037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.671205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.671232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.671247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.671445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.671651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.671674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.671689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.674097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.683025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.683327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.683545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.683598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.683622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.683789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.683959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.683982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.683997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.686203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.695615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.695913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.696108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.696138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.696156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.696305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.696439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.696462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.696477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.698856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.708461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.708841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.709025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.709054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.709086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.709257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.709481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.709504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.709520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.711807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.720959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.721268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.721423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.721451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.721469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.721623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.721811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.721834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.721850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.724112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.733458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.733760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.733901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.733930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.733947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.734144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.734315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.734338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.734354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.736710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.746162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.746451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.746591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.746620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.746638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.814 [2024-11-20 12:54:18.746803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.814 [2024-11-20 12:54:18.747010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.814 [2024-11-20 12:54:18.747033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.814 [2024-11-20 12:54:18.747049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.814 [2024-11-20 12:54:18.749542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.814 [2024-11-20 12:54:18.758726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.814 [2024-11-20 12:54:18.759062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.759192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.814 [2024-11-20 12:54:18.759218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.814 [2024-11-20 12:54:18.759234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.759430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.759642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.759666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.759682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.762249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.771461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.771749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.771897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.771923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.771939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.772099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.772265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.772288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.772304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.774733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.783981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.784288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.784407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.784435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.784453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.784618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.784806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.784829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.784844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.787375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.796480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.796837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.797004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.797033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.797050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.797261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.797433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.797461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.797478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.799909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.809003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.809351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.809482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.809510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.809528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.809693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.809881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.809904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.809920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.812321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.821448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.821779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.821918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.821947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.821964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.822143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.822314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.822337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.822353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.824796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.833977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.834285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.834429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.834457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.834474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.834675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.834863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.834887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.834909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.837427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.846593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.846925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.847082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.847110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.847126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.847308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.847460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.847484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.847499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.849987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.859004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.859330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.859436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.859461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.859477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.815 [2024-11-20 12:54:18.859632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.815 [2024-11-20 12:54:18.859803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.815 [2024-11-20 12:54:18.859827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.815 [2024-11-20 12:54:18.859842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.815 [2024-11-20 12:54:18.862193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.815 [2024-11-20 12:54:18.871570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.815 [2024-11-20 12:54:18.871859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.871995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.815 [2024-11-20 12:54:18.872020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.815 [2024-11-20 12:54:18.872036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.816 [2024-11-20 12:54:18.872241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.816 [2024-11-20 12:54:18.872358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.816 [2024-11-20 12:54:18.872381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.816 [2024-11-20 12:54:18.872396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.816 [2024-11-20 12:54:18.874814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.816 [2024-11-20 12:54:18.884023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.816 [2024-11-20 12:54:18.884347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.816 [2024-11-20 12:54:18.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.816 [2024-11-20 12:54:18.884549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.816 [2024-11-20 12:54:18.884565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.816 [2024-11-20 12:54:18.884696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.816 [2024-11-20 12:54:18.884895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.816 [2024-11-20 12:54:18.884919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.816 [2024-11-20 12:54:18.884934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.816 [2024-11-20 12:54:18.887449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.816 [2024-11-20 12:54:18.896692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.816 [2024-11-20 12:54:18.897013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.816 [2024-11-20 12:54:18.897161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.816 [2024-11-20 12:54:18.897191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.816 [2024-11-20 12:54:18.897209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.816 [2024-11-20 12:54:18.897410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.816 [2024-11-20 12:54:18.897544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.816 [2024-11-20 12:54:18.897568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.816 [2024-11-20 12:54:18.897583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.816 [2024-11-20 12:54:18.900075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.816 [2024-11-20 12:54:18.909176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:45.816 [2024-11-20 12:54:18.909438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.816 [2024-11-20 12:54:18.909567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:45.816 [2024-11-20 12:54:18.909596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:45.816 [2024-11-20 12:54:18.909613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:45.816 [2024-11-20 12:54:18.909797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:45.816 [2024-11-20 12:54:18.909950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:45.816 [2024-11-20 12:54:18.909973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:45.816 [2024-11-20 12:54:18.909989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:45.816 [2024-11-20 12:54:18.912394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.077 [2024-11-20 12:54:18.921692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.077 [2024-11-20 12:54:18.922009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.922126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.922153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.077 [2024-11-20 12:54:18.922169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.077 [2024-11-20 12:54:18.922340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.077 [2024-11-20 12:54:18.922511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.077 [2024-11-20 12:54:18.922534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.077 [2024-11-20 12:54:18.922549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.077 [2024-11-20 12:54:18.924892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.077 [2024-11-20 12:54:18.934407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.077 [2024-11-20 12:54:18.934711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.934864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.934890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.077 [2024-11-20 12:54:18.934906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.077 [2024-11-20 12:54:18.935078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.077 [2024-11-20 12:54:18.935229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.077 [2024-11-20 12:54:18.935266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.077 [2024-11-20 12:54:18.935282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.077 [2024-11-20 12:54:18.937640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.077 [2024-11-20 12:54:18.947001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.077 [2024-11-20 12:54:18.947332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.947555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.947606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.077 [2024-11-20 12:54:18.947623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.077 [2024-11-20 12:54:18.947788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.077 [2024-11-20 12:54:18.947958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.077 [2024-11-20 12:54:18.947982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.077 [2024-11-20 12:54:18.947997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.077 [2024-11-20 12:54:18.950076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.077 [2024-11-20 12:54:18.959630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.077 [2024-11-20 12:54:18.960016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.960225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.077 [2024-11-20 12:54:18.960255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.077 [2024-11-20 12:54:18.960272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.077 [2024-11-20 12:54:18.960420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.077 [2024-11-20 12:54:18.960609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.077 [2024-11-20 12:54:18.960633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.077 [2024-11-20 12:54:18.960648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.077 [2024-11-20 12:54:18.962844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:18.972327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:18.972775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:18.972962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:18.972991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:18.973009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:18.973223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:18.973376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:18.973399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:18.973415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:18.975737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:18.984950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:18.985235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:18.985366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:18.985392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:18.985408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:18.985616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:18.985786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:18.985809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:18.985824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:18.988174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:18.997463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:18.997765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:18.997951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:18.997985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:18.998003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:18.998194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:18.998362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:18.998386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:18.998401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.000653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.010053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.010423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.010608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.010662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:19.010680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:19.010863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:19.011033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:19.011057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:19.011086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.013389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.022547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.022868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.023046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.023079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:19.023098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:19.023297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:19.023486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:19.023510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:19.023526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.025940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.035232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.035572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.035744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.035774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:19.035797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:19.035964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:19.036168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:19.036192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:19.036208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.038516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.047913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.048180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.048333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.048359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:19.048375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:19.048536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:19.048704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:19.048728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:19.048744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.051084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.060351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.060636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.060801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.060830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:19.060848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:19.061013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:19.061177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:19.061202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:19.061218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.063484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.072761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.073148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.073312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.073341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.078 [2024-11-20 12:54:19.073359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.078 [2024-11-20 12:54:19.073531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.078 [2024-11-20 12:54:19.073684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.078 [2024-11-20 12:54:19.073708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.078 [2024-11-20 12:54:19.073723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.078 [2024-11-20 12:54:19.076011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.078 [2024-11-20 12:54:19.085375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.078 [2024-11-20 12:54:19.085731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.085873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.078 [2024-11-20 12:54:19.085902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.085920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.086067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.086233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.086257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.086273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.088596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.098048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.098392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.098523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.098549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.098565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.098682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.098891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.098915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.098931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.101376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.110617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.110991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.111213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.111243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.111261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.111445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.111604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.111628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.111644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.114059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.123344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.123670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.123847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.123873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.123889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.124097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.124250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.124273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.124289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.126538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.135843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.136197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.136349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.136375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.136391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.136588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.136741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.136764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.136780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.139221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.148427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.148701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.148843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.148872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.148889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.149037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.149199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.149238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.149255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.151484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.160920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.161191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.161331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.161359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.161377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.161507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.161658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.161681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.161696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.164037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.079 [2024-11-20 12:54:19.173484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.079 [2024-11-20 12:54:19.173770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.173889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.079 [2024-11-20 12:54:19.173917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.079 [2024-11-20 12:54:19.173935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.079 [2024-11-20 12:54:19.174129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.079 [2024-11-20 12:54:19.174300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.079 [2024-11-20 12:54:19.174323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.079 [2024-11-20 12:54:19.174339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.079 [2024-11-20 12:54:19.176538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.186234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.186538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.186650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.186692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.186709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.186825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.187029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.187052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.187087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.189437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.198850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.199180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.199342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.199368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.199384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.199596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.199803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.199826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.199841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.202172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.211444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.211801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.211928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.211953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.211969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.212140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.212274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.212297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.212313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.214706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.224042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.224382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.224496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.224525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.224542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.224726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.224860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.224884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.224899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.227217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.236475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.236757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.236924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.236953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.236970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.237149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.237302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.237325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.237340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.239697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.249038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.249382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.249639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.249690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.249707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.249855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.250024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.250048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.250063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.252434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.261660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.262059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.262267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.262320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.262337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.262503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.262691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.262714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.262729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.264963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.274235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.274683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.274821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.274851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.274868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.275053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.275219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.275243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.275258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.277490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.286944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.287266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.287399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.287425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.341 [2024-11-20 12:54:19.287441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.341 [2024-11-20 12:54:19.287557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.341 [2024-11-20 12:54:19.287748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.341 [2024-11-20 12:54:19.287772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.341 [2024-11-20 12:54:19.287787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.341 [2024-11-20 12:54:19.290358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.341 [2024-11-20 12:54:19.299677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.341 [2024-11-20 12:54:19.299973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.300149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.341 [2024-11-20 12:54:19.300176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.300192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.300356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.300523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.300547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.300562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.302755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.312350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.312614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.312779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.312808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.312826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.313009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.313173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.313197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.313213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.315390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.324967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.325292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.325420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.325446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.325461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.325656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.325872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.325896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.325911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.328316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.337524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.337857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.337987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.338015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.338032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.338210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.338400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.338423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.338439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.340673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.350047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.350338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.350477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.350511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.350529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.350714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.350884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.350908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.350924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.353364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.362511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.362808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.362941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.362984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.363000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.363129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.363321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.363345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.363361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.365775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.375214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.375495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.375665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.375690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.375706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.375882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.376096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.376120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.376135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.378617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.387816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.388159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.388290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.388316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.388337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.388471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.388739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.388763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.388779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.391077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.400203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.400466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.400630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.400660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.400677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.400824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.400994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.401018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.401033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.403436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.412748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.413089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.413221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.413247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.413262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.413421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.413627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.413651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.413666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.416061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.425278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.425596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.425747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.342 [2024-11-20 12:54:19.425773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.342 [2024-11-20 12:54:19.425788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.342 [2024-11-20 12:54:19.425971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.342 [2024-11-20 12:54:19.426186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.342 [2024-11-20 12:54:19.426211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.342 [2024-11-20 12:54:19.426227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.342 [2024-11-20 12:54:19.428549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.342 [2024-11-20 12:54:19.437774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.342 [2024-11-20 12:54:19.438149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.343 [2024-11-20 12:54:19.438285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.343 [2024-11-20 12:54:19.438314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.343 [2024-11-20 12:54:19.438331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.343 [2024-11-20 12:54:19.438479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.343 [2024-11-20 12:54:19.438667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.343 [2024-11-20 12:54:19.438691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.343 [2024-11-20 12:54:19.438706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.343 [2024-11-20 12:54:19.441030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.604 [2024-11-20 12:54:19.450243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.604 [2024-11-20 12:54:19.450545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.450659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.450688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.450706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.450854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.451006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.451029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.451045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.453466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.462635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.462958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.463113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.463142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.463160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.463326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.463504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.463528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.463543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.466042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.475291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.475594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.475769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.475795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.475811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.475943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.476177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.476202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.476217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.478556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.487815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.488127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.488261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.488290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.488307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.488455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.488625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.488649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.488665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.490829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.500571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.500872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.501027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.501052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.501075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.501254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.501443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.501472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.501489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.503870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.513225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.513521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.513710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.513760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.513778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.513997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.514180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.514206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.514222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.516474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.525844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.526174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.526315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.526344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.526362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.526510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.526717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.526740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.526756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.529211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.538321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.538596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.538707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.538734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.538751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.538922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.539125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.539148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.539168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.541158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.550603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.550915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.551067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.551101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.551117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.605 [2024-11-20 12:54:19.551298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.605 [2024-11-20 12:54:19.551444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.605 [2024-11-20 12:54:19.551465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.605 [2024-11-20 12:54:19.551479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.605 [2024-11-20 12:54:19.553468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.605 [2024-11-20 12:54:19.562705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.605 [2024-11-20 12:54:19.563085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.563261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.605 [2024-11-20 12:54:19.563287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.605 [2024-11-20 12:54:19.563303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.563452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.563642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.563661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.563674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.565690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.574937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.575283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.575435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.575461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.575477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.575610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.575772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.575791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.575804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.577668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.587028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.587340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.587496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.587522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.587537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.587703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.587882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.587902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.587930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.589996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.599585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.599893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.599991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.600018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.600033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.600174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.600354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.600390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.600403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.602327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.611654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.611966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.612078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.612104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.612120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.612236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.612401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.612420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.612433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.614519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.623706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.624125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.624247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.624273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.624289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.624405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.624574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.624593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.624606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.626680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.636091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.636375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.636570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.636596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.636611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.636789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.636962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.636981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.636994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.639112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.648405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.648764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.648901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.648926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.648942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.649083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.649285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.649305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.649318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.651264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.660455] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.660797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.660910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.660936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.660952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.661109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.661340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.606 [2024-11-20 12:54:19.661360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.606 [2024-11-20 12:54:19.661388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.606 [2024-11-20 12:54:19.663488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.606 [2024-11-20 12:54:19.672594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.606 [2024-11-20 12:54:19.672918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.673032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.606 [2024-11-20 12:54:19.673058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.606 [2024-11-20 12:54:19.673082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.606 [2024-11-20 12:54:19.673296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.606 [2024-11-20 12:54:19.673453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.607 [2024-11-20 12:54:19.673474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.607 [2024-11-20 12:54:19.673486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.607 [2024-11-20 12:54:19.675616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.607 [2024-11-20 12:54:19.684783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.607 [2024-11-20 12:54:19.685091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.607 [2024-11-20 12:54:19.685222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.607 [2024-11-20 12:54:19.685248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.607 [2024-11-20 12:54:19.685264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.607 [2024-11-20 12:54:19.685413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.607 [2024-11-20 12:54:19.685619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.607 [2024-11-20 12:54:19.685638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.607 [2024-11-20 12:54:19.685651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.607 [2024-11-20 12:54:19.687722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.607 [2024-11-20 12:54:19.696980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.607 [2024-11-20 12:54:19.697328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.607 [2024-11-20 12:54:19.697457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.607 [2024-11-20 12:54:19.697488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.607 [2024-11-20 12:54:19.697505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.607 [2024-11-20 12:54:19.697700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.607 [2024-11-20 12:54:19.697871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.607 [2024-11-20 12:54:19.697891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.607 [2024-11-20 12:54:19.697903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.607 [2024-11-20 12:54:19.699926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.607 [2024-11-20 12:54:19.709239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.607 [2024-11-20 12:54:19.709537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.607 [2024-11-20 12:54:19.709667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.607 [2024-11-20 12:54:19.709707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.607 [2024-11-20 12:54:19.709723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.869 [2024-11-20 12:54:19.709840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.869 [2024-11-20 12:54:19.709993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.869 [2024-11-20 12:54:19.710014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.869 [2024-11-20 12:54:19.710042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.869 [2024-11-20 12:54:19.712097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.869 [2024-11-20 12:54:19.721454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.869 [2024-11-20 12:54:19.721854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.869 [2024-11-20 12:54:19.721989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.869 [2024-11-20 12:54:19.722015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.869 [2024-11-20 12:54:19.722031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.869 [2024-11-20 12:54:19.722206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.869 [2024-11-20 12:54:19.722357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.869 [2024-11-20 12:54:19.722391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.869 [2024-11-20 12:54:19.722403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.869 [2024-11-20 12:54:19.724228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.869 [2024-11-20 12:54:19.733585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.869 [2024-11-20 12:54:19.733924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.869 [2024-11-20 12:54:19.734053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.869 [2024-11-20 12:54:19.734086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.869 [2024-11-20 12:54:19.734109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.869 [2024-11-20 12:54:19.734291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.869 [2024-11-20 12:54:19.734437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.869 [2024-11-20 12:54:19.734457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.869 [2024-11-20 12:54:19.734469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.736538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.745615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.745941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.746083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.746109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.746125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.746274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.746467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.746486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.746498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.748393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.757684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.757993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.758130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.758157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.758172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.758305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.758453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.758473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.758485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.760534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.769725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.770053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.770164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.770190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.770205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.770292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.770422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.770455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.770468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.772282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.781955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.782218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.782361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.782387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.782403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.782552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.782727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.782747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.782759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.784646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.794197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.794536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.794665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.794691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.794707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.794872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.795030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.795049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.795062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.797023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.806235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.806655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.806782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.806807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.806824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.806940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.807122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.807143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.807171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.809146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.818420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.818743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.818873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.818899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.818915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.819048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.819208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.819230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.819243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.821122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.830552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.830924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.831086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.831113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.831129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.831295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.831455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.831475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.831487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.833460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.842715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.843075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.843182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.843208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.870 [2024-11-20 12:54:19.843223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.870 [2024-11-20 12:54:19.843356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.870 [2024-11-20 12:54:19.843548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.870 [2024-11-20 12:54:19.843573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.870 [2024-11-20 12:54:19.843587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.870 [2024-11-20 12:54:19.845586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.870 [2024-11-20 12:54:19.855122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.870 [2024-11-20 12:54:19.855453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.870 [2024-11-20 12:54:19.855584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.855609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.855625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.855790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.855935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.855956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.855970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.858039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.867519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.867836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.867955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.867981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.867996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.868155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.868309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.868331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.868346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.870470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.879638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.879882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.880019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.880045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.880060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.880217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.880427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.880447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.880464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.882323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.891869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.892188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.892316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.892342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.892358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.892491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.892625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.892646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.892659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.894511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.904093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.904360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.904484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.904510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.904525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.904658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.904821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.904841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.904854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.906647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.916107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.916397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.916500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.916527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.916542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.916754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.916925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.916945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.916958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.919035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.928470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.928773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.928909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.928935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.928951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.929126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.929308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.929329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.929343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.931637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.940535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.940841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.940973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.940999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.941015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.941174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.941371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.941392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.941405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.943358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.952759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.953004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.953182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.953209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.953224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.953373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.953578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.871 [2024-11-20 12:54:19.953598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.871 [2024-11-20 12:54:19.953610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.871 [2024-11-20 12:54:19.955602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:46.871 [2024-11-20 12:54:19.964975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:46.871 [2024-11-20 12:54:19.965355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.965479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:46.871 [2024-11-20 12:54:19.965505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:46.871 [2024-11-20 12:54:19.965521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:46.871 [2024-11-20 12:54:19.965653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:46.871 [2024-11-20 12:54:19.965843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:46.872 [2024-11-20 12:54:19.965862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:46.872 [2024-11-20 12:54:19.965875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:46.872 [2024-11-20 12:54:19.967908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.133 [2024-11-20 12:54:19.977321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.133 [2024-11-20 12:54:19.977650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:19.977802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:19.977828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.133 [2024-11-20 12:54:19.977844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.133 [2024-11-20 12:54:19.977961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.133 [2024-11-20 12:54:19.978137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.133 [2024-11-20 12:54:19.978173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.133 [2024-11-20 12:54:19.978187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.133 [2024-11-20 12:54:19.980251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.133 [2024-11-20 12:54:19.989528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.133 [2024-11-20 12:54:19.989915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:19.990023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:19.990050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.133 [2024-11-20 12:54:19.990065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.133 [2024-11-20 12:54:19.990225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.133 [2024-11-20 12:54:19.990447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.133 [2024-11-20 12:54:19.990467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.133 [2024-11-20 12:54:19.990479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.133 [2024-11-20 12:54:19.992514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.133 [2024-11-20 12:54:20.001980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.133 [2024-11-20 12:54:20.002334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.002485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.002511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.133 [2024-11-20 12:54:20.002527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.133 [2024-11-20 12:54:20.002708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.133 [2024-11-20 12:54:20.002910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.133 [2024-11-20 12:54:20.002930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.133 [2024-11-20 12:54:20.002943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.133 [2024-11-20 12:54:20.005126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.133 [2024-11-20 12:54:20.014228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.133 [2024-11-20 12:54:20.014581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.014677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.014702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.133 [2024-11-20 12:54:20.014718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.133 [2024-11-20 12:54:20.014883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.133 [2024-11-20 12:54:20.015034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.133 [2024-11-20 12:54:20.015078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.133 [2024-11-20 12:54:20.015095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.133 [2024-11-20 12:54:20.017208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.133 [2024-11-20 12:54:20.026546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.133 [2024-11-20 12:54:20.026929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.027087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.027114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.133 [2024-11-20 12:54:20.027131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.133 [2024-11-20 12:54:20.027281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.133 [2024-11-20 12:54:20.027481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.133 [2024-11-20 12:54:20.027501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.133 [2024-11-20 12:54:20.027514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.133 [2024-11-20 12:54:20.029685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.133 [2024-11-20 12:54:20.038732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.133 [2024-11-20 12:54:20.039058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.039189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.133 [2024-11-20 12:54:20.039216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.133 [2024-11-20 12:54:20.039234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.133 [2024-11-20 12:54:20.039418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.133 [2024-11-20 12:54:20.039566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.039587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.039600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.041558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.134 [2024-11-20 12:54:20.050909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.134 [2024-11-20 12:54:20.051244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.051381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.051407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.134 [2024-11-20 12:54:20.051423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.134 [2024-11-20 12:54:20.051588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.134 [2024-11-20 12:54:20.051753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.051774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.051789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.053857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.134 [2024-11-20 12:54:20.063043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.134 [2024-11-20 12:54:20.063346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.063481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.063507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.134 [2024-11-20 12:54:20.063523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.134 [2024-11-20 12:54:20.063720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.134 [2024-11-20 12:54:20.063881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.063902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.063915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.065961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.134 [2024-11-20 12:54:20.075512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.134 [2024-11-20 12:54:20.075836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.075969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.075995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.134 [2024-11-20 12:54:20.076020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.134 [2024-11-20 12:54:20.076179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.134 [2024-11-20 12:54:20.076285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.076307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.076322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.078262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.134 [2024-11-20 12:54:20.087887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.134 [2024-11-20 12:54:20.088282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.088394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.088420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.134 [2024-11-20 12:54:20.088436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.134 [2024-11-20 12:54:20.088568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.134 [2024-11-20 12:54:20.088729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.088750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.088763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.090710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.134 [2024-11-20 12:54:20.100196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.134 [2024-11-20 12:54:20.100511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.100611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.100637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.134 [2024-11-20 12:54:20.100653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.134 [2024-11-20 12:54:20.100851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.134 [2024-11-20 12:54:20.101012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.101033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.101047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.103184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.134 [2024-11-20 12:54:20.112403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.134 [2024-11-20 12:54:20.112731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.112862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.134 [2024-11-20 12:54:20.112888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.134 [2024-11-20 12:54:20.112903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.134 [2024-11-20 12:54:20.113042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.134 [2024-11-20 12:54:20.113220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.134 [2024-11-20 12:54:20.113242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.134 [2024-11-20 12:54:20.113256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.134 [2024-11-20 12:54:20.115209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.124797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.125152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.125290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.125317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.135 [2024-11-20 12:54:20.125332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.135 [2024-11-20 12:54:20.125497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.135 [2024-11-20 12:54:20.125687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.135 [2024-11-20 12:54:20.125707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.135 [2024-11-20 12:54:20.125719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.135 [2024-11-20 12:54:20.127474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.136934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.137288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.137418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.137444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.135 [2024-11-20 12:54:20.137460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.135 [2024-11-20 12:54:20.137609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.135 [2024-11-20 12:54:20.137799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.135 [2024-11-20 12:54:20.137819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.135 [2024-11-20 12:54:20.137831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.135 [2024-11-20 12:54:20.139710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.149193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.149494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.149627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.149653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.135 [2024-11-20 12:54:20.149668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.135 [2024-11-20 12:54:20.149849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.135 [2024-11-20 12:54:20.150031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.135 [2024-11-20 12:54:20.150066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.135 [2024-11-20 12:54:20.150090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.135 [2024-11-20 12:54:20.152034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.161441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.161838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.161971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.161998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.135 [2024-11-20 12:54:20.162013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.135 [2024-11-20 12:54:20.162172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.135 [2024-11-20 12:54:20.162293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.135 [2024-11-20 12:54:20.162314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.135 [2024-11-20 12:54:20.162328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.135 [2024-11-20 12:54:20.164344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.173782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.174125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.174236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.174262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.135 [2024-11-20 12:54:20.174277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.135 [2024-11-20 12:54:20.174460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.135 [2024-11-20 12:54:20.174667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.135 [2024-11-20 12:54:20.174687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.135 [2024-11-20 12:54:20.174716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.135 [2024-11-20 12:54:20.176806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.186040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.186399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.186530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.186556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.135 [2024-11-20 12:54:20.186572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.135 [2024-11-20 12:54:20.186704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.135 [2024-11-20 12:54:20.186817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.135 [2024-11-20 12:54:20.186842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.135 [2024-11-20 12:54:20.186855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.135 [2024-11-20 12:54:20.188889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.135 [2024-11-20 12:54:20.198486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.135 [2024-11-20 12:54:20.198753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.198876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.135 [2024-11-20 12:54:20.198902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.136 [2024-11-20 12:54:20.198917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.136 [2024-11-20 12:54:20.199018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.136 [2024-11-20 12:54:20.199212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.136 [2024-11-20 12:54:20.199235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.136 [2024-11-20 12:54:20.199249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.136 [2024-11-20 12:54:20.201275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.136 [2024-11-20 12:54:20.210692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.136 [2024-11-20 12:54:20.211042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.136 [2024-11-20 12:54:20.211161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.136 [2024-11-20 12:54:20.211188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.136 [2024-11-20 12:54:20.211203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.136 [2024-11-20 12:54:20.211369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.136 [2024-11-20 12:54:20.211539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.136 [2024-11-20 12:54:20.211560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.136 [2024-11-20 12:54:20.211574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.136 [2024-11-20 12:54:20.213612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.136 [2024-11-20 12:54:20.223021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.136 [2024-11-20 12:54:20.223353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.136 [2024-11-20 12:54:20.223518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.136 [2024-11-20 12:54:20.223544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.136 [2024-11-20 12:54:20.223559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.136 [2024-11-20 12:54:20.223740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.136 [2024-11-20 12:54:20.223899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.136 [2024-11-20 12:54:20.223918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.136 [2024-11-20 12:54:20.223951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.136 [2024-11-20 12:54:20.226038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.136 [2024-11-20 12:54:20.235355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.136 [2024-11-20 12:54:20.235647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.136 [2024-11-20 12:54:20.235748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.136 [2024-11-20 12:54:20.235774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.136 [2024-11-20 12:54:20.235789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.136 [2024-11-20 12:54:20.235923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.136 [2024-11-20 12:54:20.236128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.136 [2024-11-20 12:54:20.236149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.136 [2024-11-20 12:54:20.236178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.398 [2024-11-20 12:54:20.238576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.398 [2024-11-20 12:54:20.247873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.398 [2024-11-20 12:54:20.248230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.248356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.248383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.398 [2024-11-20 12:54:20.248398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.398 [2024-11-20 12:54:20.248532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.398 [2024-11-20 12:54:20.248736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.398 [2024-11-20 12:54:20.248756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.398 [2024-11-20 12:54:20.248769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.398 [2024-11-20 12:54:20.250755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.398 [2024-11-20 12:54:20.260142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.398 [2024-11-20 12:54:20.260561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.260711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.260736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.398 [2024-11-20 12:54:20.260751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.398 [2024-11-20 12:54:20.260898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.398 [2024-11-20 12:54:20.261098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.398 [2024-11-20 12:54:20.261118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.398 [2024-11-20 12:54:20.261133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.398 [2024-11-20 12:54:20.263156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.398 [2024-11-20 12:54:20.272231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.398 [2024-11-20 12:54:20.272480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.272664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.272690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.398 [2024-11-20 12:54:20.272706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.398 [2024-11-20 12:54:20.272838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.398 [2024-11-20 12:54:20.272998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.398 [2024-11-20 12:54:20.273018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.398 [2024-11-20 12:54:20.273031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.398 [2024-11-20 12:54:20.275078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.398 [2024-11-20 12:54:20.284493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.398 [2024-11-20 12:54:20.284880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.285014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.285040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.398 [2024-11-20 12:54:20.285055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.398 [2024-11-20 12:54:20.285211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.398 [2024-11-20 12:54:20.285332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.398 [2024-11-20 12:54:20.285353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.398 [2024-11-20 12:54:20.285367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.398 [2024-11-20 12:54:20.287347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.398 [2024-11-20 12:54:20.296841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.398 [2024-11-20 12:54:20.297172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.398 [2024-11-20 12:54:20.297302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.297328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.297343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.297492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.297685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.297705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.297717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.299757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.309106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.309411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.309568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.309594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.309610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.309759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.309942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.309964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.309977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.311927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.321691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.322014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.322136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.322166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.322184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.322367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.322555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.322579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.322594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.324890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.334358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.334639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.334821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.334848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.334863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.335041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.335221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.335245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.335261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.337509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.347134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.347448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.347623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.347652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.347669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.347852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.348040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.348063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.348091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.350522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.359682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.360023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.360186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.360212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.360228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.360376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.360575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.360599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.360616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.362848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.372333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.372659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.372818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.372846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.372865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.373048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.373230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.373256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.373272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.375650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.384931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.385263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.385466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.385492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.385507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.385684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.385827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.385850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.385866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.388270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.397467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.397773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.397935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.397964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.397981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.398158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.399 [2024-11-20 12:54:20.398311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.399 [2024-11-20 12:54:20.398334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.399 [2024-11-20 12:54:20.398349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.399 [2024-11-20 12:54:20.400719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.399 [2024-11-20 12:54:20.410075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.399 [2024-11-20 12:54:20.410515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.410728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.399 [2024-11-20 12:54:20.410774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.399 [2024-11-20 12:54:20.410792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.399 [2024-11-20 12:54:20.410975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.411139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.411164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.411179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.413424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.422562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.422967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.423136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.423166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.423189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.423337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.423453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.423476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.423491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.425634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.435254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.435569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.435731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.435757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.435773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.435889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.436101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.436127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.436142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.438503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.447902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.448280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.448385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.448411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.448427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.448645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.448834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.448857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.448873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.451169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.460467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.460912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.461084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.461114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.461131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.461303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.461474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.461497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.461512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.463671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.472798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.473101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.473256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.473282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.473297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.473459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.473611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.473635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.473650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.476026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.485168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.485471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.485574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.485599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.485614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.485796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.485949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.485973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.485988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.488409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.400 [2024-11-20 12:54:20.497646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.400 [2024-11-20 12:54:20.498038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.498218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.400 [2024-11-20 12:54:20.498248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.400 [2024-11-20 12:54:20.498265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.400 [2024-11-20 12:54:20.498449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.400 [2024-11-20 12:54:20.498643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.400 [2024-11-20 12:54:20.498667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.400 [2024-11-20 12:54:20.498682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.400 [2024-11-20 12:54:20.501095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.661 [2024-11-20 12:54:20.510309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.661 [2024-11-20 12:54:20.510679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.510853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.510879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.661 [2024-11-20 12:54:20.510895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.661 [2024-11-20 12:54:20.511054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.661 [2024-11-20 12:54:20.511238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.661 [2024-11-20 12:54:20.511261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.661 [2024-11-20 12:54:20.511276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.661 [2024-11-20 12:54:20.513600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.661 [2024-11-20 12:54:20.522998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.661 [2024-11-20 12:54:20.523297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.523413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.523439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.661 [2024-11-20 12:54:20.523455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.661 [2024-11-20 12:54:20.523620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.661 [2024-11-20 12:54:20.523778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.661 [2024-11-20 12:54:20.523802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.661 [2024-11-20 12:54:20.523817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.661 [2024-11-20 12:54:20.526220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.661 [2024-11-20 12:54:20.535655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.661 [2024-11-20 12:54:20.536055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.536195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.536224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.661 [2024-11-20 12:54:20.536241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.661 [2024-11-20 12:54:20.536390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.661 [2024-11-20 12:54:20.536523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.661 [2024-11-20 12:54:20.536553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.661 [2024-11-20 12:54:20.536569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.661 [2024-11-20 12:54:20.538874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.661 [2024-11-20 12:54:20.548248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.661 [2024-11-20 12:54:20.548603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.548768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.548796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.661 [2024-11-20 12:54:20.548814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.661 [2024-11-20 12:54:20.548979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.661 [2024-11-20 12:54:20.549143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.661 [2024-11-20 12:54:20.549167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.661 [2024-11-20 12:54:20.549183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.661 [2024-11-20 12:54:20.551467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.661 [2024-11-20 12:54:20.560480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.661 [2024-11-20 12:54:20.560901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.561082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.561109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.661 [2024-11-20 12:54:20.561124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.661 [2024-11-20 12:54:20.561258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.661 [2024-11-20 12:54:20.561458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.661 [2024-11-20 12:54:20.561481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.661 [2024-11-20 12:54:20.561497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.661 [2024-11-20 12:54:20.563816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.661 [2024-11-20 12:54:20.573012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.661 [2024-11-20 12:54:20.573404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.573533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.661 [2024-11-20 12:54:20.573558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.661 [2024-11-20 12:54:20.573574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.661 [2024-11-20 12:54:20.573786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.661 [2024-11-20 12:54:20.573953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.661 [2024-11-20 12:54:20.573977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.573998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.576278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.585552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.585874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.585991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.586020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.586037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.586196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.586349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.586372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.586388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.588707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.598237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.598590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.598762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.598790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.598807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.598973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.599156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.599180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.599196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.601606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.610544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.610875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.611027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.611053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.611076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.611211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.611346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.611383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.611399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.613675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.623112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.623471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.623621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.623647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.623662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.623837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.624025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.624049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.624064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.626455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.635691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.636089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.636373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.636398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.636413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.636626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.636812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.636836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.636852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.639095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.648143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.648434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.648610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.648660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.648677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.648824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.648994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.649017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.649033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.651283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.660804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.661173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.661303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.661328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.661344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.661543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.661713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.661736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.661752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.664077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.673471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.673812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.673940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.673969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.673986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.674141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.674293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.674314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.674328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.676519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.662 [2024-11-20 12:54:20.686133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.662 [2024-11-20 12:54:20.686490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.686665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.662 [2024-11-20 12:54:20.686691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.662 [2024-11-20 12:54:20.686707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.662 [2024-11-20 12:54:20.686926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.662 [2024-11-20 12:54:20.687138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.662 [2024-11-20 12:54:20.687162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.662 [2024-11-20 12:54:20.687178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.662 [2024-11-20 12:54:20.689495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.663 [2024-11-20 12:54:20.698674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.663 [2024-11-20 12:54:20.698972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.699180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.699207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.663 [2024-11-20 12:54:20.699223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.663 [2024-11-20 12:54:20.699404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.663 [2024-11-20 12:54:20.699556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.663 [2024-11-20 12:54:20.699579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.663 [2024-11-20 12:54:20.699595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.663 [2024-11-20 12:54:20.701825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.663 [2024-11-20 12:54:20.711420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.663 [2024-11-20 12:54:20.711801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.711988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.712017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.663 [2024-11-20 12:54:20.712035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.663 [2024-11-20 12:54:20.712211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.663 [2024-11-20 12:54:20.712381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.663 [2024-11-20 12:54:20.712404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.663 [2024-11-20 12:54:20.712420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.663 [2024-11-20 12:54:20.714618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.663 [2024-11-20 12:54:20.724184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.663 [2024-11-20 12:54:20.724528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.724667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.724696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.663 [2024-11-20 12:54:20.724714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.663 [2024-11-20 12:54:20.724915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.663 [2024-11-20 12:54:20.725067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.663 [2024-11-20 12:54:20.725102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.663 [2024-11-20 12:54:20.725118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.663 [2024-11-20 12:54:20.727386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.663 [2024-11-20 12:54:20.736784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.663 [2024-11-20 12:54:20.737085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.737217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.737246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.663 [2024-11-20 12:54:20.737264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.663 [2024-11-20 12:54:20.737430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.663 [2024-11-20 12:54:20.737637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.663 [2024-11-20 12:54:20.737661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.663 [2024-11-20 12:54:20.737676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.663 [2024-11-20 12:54:20.740024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.663 [2024-11-20 12:54:20.749407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.663 [2024-11-20 12:54:20.749700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.749841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.749870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.663 [2024-11-20 12:54:20.749888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.663 [2024-11-20 12:54:20.750035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.663 [2024-11-20 12:54:20.750232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.663 [2024-11-20 12:54:20.750257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.663 [2024-11-20 12:54:20.750273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.663 [2024-11-20 12:54:20.752483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.663 [2024-11-20 12:54:20.761870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.663 [2024-11-20 12:54:20.762180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.762293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.663 [2024-11-20 12:54:20.762322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.663 [2024-11-20 12:54:20.762339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.663 [2024-11-20 12:54:20.762451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.663 [2024-11-20 12:54:20.762584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.663 [2024-11-20 12:54:20.762607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.663 [2024-11-20 12:54:20.762623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.663 [2024-11-20 12:54:20.765116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.925 [2024-11-20 12:54:20.774420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.925 [2024-11-20 12:54:20.774757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.774883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.774908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.925 [2024-11-20 12:54:20.774930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.925 [2024-11-20 12:54:20.775084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.925 [2024-11-20 12:54:20.775279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.925 [2024-11-20 12:54:20.775303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.925 [2024-11-20 12:54:20.775318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.925 [2024-11-20 12:54:20.777724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.925 [2024-11-20 12:54:20.787056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.925 [2024-11-20 12:54:20.787371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.787551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.787577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.925 [2024-11-20 12:54:20.787592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.925 [2024-11-20 12:54:20.787786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.925 [2024-11-20 12:54:20.787911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.925 [2024-11-20 12:54:20.787934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.925 [2024-11-20 12:54:20.787950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.925 [2024-11-20 12:54:20.790316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.925 [2024-11-20 12:54:20.799464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.925 [2024-11-20 12:54:20.799801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.799930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.799956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.925 [2024-11-20 12:54:20.799971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.925 [2024-11-20 12:54:20.800129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.925 [2024-11-20 12:54:20.800318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.925 [2024-11-20 12:54:20.800341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.925 [2024-11-20 12:54:20.800356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.925 [2024-11-20 12:54:20.802734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.925 [2024-11-20 12:54:20.811885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.925 [2024-11-20 12:54:20.812316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.812450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.812491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.925 [2024-11-20 12:54:20.812509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.925 [2024-11-20 12:54:20.812662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.925 [2024-11-20 12:54:20.812868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.925 [2024-11-20 12:54:20.812891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.925 [2024-11-20 12:54:20.812907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.925 [2024-11-20 12:54:20.815277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.925 [2024-11-20 12:54:20.824450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.925 [2024-11-20 12:54:20.824762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.824888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.824914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.925 [2024-11-20 12:54:20.824929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.925 [2024-11-20 12:54:20.825099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.925 [2024-11-20 12:54:20.825270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.925 [2024-11-20 12:54:20.825294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.925 [2024-11-20 12:54:20.825309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.925 [2024-11-20 12:54:20.827665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.925 [2024-11-20 12:54:20.837022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.925 [2024-11-20 12:54:20.837427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.837683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.925 [2024-11-20 12:54:20.837709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.925 [2024-11-20 12:54:20.837725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.925 [2024-11-20 12:54:20.837872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.925 [2024-11-20 12:54:20.838042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.925 [2024-11-20 12:54:20.838066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.925 [2024-11-20 12:54:20.838094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.925 [2024-11-20 12:54:20.840325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.849744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.850088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.850228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.850254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.850270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.850488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.850695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.850719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.850734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.853060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.862190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.862453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.862608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.862634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.862650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.862809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.862943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.862966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.862981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.865190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.874856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.875157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.875302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.875331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.875349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.875514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.875738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.875762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.875777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.878241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.887262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.887612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.887779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.887808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.887825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.887991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.888196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.888221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.888237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.890429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.900004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.900298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.900453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.900479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.900494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.900656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.900821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.900844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.900860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.903210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.912514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.912837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.912974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.913000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.913015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.913174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.913362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.913386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.913402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.915686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.925136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.925491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.925620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.925645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.925661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.925850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.926038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.926061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.926095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.928527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.937784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.938149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.938342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.938382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.938398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.938557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.938774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.938799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.926 [2024-11-20 12:54:20.938814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.926 [2024-11-20 12:54:20.940975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.926 [2024-11-20 12:54:20.950402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.926 [2024-11-20 12:54:20.950698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.950841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.926 [2024-11-20 12:54:20.950868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.926 [2024-11-20 12:54:20.950883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.926 [2024-11-20 12:54:20.951057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.926 [2024-11-20 12:54:20.951293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.926 [2024-11-20 12:54:20.951317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:20.951332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:20.953561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.927 [2024-11-20 12:54:20.962768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.927 [2024-11-20 12:54:20.963094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:20.963329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:20.963356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.927 [2024-11-20 12:54:20.963371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.927 [2024-11-20 12:54:20.963576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.927 [2024-11-20 12:54:20.963796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.927 [2024-11-20 12:54:20.963820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:20.963841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:20.966142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.927 [2024-11-20 12:54:20.975414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.927 [2024-11-20 12:54:20.975741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:20.975878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:20.975905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.927 [2024-11-20 12:54:20.975921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.927 [2024-11-20 12:54:20.976092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.927 [2024-11-20 12:54:20.976254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.927 [2024-11-20 12:54:20.976278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:20.976294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:20.978562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.927 [2024-11-20 12:54:20.988037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.927 [2024-11-20 12:54:20.988362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:20.988491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:20.988535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.927 [2024-11-20 12:54:20.988551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.927 [2024-11-20 12:54:20.988712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.927 [2024-11-20 12:54:20.988920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.927 [2024-11-20 12:54:20.988944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:20.988959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:20.991289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.927 [2024-11-20 12:54:21.000771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.927 [2024-11-20 12:54:21.001116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:21.001280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:21.001309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.927 [2024-11-20 12:54:21.001326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.927 [2024-11-20 12:54:21.001455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.927 [2024-11-20 12:54:21.001662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.927 [2024-11-20 12:54:21.001685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:21.001701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:21.004106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.927 [2024-11-20 12:54:21.013212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.927 [2024-11-20 12:54:21.013632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:21.013821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:21.013850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.927 [2024-11-20 12:54:21.013868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.927 [2024-11-20 12:54:21.014034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.927 [2024-11-20 12:54:21.014252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.927 [2024-11-20 12:54:21.014277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:21.014293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:21.016669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:47.927 [2024-11-20 12:54:21.025923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.927 [2024-11-20 12:54:21.026236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:21.026361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:47.927 [2024-11-20 12:54:21.026387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:47.927 [2024-11-20 12:54:21.026402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:47.927 [2024-11-20 12:54:21.026539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:47.927 [2024-11-20 12:54:21.026710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:47.927 [2024-11-20 12:54:21.026734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:47.927 [2024-11-20 12:54:21.026749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.927 [2024-11-20 12:54:21.029138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.188 [2024-11-20 12:54:21.038493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.188 [2024-11-20 12:54:21.038808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.038938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.038967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.188 [2024-11-20 12:54:21.038984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.188 [2024-11-20 12:54:21.039164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.188 [2024-11-20 12:54:21.039335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.188 [2024-11-20 12:54:21.039359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.188 [2024-11-20 12:54:21.039374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.188 [2024-11-20 12:54:21.041838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.188 [2024-11-20 12:54:21.051105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.188 [2024-11-20 12:54:21.051422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.051613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.051642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.188 [2024-11-20 12:54:21.051660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.188 [2024-11-20 12:54:21.051826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.188 [2024-11-20 12:54:21.051996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.188 [2024-11-20 12:54:21.052020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.188 [2024-11-20 12:54:21.052036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.188 [2024-11-20 12:54:21.054474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.188 [2024-11-20 12:54:21.063628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.188 [2024-11-20 12:54:21.063908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.064046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.064096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.188 [2024-11-20 12:54:21.064112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.188 [2024-11-20 12:54:21.064275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.188 [2024-11-20 12:54:21.064457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.188 [2024-11-20 12:54:21.064481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.188 [2024-11-20 12:54:21.064496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.188 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3640227 Killed "${NVMF_APP[@]}" "$@" 00:26:48.188 12:54:21 -- host/bdevperf.sh@36 -- # tgt_init 00:26:48.188 12:54:21 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:48.188 12:54:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:48.188 12:54:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:48.188 12:54:21 -- common/autotest_common.sh@10 -- # set +x 00:26:48.188 [2024-11-20 12:54:21.067142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.188 12:54:21 -- nvmf/common.sh@469 -- # nvmfpid=3641342 00:26:48.188 12:54:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:48.188 12:54:21 -- nvmf/common.sh@470 -- # waitforlisten 3641342 00:26:48.188 12:54:21 -- common/autotest_common.sh@829 -- # '[' -z 3641342 ']' 00:26:48.188 12:54:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:48.188 12:54:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:48.188 12:54:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:48.188 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:48.188 12:54:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:48.188 12:54:21 -- common/autotest_common.sh@10 -- # set +x 00:26:48.188 [2024-11-20 12:54:21.076186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.188 [2024-11-20 12:54:21.076556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.076700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.076734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.188 [2024-11-20 12:54:21.076752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.188 [2024-11-20 12:54:21.076936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.188 [2024-11-20 12:54:21.077100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.188 [2024-11-20 12:54:21.077126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.188 [2024-11-20 12:54:21.077142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.188 [2024-11-20 12:54:21.079528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.188 [2024-11-20 12:54:21.088818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.188 [2024-11-20 12:54:21.089085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.089222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.089251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.188 [2024-11-20 12:54:21.089268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.188 [2024-11-20 12:54:21.089398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.188 [2024-11-20 12:54:21.089549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.188 [2024-11-20 12:54:21.089573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.188 [2024-11-20 12:54:21.089589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.188 [2024-11-20 12:54:21.091878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.188 [2024-11-20 12:54:21.101486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.188 [2024-11-20 12:54:21.101851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.102011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.188 [2024-11-20 12:54:21.102037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.188 [2024-11-20 12:54:21.102079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.188 [2024-11-20 12:54:21.102248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.188 [2024-11-20 12:54:21.102454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.188 [2024-11-20 12:54:21.102477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.188 [2024-11-20 12:54:21.102493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.188 [2024-11-20 12:54:21.104818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.114173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.114524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.114693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.114722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.114745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.114798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:48.189 [2024-11-20 12:54:21.114867] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:48.189 [2024-11-20 12:54:21.114912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.115092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.115115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.115130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.117522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.126825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.127205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.127410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.127460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.127478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.127679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.127849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.127873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.127888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.130256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.139289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.139687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.139895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.139921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.139937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.140055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.140271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.140296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.140311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.142472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 EAL: No free 2048 kB hugepages reported on node 1 00:26:48.189 [2024-11-20 12:54:21.151872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.152166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.152305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.152330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.152346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.152495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.152698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.152721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.152737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.154834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.164417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.164737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.164905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.164934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.164952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.165125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.165308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.165329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.165343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.167580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.176921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.177306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.177470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.177495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.177511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.177628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.177853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.177877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.177893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.180400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.182388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:48.189 [2024-11-20 12:54:21.189373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.189807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.189968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.189997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.190017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.190219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.190401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.190439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.190458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.192690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.201877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.202269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.202452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.202481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.202500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.202672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.202790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.202814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.202832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.205181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.189 [2024-11-20 12:54:21.214386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.189 [2024-11-20 12:54:21.214702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.214858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.189 [2024-11-20 12:54:21.214887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.189 [2024-11-20 12:54:21.214905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.189 [2024-11-20 12:54:21.215036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.189 [2024-11-20 12:54:21.215222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.189 [2024-11-20 12:54:21.215244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.189 [2024-11-20 12:54:21.215259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.189 [2024-11-20 12:54:21.217724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.190 [2024-11-20 12:54:21.227124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.190 [2024-11-20 12:54:21.227451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.227593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.227622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.190 [2024-11-20 12:54:21.227652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.190 [2024-11-20 12:54:21.227765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.190 [2024-11-20 12:54:21.227917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.190 [2024-11-20 12:54:21.227941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.190 [2024-11-20 12:54:21.227956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.190 [2024-11-20 12:54:21.230077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.190 [2024-11-20 12:54:21.239708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.190 [2024-11-20 12:54:21.240001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.240114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.240142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.190 [2024-11-20 12:54:21.240158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.190 [2024-11-20 12:54:21.240276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.190 [2024-11-20 12:54:21.240463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.190 [2024-11-20 12:54:21.240488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.190 [2024-11-20 12:54:21.240504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.190 [2024-11-20 12:54:21.242550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.190 [2024-11-20 12:54:21.252335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.190 [2024-11-20 12:54:21.252874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.253009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.253039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.190 [2024-11-20 12:54:21.253061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.190 [2024-11-20 12:54:21.253233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.190 [2024-11-20 12:54:21.253417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.190 [2024-11-20 12:54:21.253442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.190 [2024-11-20 12:54:21.253462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.190 [2024-11-20 12:54:21.255885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.190 [2024-11-20 12:54:21.265065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.190 [2024-11-20 12:54:21.265449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.265587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.265616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.190 [2024-11-20 12:54:21.265644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.190 [2024-11-20 12:54:21.265829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.190 [2024-11-20 12:54:21.265963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.190 [2024-11-20 12:54:21.265986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.190 [2024-11-20 12:54:21.266003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.190 [2024-11-20 12:54:21.268185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.190 [2024-11-20 12:54:21.277694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.190 [2024-11-20 12:54:21.278019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.278214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.278241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.190 [2024-11-20 12:54:21.278256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.190 [2024-11-20 12:54:21.278428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.190 [2024-11-20 12:54:21.278563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.190 [2024-11-20 12:54:21.278587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.190 [2024-11-20 12:54:21.278602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.190 [2024-11-20 12:54:21.280931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.190 [2024-11-20 12:54:21.290187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.190 [2024-11-20 12:54:21.290521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.290704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.190 [2024-11-20 12:54:21.290730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.190 [2024-11-20 12:54:21.290746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.190 [2024-11-20 12:54:21.290910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.190 [2024-11-20 12:54:21.291106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.190 [2024-11-20 12:54:21.291131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.190 [2024-11-20 12:54:21.291147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.190 [2024-11-20 12:54:21.293217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.450 [2024-11-20 12:54:21.297767] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:48.450 [2024-11-20 12:54:21.297910] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:48.450 [2024-11-20 12:54:21.297929] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:48.450 [2024-11-20 12:54:21.297942] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:48.450 [2024-11-20 12:54:21.298010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:48.450 [2024-11-20 12:54:21.298063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:48.450 [2024-11-20 12:54:21.298066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:48.450 [2024-11-20 12:54:21.302556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.450 [2024-11-20 12:54:21.302929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.303051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.303095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.450 [2024-11-20 12:54:21.303112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.450 [2024-11-20 12:54:21.303248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.450 [2024-11-20 12:54:21.303437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.450 [2024-11-20 12:54:21.303458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.450 [2024-11-20 12:54:21.303474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.450 [2024-11-20 12:54:21.305683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.450 [2024-11-20 12:54:21.314905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.450 [2024-11-20 12:54:21.315403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.315561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.315588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.450 [2024-11-20 12:54:21.315608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.450 [2024-11-20 12:54:21.315783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.450 [2024-11-20 12:54:21.315975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.450 [2024-11-20 12:54:21.315997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.450 [2024-11-20 12:54:21.316016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.450 [2024-11-20 12:54:21.318213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.450 [2024-11-20 12:54:21.327381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.450 [2024-11-20 12:54:21.327922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.328097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.328125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.450 [2024-11-20 12:54:21.328145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.450 [2024-11-20 12:54:21.328303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.450 [2024-11-20 12:54:21.328475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.450 [2024-11-20 12:54:21.328507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.450 [2024-11-20 12:54:21.328526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.450 [2024-11-20 12:54:21.330526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.450 [2024-11-20 12:54:21.339795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.450 [2024-11-20 12:54:21.340306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.450 [2024-11-20 12:54:21.340464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.340491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.340510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.340712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.340899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.340920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.340938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.342981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.352325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.352767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.352885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.352912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.352930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.353096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.353269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.353292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.353309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.355327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.364659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.365039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.365197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.365224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.365244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.365424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.365598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.365621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.365640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.367872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.377042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.377623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.377752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.377779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.377798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.377989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.378205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.378229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.378246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.380312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.389480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.389789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.389923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.389949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.389966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.390148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.390270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.390291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.390306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.392256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.401863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.402149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.402263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.402289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.402304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.402454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.402651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.402671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.402695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.404648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.414100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.414336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.414488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.414519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.414536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.414686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.414836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.414857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.414870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.417124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.426435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.451 [2024-11-20 12:54:21.426783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.426894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.451 [2024-11-20 12:54:21.426919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.451 [2024-11-20 12:54:21.426935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.451 [2024-11-20 12:54:21.427076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.451 [2024-11-20 12:54:21.427214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.451 [2024-11-20 12:54:21.427235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.451 [2024-11-20 12:54:21.427249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.451 [2024-11-20 12:54:21.429266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.451 [2024-11-20 12:54:21.438862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.439142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.439260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.439286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.439302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.439452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.439587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.439608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.439622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.441811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.451173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.451508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.451641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.451667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.451688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.451854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.452036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.452057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.452095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.454250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.463395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.463683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.463814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.463840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.463855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.463988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.464165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.464188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.464202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.466258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.475540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.475860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.475980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.476005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.476021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.476163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.476301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.476322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.476336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.478456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.487813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.488082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.488216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.488243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.488258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.488429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.488580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.488601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.488615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.490561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.500203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.500476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.500578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.500603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.500619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.500736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.500949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.500970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.500983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.503165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.512626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.512850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.512970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.512996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.513011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.513186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.513324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.513360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.513374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.515306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.524856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.525172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.525308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.525334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.525350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.525466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.525590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.525611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.525625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.527753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.537128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.537527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.537661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.537687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.452 [2024-11-20 12:54:21.537703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.452 [2024-11-20 12:54:21.537868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.452 [2024-11-20 12:54:21.538019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.452 [2024-11-20 12:54:21.538040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.452 [2024-11-20 12:54:21.538053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.452 [2024-11-20 12:54:21.540254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.452 [2024-11-20 12:54:21.549330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.452 [2024-11-20 12:54:21.549616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.549721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.452 [2024-11-20 12:54:21.549747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.453 [2024-11-20 12:54:21.549763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.453 [2024-11-20 12:54:21.549896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.453 [2024-11-20 12:54:21.550130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.453 [2024-11-20 12:54:21.550152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.453 [2024-11-20 12:54:21.550166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.453 [2024-11-20 12:54:21.552241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.712 [2024-11-20 12:54:21.561498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.712 [2024-11-20 12:54:21.561777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.561941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.561976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.712 [2024-11-20 12:54:21.561992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.712 [2024-11-20 12:54:21.562183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.712 [2024-11-20 12:54:21.562321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.712 [2024-11-20 12:54:21.562346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.712 [2024-11-20 12:54:21.562361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.712 [2024-11-20 12:54:21.564306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.712 [2024-11-20 12:54:21.573836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.712 [2024-11-20 12:54:21.574094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.574196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.574222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.712 [2024-11-20 12:54:21.574237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.712 [2024-11-20 12:54:21.574355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.712 [2024-11-20 12:54:21.574521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.712 [2024-11-20 12:54:21.574542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.712 [2024-11-20 12:54:21.574555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.712 [2024-11-20 12:54:21.576522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.712 [2024-11-20 12:54:21.586218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.712 [2024-11-20 12:54:21.586551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.586650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.586676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.712 [2024-11-20 12:54:21.586691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.712 [2024-11-20 12:54:21.586824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.712 [2024-11-20 12:54:21.586975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.712 [2024-11-20 12:54:21.586996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.712 [2024-11-20 12:54:21.587010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.712 [2024-11-20 12:54:21.589165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.712 [2024-11-20 12:54:21.598470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.712 [2024-11-20 12:54:21.598749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.598891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.598917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.712 [2024-11-20 12:54:21.598933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.712 [2024-11-20 12:54:21.599066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.712 [2024-11-20 12:54:21.599195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.712 [2024-11-20 12:54:21.599216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.712 [2024-11-20 12:54:21.599235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.712 [2024-11-20 12:54:21.601366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.712 [2024-11-20 12:54:21.610751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.712 [2024-11-20 12:54:21.611080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.611208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.611233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.712 [2024-11-20 12:54:21.611250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.712 [2024-11-20 12:54:21.611415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.712 [2024-11-20 12:54:21.611569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.712 [2024-11-20 12:54:21.611590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.712 [2024-11-20 12:54:21.611604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.712 [2024-11-20 12:54:21.613809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.712 [2024-11-20 12:54:21.623037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.712 [2024-11-20 12:54:21.623373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.623478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.712 [2024-11-20 12:54:21.623504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.623519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.623668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.623835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.623856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.623870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.625950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.635297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.635652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.635780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.635806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.635821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.635954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.636163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.636185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.636199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.638313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.647546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.647868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.647997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.648023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.648039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.648228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.648366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.648402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.648416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.650436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.659894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.660204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.660318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.660344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.660368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.660549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.660683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.660704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.660718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.662847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.672271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.672550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.672706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.672732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.672748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.672897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.673092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.673115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.673129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.675136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.684565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.684819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.684940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.684966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.684981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.685157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.685359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.685395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.685409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.687463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.696835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.697117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.697250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.697276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.697292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.697408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.697544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.697565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.697579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.699698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.709119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.709400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.709522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.709548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.709563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.709712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.709878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.709899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.709913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.711992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.721493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.721796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.721894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.721920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.721935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.722094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.722247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.713 [2024-11-20 12:54:21.722268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.713 [2024-11-20 12:54:21.722282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.713 [2024-11-20 12:54:21.724310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.713 [2024-11-20 12:54:21.733852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.713 [2024-11-20 12:54:21.734110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.734259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.713 [2024-11-20 12:54:21.734285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.713 [2024-11-20 12:54:21.734301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.713 [2024-11-20 12:54:21.734482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.713 [2024-11-20 12:54:21.734695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.734716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.734729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.736855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.714 [2024-11-20 12:54:21.746091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.714 [2024-11-20 12:54:21.746394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.746550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.746576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.714 [2024-11-20 12:54:21.746591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.714 [2024-11-20 12:54:21.746724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.714 [2024-11-20 12:54:21.746874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.746895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.746909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.748893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.714 [2024-11-20 12:54:21.758458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.714 [2024-11-20 12:54:21.758793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.758892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.758923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.714 [2024-11-20 12:54:21.758939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.714 [2024-11-20 12:54:21.759097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.714 [2024-11-20 12:54:21.759267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.759289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.759302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.761303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.714 [2024-11-20 12:54:21.770875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.714 [2024-11-20 12:54:21.771176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.771301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.771327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.714 [2024-11-20 12:54:21.771343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.714 [2024-11-20 12:54:21.771476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.714 [2024-11-20 12:54:21.771626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.771647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.771661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.773790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.714 [2024-11-20 12:54:21.783164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.714 [2024-11-20 12:54:21.783448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.783568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.783594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.714 [2024-11-20 12:54:21.783609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.714 [2024-11-20 12:54:21.783758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.714 [2024-11-20 12:54:21.783911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.783931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.783945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.785808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.714 [2024-11-20 12:54:21.795513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.714 [2024-11-20 12:54:21.795810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.795918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.795943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.714 [2024-11-20 12:54:21.795964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.714 [2024-11-20 12:54:21.796123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.714 [2024-11-20 12:54:21.796310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.796332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.796345] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.798580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.714 [2024-11-20 12:54:21.807799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.714 [2024-11-20 12:54:21.808076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.808226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.714 [2024-11-20 12:54:21.808252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.714 [2024-11-20 12:54:21.808268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.714 [2024-11-20 12:54:21.808450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.714 [2024-11-20 12:54:21.808632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.714 [2024-11-20 12:54:21.808652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.714 [2024-11-20 12:54:21.808666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.714 [2024-11-20 12:54:21.810888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.974 [2024-11-20 12:54:21.820110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.974 [2024-11-20 12:54:21.820375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.820499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.820525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.974 [2024-11-20 12:54:21.820540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.974 [2024-11-20 12:54:21.820657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.974 [2024-11-20 12:54:21.820792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.974 [2024-11-20 12:54:21.820813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.974 [2024-11-20 12:54:21.820828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.974 [2024-11-20 12:54:21.823079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.974 [2024-11-20 12:54:21.832573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.974 [2024-11-20 12:54:21.832861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.832969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.832995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.974 [2024-11-20 12:54:21.833010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.974 [2024-11-20 12:54:21.833173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.974 [2024-11-20 12:54:21.833327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.974 [2024-11-20 12:54:21.833349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.974 [2024-11-20 12:54:21.833388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.974 [2024-11-20 12:54:21.835370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.974 [2024-11-20 12:54:21.844698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.974 [2024-11-20 12:54:21.845016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.845128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.845155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.974 [2024-11-20 12:54:21.845171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.974 [2024-11-20 12:54:21.845304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.974 [2024-11-20 12:54:21.845439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.974 [2024-11-20 12:54:21.845460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.974 [2024-11-20 12:54:21.845473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.974 [2024-11-20 12:54:21.847549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.974 [2024-11-20 12:54:21.856916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.974 [2024-11-20 12:54:21.857250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.857352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.974 [2024-11-20 12:54:21.857378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.974 [2024-11-20 12:54:21.857393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.974 [2024-11-20 12:54:21.857574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.974 [2024-11-20 12:54:21.857740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.974 [2024-11-20 12:54:21.857761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.974 [2024-11-20 12:54:21.857775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.974 [2024-11-20 12:54:21.859865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.974 [2024-11-20 12:54:21.868971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.974 [2024-11-20 12:54:21.869271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.869403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.869430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.869446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.869628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.869788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.869809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.869824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.871956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.881314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.881603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.881759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.881785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.881801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.881934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.882128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.882151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.882165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.884216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.893495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.893778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.893902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.893928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.893944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.894061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.894191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.894213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.894227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.896307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.905775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.906057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.906217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.906244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.906259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.906393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.906576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.906605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.906620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.908756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.918053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.918432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.918562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.918588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.918604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.918753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.918936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.918957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.918970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.921124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.930204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.930569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.930703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.930729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.930744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.930893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.931013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.931034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.931048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.933113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.942514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.942831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.942921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.942947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.942962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.943121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.943275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.943297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.943315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.945277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.954844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.955135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.955265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.955290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.955306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.955488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.955668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.955689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.955704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.957740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.967183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.967482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.967583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.967609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.975 [2024-11-20 12:54:21.967624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.975 [2024-11-20 12:54:21.967789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.975 [2024-11-20 12:54:21.967956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.975 [2024-11-20 12:54:21.967977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.975 [2024-11-20 12:54:21.967991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.975 [2024-11-20 12:54:21.970190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.975 [2024-11-20 12:54:21.979542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.975 [2024-11-20 12:54:21.979837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.979964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.975 [2024-11-20 12:54:21.979990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:21.980005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:21.980180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:21.980350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:21.980385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:21.980399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:21.982562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:21.991855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:21.992114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:21.992246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:21.992272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:21.992287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:21.992420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:21.992571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:21.992592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:21.992606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:21.994503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:22.004298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.004589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.004691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.004718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.004734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.004883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.005019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.005040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.005053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:22.006957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:22.016501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.016801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.016930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.016957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.016972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.017148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.017286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.017307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.017322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:22.019480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:22.028676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.028945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.029041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.029067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.029093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.029275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.029425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.029447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.029461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:22.031474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:22.040965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.041287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.041444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.041471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.041487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.041636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.041787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.041808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.041822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:22.044043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:22.053366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.053687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.053788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.053814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.053830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.053996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.054144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.054166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.054180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:22.056234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 [2024-11-20 12:54:22.065719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.065979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.066130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.066157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.066173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.066338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.066460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.066481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.066495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.976 [2024-11-20 12:54:22.068608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.976 12:54:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:48.976 12:54:22 -- common/autotest_common.sh@862 -- # return 0 00:26:48.976 12:54:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:48.976 12:54:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:48.976 12:54:22 -- common/autotest_common.sh@10 -- # set +x 00:26:48.976 [2024-11-20 12:54:22.078158] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.976 [2024-11-20 12:54:22.078385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.078543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.976 [2024-11-20 12:54:22.078575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:48.976 [2024-11-20 12:54:22.078590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:48.976 [2024-11-20 12:54:22.078756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:48.976 [2024-11-20 12:54:22.078907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.976 [2024-11-20 12:54:22.078928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.976 [2024-11-20 12:54:22.078941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.237 [2024-11-20 12:54:22.081061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:49.237 12:54:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:49.237 12:54:22 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:49.237 12:54:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.237 12:54:22 -- common/autotest_common.sh@10 -- # set +x 00:26:49.237 [2024-11-20 12:54:22.090447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.237 [2024-11-20 12:54:22.090693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.090819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.090844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:49.237 [2024-11-20 12:54:22.090860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:49.237 [2024-11-20 12:54:22.091042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:49.237 [2024-11-20 12:54:22.091231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:49.237 [2024-11-20 12:54:22.091253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:49.237 [2024-11-20 12:54:22.091273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.237 [2024-11-20 12:54:22.092954] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:49.237 [2024-11-20 12:54:22.093397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:49.237 12:54:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.237 12:54:22 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:49.237 12:54:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.237 12:54:22 -- common/autotest_common.sh@10 -- # set +x 00:26:49.237 [2024-11-20 12:54:22.102741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.237 [2024-11-20 12:54:22.103032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.103162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.103189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:49.237 [2024-11-20 12:54:22.103204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:49.237 [2024-11-20 12:54:22.103322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:49.237 [2024-11-20 12:54:22.103488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:49.237 [2024-11-20 12:54:22.103509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:49.237 [2024-11-20 12:54:22.103522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.237 [2024-11-20 12:54:22.105650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:49.237 [2024-11-20 12:54:22.115043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.237 [2024-11-20 12:54:22.115353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.115489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.115514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:49.237 [2024-11-20 12:54:22.115531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:49.237 [2024-11-20 12:54:22.115680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:49.237 [2024-11-20 12:54:22.115817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:49.237 [2024-11-20 12:54:22.115838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:49.237 [2024-11-20 12:54:22.115852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.237 [2024-11-20 12:54:22.117992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:49.237 [2024-11-20 12:54:22.127446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.237 [2024-11-20 12:54:22.127893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.128042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.128076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:49.237 [2024-11-20 12:54:22.128097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:49.237 [2024-11-20 12:54:22.128272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:49.237 [2024-11-20 12:54:22.128440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:49.237 [2024-11-20 12:54:22.128463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:49.237 [2024-11-20 12:54:22.128481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.237 [2024-11-20 12:54:22.130760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:49.237 Malloc0 00:26:49.237 12:54:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.237 12:54:22 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:49.237 12:54:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.237 12:54:22 -- common/autotest_common.sh@10 -- # set +x 00:26:49.237 [2024-11-20 12:54:22.139874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.237 [2024-11-20 12:54:22.140193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.140307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:49.237 [2024-11-20 12:54:22.140333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1219160 with addr=10.0.0.2, port=4420 00:26:49.237 [2024-11-20 12:54:22.140360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1219160 is same with the state(5) to be set 00:26:49.237 12:54:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.237 [2024-11-20 12:54:22.140477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1219160 (9): Bad file descriptor 00:26:49.237 12:54:22 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:49.237 [2024-11-20 12:54:22.140615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:49.237 12:54:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.237 [2024-11-20 12:54:22.140637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:49.237 [2024-11-20 12:54:22.140651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.237 12:54:22 -- common/autotest_common.sh@10 -- # set +x 00:26:49.237 [2024-11-20 12:54:22.142893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:49.237 12:54:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.237 12:54:22 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:49.237 12:54:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.237 12:54:22 -- common/autotest_common.sh@10 -- # set +x 00:26:49.237 [2024-11-20 12:54:22.152118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.237 [2024-11-20 12:54:22.152243] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:49.237 12:54:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.237 12:54:22 -- host/bdevperf.sh@38 -- # wait 3640654 00:26:49.237 [2024-11-20 12:54:22.308290] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:59.236 00:26:59.236 Latency(us) 00:26:59.236 [2024-11-20T11:54:32.344Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.236 [2024-11-20T11:54:32.344Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:59.236 Verification LBA range: start 0x0 length 0x4000 00:26:59.236 Nvme1n1 : 15.01 9135.35 35.68 16581.50 0.00 4962.65 1353.20 20486.07 00:26:59.236 [2024-11-20T11:54:32.344Z] =================================================================================================================== 00:26:59.236 [2024-11-20T11:54:32.344Z] Total : 9135.35 35.68 16581.50 0.00 4962.65 1353.20 20486.07 00:26:59.236 12:54:30 -- host/bdevperf.sh@39 -- # sync 00:26:59.236 12:54:30 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:59.236 12:54:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.236 12:54:30 -- common/autotest_common.sh@10 -- # set +x 00:26:59.236 12:54:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:59.236 12:54:30 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:26:59.236 12:54:30 -- host/bdevperf.sh@44 -- # nvmftestfini 00:26:59.236 12:54:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:59.236 12:54:30 -- nvmf/common.sh@116 -- # sync 00:26:59.236 12:54:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:59.236 12:54:30 -- nvmf/common.sh@119 -- # set +e 00:26:59.236 12:54:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:59.236 12:54:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:59.236 rmmod nvme_tcp 00:26:59.236 rmmod nvme_fabrics 00:26:59.236 rmmod nvme_keyring 00:26:59.236 12:54:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:59.236 12:54:30 -- nvmf/common.sh@123 -- # set -e 00:26:59.236 12:54:30 -- nvmf/common.sh@124 -- # return 0 00:26:59.236 12:54:30 -- nvmf/common.sh@477 -- # '[' -n 3641342 ']' 00:26:59.236 12:54:30 -- nvmf/common.sh@478 -- # killprocess 3641342 00:26:59.236 12:54:30 -- common/autotest_common.sh@936 -- # '[' -z 3641342 ']' 00:26:59.236 12:54:30 -- common/autotest_common.sh@940 -- # kill -0 3641342 00:26:59.236 12:54:30 -- common/autotest_common.sh@941 -- # uname 00:26:59.236 12:54:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:59.236 12:54:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3641342 00:26:59.236 12:54:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:59.236 12:54:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:59.236 12:54:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3641342' 00:26:59.236 killing process with pid 3641342 00:26:59.236 12:54:30 -- common/autotest_common.sh@955 -- # kill 3641342 00:26:59.236 12:54:30 -- common/autotest_common.sh@960 -- # wait 3641342 00:26:59.236 12:54:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:59.236 12:54:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:59.236 12:54:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:59.236 12:54:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:59.236 12:54:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:59.236 12:54:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:59.236 12:54:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:59.236 12:54:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:00.248 12:54:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:00.248 00:27:00.248 real 0m23.399s 00:27:00.248 user 1m2.855s 00:27:00.248 sys 0m4.523s 00:27:00.248 12:54:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:00.248 12:54:33 -- common/autotest_common.sh@10 -- # set +x 00:27:00.248 ************************************ 00:27:00.248 END TEST nvmf_bdevperf 00:27:00.248 ************************************ 00:27:00.248 12:54:33 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:00.248 12:54:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:00.248 12:54:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:00.248 12:54:33 -- common/autotest_common.sh@10 -- # set +x 00:27:00.248 ************************************ 00:27:00.248 START TEST nvmf_target_disconnect 00:27:00.248 ************************************ 00:27:00.248 12:54:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:00.507 * Looking for test storage... 00:27:00.507 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:00.507 12:54:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:00.507 12:54:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:00.507 12:54:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:00.507 12:54:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:00.507 12:54:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:00.507 12:54:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:00.507 12:54:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:00.507 12:54:33 -- scripts/common.sh@335 -- # IFS=.-: 00:27:00.507 12:54:33 -- scripts/common.sh@335 -- # read -ra ver1 00:27:00.507 12:54:33 -- scripts/common.sh@336 -- # IFS=.-: 00:27:00.507 12:54:33 -- scripts/common.sh@336 -- # read -ra ver2 00:27:00.507 12:54:33 -- scripts/common.sh@337 -- # local 'op=<' 00:27:00.507 12:54:33 -- scripts/common.sh@339 -- # ver1_l=2 00:27:00.507 12:54:33 -- scripts/common.sh@340 -- # ver2_l=1 00:27:00.507 12:54:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:00.507 12:54:33 -- scripts/common.sh@343 -- # case "$op" in 00:27:00.507 12:54:33 -- scripts/common.sh@344 -- # : 1 00:27:00.507 12:54:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:00.507 12:54:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:00.507 12:54:33 -- scripts/common.sh@364 -- # decimal 1 00:27:00.507 12:54:33 -- scripts/common.sh@352 -- # local d=1 00:27:00.507 12:54:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:00.507 12:54:33 -- scripts/common.sh@354 -- # echo 1 00:27:00.507 12:54:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:00.507 12:54:33 -- scripts/common.sh@365 -- # decimal 2 00:27:00.507 12:54:33 -- scripts/common.sh@352 -- # local d=2 00:27:00.507 12:54:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:00.507 12:54:33 -- scripts/common.sh@354 -- # echo 2 00:27:00.507 12:54:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:00.507 12:54:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:00.507 12:54:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:00.507 12:54:33 -- scripts/common.sh@367 -- # return 0 00:27:00.507 12:54:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:00.507 12:54:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:00.507 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.507 --rc genhtml_branch_coverage=1 00:27:00.507 --rc genhtml_function_coverage=1 00:27:00.507 --rc genhtml_legend=1 00:27:00.507 --rc geninfo_all_blocks=1 00:27:00.507 --rc geninfo_unexecuted_blocks=1 00:27:00.507 00:27:00.507 ' 00:27:00.507 12:54:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:00.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.508 --rc genhtml_branch_coverage=1 00:27:00.508 --rc genhtml_function_coverage=1 00:27:00.508 --rc genhtml_legend=1 00:27:00.508 --rc geninfo_all_blocks=1 00:27:00.508 --rc geninfo_unexecuted_blocks=1 00:27:00.508 00:27:00.508 ' 00:27:00.508 12:54:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:00.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.508 --rc genhtml_branch_coverage=1 00:27:00.508 --rc genhtml_function_coverage=1 00:27:00.508 --rc genhtml_legend=1 00:27:00.508 --rc geninfo_all_blocks=1 00:27:00.508 --rc geninfo_unexecuted_blocks=1 00:27:00.508 00:27:00.508 ' 00:27:00.508 12:54:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:00.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:00.508 --rc genhtml_branch_coverage=1 00:27:00.508 --rc genhtml_function_coverage=1 00:27:00.508 --rc genhtml_legend=1 00:27:00.508 --rc geninfo_all_blocks=1 00:27:00.508 --rc geninfo_unexecuted_blocks=1 00:27:00.508 00:27:00.508 ' 00:27:00.508 12:54:33 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:00.508 12:54:33 -- nvmf/common.sh@7 -- # uname -s 00:27:00.508 12:54:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:00.508 12:54:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:00.508 12:54:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:00.508 12:54:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:00.508 12:54:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:00.508 12:54:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:00.508 12:54:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:00.508 12:54:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:00.508 12:54:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:00.508 12:54:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:00.508 12:54:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:00.508 12:54:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:00.508 12:54:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:00.508 12:54:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:00.508 12:54:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:00.508 12:54:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:00.508 12:54:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:00.508 12:54:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:00.508 12:54:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:00.508 12:54:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.508 12:54:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.508 12:54:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.508 12:54:33 -- paths/export.sh@5 -- # export PATH 00:27:00.508 12:54:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.508 12:54:33 -- nvmf/common.sh@46 -- # : 0 00:27:00.508 12:54:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:00.508 12:54:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:00.508 12:54:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:00.508 12:54:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:00.508 12:54:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:00.508 12:54:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:00.508 12:54:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:00.508 12:54:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:00.508 12:54:33 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:00.508 12:54:33 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:00.508 12:54:33 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:00.508 12:54:33 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:00.508 12:54:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:00.508 12:54:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:00.508 12:54:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:00.508 12:54:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:00.508 12:54:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:00.508 12:54:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:00.508 12:54:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:00.508 12:54:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:00.508 12:54:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:00.508 12:54:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:00.508 12:54:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:00.508 12:54:33 -- common/autotest_common.sh@10 -- # set +x 00:27:02.410 12:54:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:02.410 12:54:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:02.410 12:54:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:02.410 12:54:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:02.410 12:54:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:02.410 12:54:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:02.410 12:54:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:02.410 12:54:35 -- nvmf/common.sh@294 -- # net_devs=() 00:27:02.410 12:54:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:02.410 12:54:35 -- nvmf/common.sh@295 -- # e810=() 00:27:02.410 12:54:35 -- nvmf/common.sh@295 -- # local -ga e810 00:27:02.410 12:54:35 -- nvmf/common.sh@296 -- # x722=() 00:27:02.410 12:54:35 -- nvmf/common.sh@296 -- # local -ga x722 00:27:02.410 12:54:35 -- nvmf/common.sh@297 -- # mlx=() 00:27:02.410 12:54:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:02.410 12:54:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:02.410 12:54:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:02.410 12:54:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:02.410 12:54:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:02.410 12:54:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:02.410 12:54:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:02.410 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:02.410 12:54:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:02.410 12:54:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:02.410 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:02.410 12:54:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:02.410 12:54:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:02.410 12:54:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:02.410 12:54:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:02.410 12:54:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:02.410 12:54:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:02.410 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:02.410 12:54:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:02.410 12:54:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:02.410 12:54:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:02.410 12:54:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:02.410 12:54:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:02.410 12:54:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:02.410 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:02.410 12:54:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:02.410 12:54:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:02.410 12:54:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:02.410 12:54:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:02.410 12:54:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:02.410 12:54:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:02.411 12:54:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:02.411 12:54:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:02.411 12:54:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:02.411 12:54:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:02.411 12:54:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:02.411 12:54:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:02.411 12:54:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:02.411 12:54:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:02.411 12:54:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:02.411 12:54:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:02.411 12:54:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:02.411 12:54:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:02.670 12:54:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:02.670 12:54:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:02.670 12:54:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:02.670 12:54:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:02.670 12:54:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:02.670 12:54:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:02.670 12:54:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:02.670 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:02.670 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:27:02.670 00:27:02.670 --- 10.0.0.2 ping statistics --- 00:27:02.670 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:02.670 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:27:02.670 12:54:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:02.670 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:02.670 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:27:02.670 00:27:02.670 --- 10.0.0.1 ping statistics --- 00:27:02.670 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:02.670 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:27:02.670 12:54:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:02.670 12:54:35 -- nvmf/common.sh@410 -- # return 0 00:27:02.670 12:54:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:02.670 12:54:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:02.670 12:54:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:02.670 12:54:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:02.670 12:54:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:02.670 12:54:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:02.670 12:54:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:02.670 12:54:35 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:02.670 12:54:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:02.670 12:54:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:02.670 12:54:35 -- common/autotest_common.sh@10 -- # set +x 00:27:02.670 ************************************ 00:27:02.670 START TEST nvmf_target_disconnect_tc1 00:27:02.670 ************************************ 00:27:02.670 12:54:35 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:02.670 12:54:35 -- host/target_disconnect.sh@32 -- # set +e 00:27:02.670 12:54:35 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:02.670 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.670 [2024-11-20 12:54:35.711983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.670 [2024-11-20 12:54:35.712237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.670 [2024-11-20 12:54:35.712269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x122eb40 with addr=10.0.0.2, port=4420 00:27:02.670 [2024-11-20 12:54:35.712309] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:02.670 [2024-11-20 12:54:35.712339] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:02.670 [2024-11-20 12:54:35.712355] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:02.670 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:02.670 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:02.670 Initializing NVMe Controllers 00:27:02.670 12:54:35 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:02.670 12:54:35 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:02.670 12:54:35 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:02.670 12:54:35 -- common/autotest_common.sh@1142 -- # return 0 00:27:02.670 12:54:35 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:02.670 12:54:35 -- host/target_disconnect.sh@41 -- # set -e 00:27:02.670 00:27:02.670 real 0m0.097s 00:27:02.670 user 0m0.040s 00:27:02.670 sys 0m0.056s 00:27:02.670 12:54:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:02.670 12:54:35 -- common/autotest_common.sh@10 -- # set +x 00:27:02.670 ************************************ 00:27:02.670 END TEST nvmf_target_disconnect_tc1 00:27:02.670 ************************************ 00:27:02.670 12:54:35 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:02.670 12:54:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:02.670 12:54:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:02.670 12:54:35 -- common/autotest_common.sh@10 -- # set +x 00:27:02.670 ************************************ 00:27:02.670 START TEST nvmf_target_disconnect_tc2 00:27:02.670 ************************************ 00:27:02.670 12:54:35 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:02.670 12:54:35 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:02.670 12:54:35 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:02.670 12:54:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:02.670 12:54:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:02.670 12:54:35 -- common/autotest_common.sh@10 -- # set +x 00:27:02.670 12:54:35 -- nvmf/common.sh@469 -- # nvmfpid=3644538 00:27:02.670 12:54:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:02.670 12:54:35 -- nvmf/common.sh@470 -- # waitforlisten 3644538 00:27:02.670 12:54:35 -- common/autotest_common.sh@829 -- # '[' -z 3644538 ']' 00:27:02.670 12:54:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:02.670 12:54:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:02.670 12:54:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:02.670 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:02.670 12:54:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:02.670 12:54:35 -- common/autotest_common.sh@10 -- # set +x 00:27:02.931 [2024-11-20 12:54:35.798932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:02.931 [2024-11-20 12:54:35.799011] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:02.931 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.931 [2024-11-20 12:54:35.863486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:02.931 [2024-11-20 12:54:35.964994] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:02.931 [2024-11-20 12:54:35.965156] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:02.931 [2024-11-20 12:54:35.965174] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:02.931 [2024-11-20 12:54:35.965187] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:02.931 [2024-11-20 12:54:35.965275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:02.931 [2024-11-20 12:54:35.965339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:02.931 [2024-11-20 12:54:35.965380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:02.931 [2024-11-20 12:54:35.965383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:03.869 12:54:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:03.869 12:54:36 -- common/autotest_common.sh@862 -- # return 0 00:27:03.869 12:54:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:03.869 12:54:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 12:54:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:03.869 12:54:36 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:03.869 12:54:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 Malloc0 00:27:03.869 12:54:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.869 12:54:36 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:03.869 12:54:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 [2024-11-20 12:54:36.820721] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:03.869 12:54:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.869 12:54:36 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:03.869 12:54:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 12:54:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.869 12:54:36 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:03.869 12:54:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 12:54:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.869 12:54:36 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:03.869 12:54:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 [2024-11-20 12:54:36.849001] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:03.869 12:54:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.869 12:54:36 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:03.869 12:54:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.869 12:54:36 -- common/autotest_common.sh@10 -- # set +x 00:27:03.869 12:54:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.869 12:54:36 -- host/target_disconnect.sh@50 -- # reconnectpid=3644704 00:27:03.869 12:54:36 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:03.869 12:54:36 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:03.869 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.776 12:54:38 -- host/target_disconnect.sh@53 -- # kill -9 3644538 00:27:05.776 12:54:38 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 [2024-11-20 12:54:38.873636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 [2024-11-20 12:54:38.873958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Read completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.776 Write completed with error (sct=0, sc=8) 00:27:05.776 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 [2024-11-20 12:54:38.874284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Write completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 Read completed with error (sct=0, sc=8) 00:27:05.777 starting I/O failed 00:27:05.777 [2024-11-20 12:54:38.874603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:05.777 [2024-11-20 12:54:38.874807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.874922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.874950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.875112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.875224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.875249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.875355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.875478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.875504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.875631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.875781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.875809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.875928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.876251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.876498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.876762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.876929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.877075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.877322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.877579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.877862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.877991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.878140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.878358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.878679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.878882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.879006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.879222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.879475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.777 qpair failed and we were unable to recover it. 00:27:05.777 [2024-11-20 12:54:38.879792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.777 [2024-11-20 12:54:38.879916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.879940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.880036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.880144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.880171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.880272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.880406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.880430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.880577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.880695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.880723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.880864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.881176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.881459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:05.778 [2024-11-20 12:54:38.881736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.778 [2024-11-20 12:54:38.881908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:05.778 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.882028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.882260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.882527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.882874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.882989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.883086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.883210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.883235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.883331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.883425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.883451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.883586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.883673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.883715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.883900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.884180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.884406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.055 [2024-11-20 12:54:38.884684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.055 [2024-11-20 12:54:38.884892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.055 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.885010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.885221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.885525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.885788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.885985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.886085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.886307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.886537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.886778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.886939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.887061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.887315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.887589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.887797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.887925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.888043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.888262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.888537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.888792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.888947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.889103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.889314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.889528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.889799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.889949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.890040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.890307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.890570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.890853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.890974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.891074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.891196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.891221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.891340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.891480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.891508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.891651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.891746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.056 [2024-11-20 12:54:38.891772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.056 qpair failed and we were unable to recover it. 00:27:06.056 [2024-11-20 12:54:38.891895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.891987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.892115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.892349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.892547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.892871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.892994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.893125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.893381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.893681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.893845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.893991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.894283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.894529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.894828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.894956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.895103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.895361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.895590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.895827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.895976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.896092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.896217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.896242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.896367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.896520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.896544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.896645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.896789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.896813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.896935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.897211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.897502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.897756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.897897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.898050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.898207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.898232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.898363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.898507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.898533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.898652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.898776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.898800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.057 [2024-11-20 12:54:38.898955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.899052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.057 [2024-11-20 12:54:38.899087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.057 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.899210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.899297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.899322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.899419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.899537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.899562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.899652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.899744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.899770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.899859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.900193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.900483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.900715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.900862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.900954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.901195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.901412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.901655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.901830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.901979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.902260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.902575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.902829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.902968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.903060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.903337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.903579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.903846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.903991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.904124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.904250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.904275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.904397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.904519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.904544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.904746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.904848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.904890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.905010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.905241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.905511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.905749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.905890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.058 [2024-11-20 12:54:38.906012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.906105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.058 [2024-11-20 12:54:38.906131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.058 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.906282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.906400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.906425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.906519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.906618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.906644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.906768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.906889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.906914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.907037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.907319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.907554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.907816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.907958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.908088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.908205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.908230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.908313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.908432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.908457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.908604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.908753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.908778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.908868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.909150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.909437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.909708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.909855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.909980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.910245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.910533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.910811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.910926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.911017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.911214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.911240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.911393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.911517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.911541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.911688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.911783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.911808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.911934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.912186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.912428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.912770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.912893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.913016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.913115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.913142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.059 [2024-11-20 12:54:38.913236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.913356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.059 [2024-11-20 12:54:38.913381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.059 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.913532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.913645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.913670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.913767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.913912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.913937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.914062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.914305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.914631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.914873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.914988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.915081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.915376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.915642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.915885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.915999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.916155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.916382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.916651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.916823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.916973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.917245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.917535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.917779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.917895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.918019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.918322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.918566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.060 qpair failed and we were unable to recover it. 00:27:06.060 [2024-11-20 12:54:38.918789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.060 [2024-11-20 12:54:38.918909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.918934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.919029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.919284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.919552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.919827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.919951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.920084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.920208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.920232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.920326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.920478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.920503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.920648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.920765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.920790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.920941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.921198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.921466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.921776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.921902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.922008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.922298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.922609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.922874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.922990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.923129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.923234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.923263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.923407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.923543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.923568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.923686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.923808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.923833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.923953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.924160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.924437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.924784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.924969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.925118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.925237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.925262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.925476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.925596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.925622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.925748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.925845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.925870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.061 qpair failed and we were unable to recover it. 00:27:06.061 [2024-11-20 12:54:38.925970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.926066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.061 [2024-11-20 12:54:38.926101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.926188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.926322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.926347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.926470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.926563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.926587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.926706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.926797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.926822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.926909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.927216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.927482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.927755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.927906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.928059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.928339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.928573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.928814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.928988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.929145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.929380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.929626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.929846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.929993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.930148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.930453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.930815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.930932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.931056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.931282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.931492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.931740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.931878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.931976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.932119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.932145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.932236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.932384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.932413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.932512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.932710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.932735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.062 [2024-11-20 12:54:38.932902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.933027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.062 [2024-11-20 12:54:38.933052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.062 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.933217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.933366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.933390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.933481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.933622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.933650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.933825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.933911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.933936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.934055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.934157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.934183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.934311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.934508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.934532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.934703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.934807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.934835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.934981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.935283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.935539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.935843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.935987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.936165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.936443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.936702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.936810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.936928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.937251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.937549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.937834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.937999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.938168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.938296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.938325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.938444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.938569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.938595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.938748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.938882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.938906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.939034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.939273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.939554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.939854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.939980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.940005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.940110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.940233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.940259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.940437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.940538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.940563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.063 qpair failed and we were unable to recover it. 00:27:06.063 [2024-11-20 12:54:38.940707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.063 [2024-11-20 12:54:38.940840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.940866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.940985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.941076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.941101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.941265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.941408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.941432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.941574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.941706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.941733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.941911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.942009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.942034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.942187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.942360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.942387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.942595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.942723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.942752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.942899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.943228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.943499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.943823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.943998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.944118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.944257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.944286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.944393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.944561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.944589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.944707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.944853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.944878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.945042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.945251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.945279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.945436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.945588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.945613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.945736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.945824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.945848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.945963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.946217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.946523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.946829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.946970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.947135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.947282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.947309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.947437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.947582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.947607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.947739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.947885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.947913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.948016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.948156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.948185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.948389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.948550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.948577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.064 qpair failed and we were unable to recover it. 00:27:06.064 [2024-11-20 12:54:38.948709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.948815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.064 [2024-11-20 12:54:38.948843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.949008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.949269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.949512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.949807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.949992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.950117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.950344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.950561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.950800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.950940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.951041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.951189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.951217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.951329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.951451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.951478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.951599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.951758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.951783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.951914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.952089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.952115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.952278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.952457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.952512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.952626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.952773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.952798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.952926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.953215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.953513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.953727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.953930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.954098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.954255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.954281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.954380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.954500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.954525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.954673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.954831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.954858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.955016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.955142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.955170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.065 qpair failed and we were unable to recover it. 00:27:06.065 [2024-11-20 12:54:38.955285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.065 [2024-11-20 12:54:38.955408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.955433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.955573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.955744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.955769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.955904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.956183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.956433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.956724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.956915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.957049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.957305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.957536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.957799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.957966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.958151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.958472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.958790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.958985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.959126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.959285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.959313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.959410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.959510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.959537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.959685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.959784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.959810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.959966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.960244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.960545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.960766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.960884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.961001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.961232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.961482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.961726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.961878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.962009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.962105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.962147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.962306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.962470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.962503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.066 [2024-11-20 12:54:38.962608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.962769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.066 [2024-11-20 12:54:38.962796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.066 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.962939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.963221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.963513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.963772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.963918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.964027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.964272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.964543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.964807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.964934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.965108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.965228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.965253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.965352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.965453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.965478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.965625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.965747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.965774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.965877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.966246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.966483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.966741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.966893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.967016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.967252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.967520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.967770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.967883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.968049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.968155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.968183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.968319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.968425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.968465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.968590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.968742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.968766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.968911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.969176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.969410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.969681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.969846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.969979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.970140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.970168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.067 qpair failed and we were unable to recover it. 00:27:06.067 [2024-11-20 12:54:38.970337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.067 [2024-11-20 12:54:38.970460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.970484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.970629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.970772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.970799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.970905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.971187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.971450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.971791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.971959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.972079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.972198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.972223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.972360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.972493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.972519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.972658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.972765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.972793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.972938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.973282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.973494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.973736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.973883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.974025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.974175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.974199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.974329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.974481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.974507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.974666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.974785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.974827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.975002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.975276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.975543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.975804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.975991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.976140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.976256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.976280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.976426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.976547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.976587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.976712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.976818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.976857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.976992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.977133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.977157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.977307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.977427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.977451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.977566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.977704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.977727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.977883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.978010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.068 [2024-11-20 12:54:38.978039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.068 qpair failed and we were unable to recover it. 00:27:06.068 [2024-11-20 12:54:38.978194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.978297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.978321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.978441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.978528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.978551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.978673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.978827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.978858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.979005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.979249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.979511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.979756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.979876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.980048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.980323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.980592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.980853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.980965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.981105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.981264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.981292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.981435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.981557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.981587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.981716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.981873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.981901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.982031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.982164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.982192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.982330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.982450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.982473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.982571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.982672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.982711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.982874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.983177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.983524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.983836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.983978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.984101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.984363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.984641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.984874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.984999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.985023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.985153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.985333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.985357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.069 [2024-11-20 12:54:38.985478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.985655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.069 [2024-11-20 12:54:38.985682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.069 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.985790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.985940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.985966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.986138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.986260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.986287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.986417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.986540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.986566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.986709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.986798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.986822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.986925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.987225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.987508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.987780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.987939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.988100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.988260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.988287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.988437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.988584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.988609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.988727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.988873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.988897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.988994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.989231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.989470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.989732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.989933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.990054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.990335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.990615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.990865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.990984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.991149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.991427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.991757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.991898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.070 qpair failed and we were unable to recover it. 00:27:06.070 [2024-11-20 12:54:38.992011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.992178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.070 [2024-11-20 12:54:38.992202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.992331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.992437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.992464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.992582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.992715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.992740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.992840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.992928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.992972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.993108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.993215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.993243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.993366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.993522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.993547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.993687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.993822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.993849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.993952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.994234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.994492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.994832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.994979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.995136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.995426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.995738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.995928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.996047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.996300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.996551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.996809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.996960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.997083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.997220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.997243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.997340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.997531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.997556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.997705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.997831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.997857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.997953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.998192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.998399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.998662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.998816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.998963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.999100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.999130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.999242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.999343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.999368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.071 qpair failed and we were unable to recover it. 00:27:06.071 [2024-11-20 12:54:38.999457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.071 [2024-11-20 12:54:38.999576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:38.999601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:38.999716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:38.999835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:38.999859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:38.999950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.000210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.000564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.000841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.000970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.001124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.001398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.001642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.001859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.001997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.002093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.002217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.002242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.002364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.002497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.002523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.002645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.002753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.002782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.002892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.003080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.003124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.003245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.003338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.003363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.003518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.003678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.003706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.003869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.004207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.004464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.004696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.004821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.004946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.005277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.005539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.005820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.005969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.006156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.006254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.006278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.072 [2024-11-20 12:54:39.006401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.006495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.072 [2024-11-20 12:54:39.006520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.072 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.006619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.006714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.006739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.006839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.006962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.007130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.007381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.007650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.007761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.007895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.008213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.008504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.008836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.008985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.009181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.009489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.009773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.009949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.010142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.010263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.010288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.010434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.010565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.010592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.010694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.010841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.010865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.010992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.011287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.011592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.011859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.011978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.012128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.012262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.012289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.012423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.012592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.012620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.012738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.012866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.012890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.012999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.013106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.013134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.073 qpair failed and we were unable to recover it. 00:27:06.073 [2024-11-20 12:54:39.013276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.073 [2024-11-20 12:54:39.013439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.013466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.013593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.013708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.013732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.013842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.013985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.014162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.014447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.014766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.014934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.015114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.015239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.015267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.015440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.015526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.015551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.015700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.015834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.015863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.016025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.016162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.016190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.016360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.016509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.016533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.016679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.016784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.016813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.016910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.017199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.017531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.017855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.017976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.018153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.018380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.018652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.018845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.019009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.019271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.019546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.019769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.019916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.074 qpair failed and we were unable to recover it. 00:27:06.074 [2024-11-20 12:54:39.020038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.074 [2024-11-20 12:54:39.020181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.020210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.020385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.020486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.020510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.020630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.020746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.020770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.020934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.021262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.021540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.021770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.021934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.022094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.022195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.022222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.022369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.022488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.022513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.022638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.022767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.022809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.022929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.023178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.023392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.023661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.023786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.023911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.024235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.024519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.024820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.024941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.025091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.025202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.025232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.075 qpair failed and we were unable to recover it. 00:27:06.075 [2024-11-20 12:54:39.025408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.075 [2024-11-20 12:54:39.025552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.025578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.025715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.025806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.025832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.025956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.026287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.026544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.026797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.026972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.027109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.027209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.027258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.027393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.027481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.027506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.027622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.027801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.027824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.027941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.028059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.028134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.028280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.028412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.028437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.028609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.028739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.028767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.028929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.029242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.029538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.029822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.029968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.030095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.030246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.030276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.030437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.030572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.030600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.030709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.030852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.030876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.031028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.031180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.031206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.031307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.031434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.031476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.031605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.031735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.031763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.031915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.032090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.032115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.032265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.032399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.032424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.076 [2024-11-20 12:54:39.032566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.032726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.076 [2024-11-20 12:54:39.032753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.076 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.032894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.033191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.033469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.033776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.033913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.034083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.034173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.034200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.034335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.034468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.034496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.034666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.034813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.034855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.035013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.035183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.035210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.035356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.035507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.035532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.035628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.035760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.035785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.035920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.036192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.036452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.036748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.036904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.037051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.037156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.037182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.037310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.037441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.037465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.037588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.037746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.037772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.037885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.038209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.038478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.038705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.038894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.039017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.039168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.039195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.039305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.039406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.039431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.077 qpair failed and we were unable to recover it. 00:27:06.077 [2024-11-20 12:54:39.039552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.077 [2024-11-20 12:54:39.039688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.039715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.039864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.039955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.039980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.040094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.040195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.040220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.040317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.040488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.040515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.040655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.040774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.040797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.040907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.041160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.041473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.041779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.041941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.042125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.042219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.042245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.042396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.042520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.042560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.042709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.042827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.042851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.042972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.043269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.043539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.043797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.043941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.044077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.044221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.044249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.044357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.044498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.044523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.044621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.044779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.044804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.044954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.045254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.045559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.045853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.045997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.046161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.046457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.078 [2024-11-20 12:54:39.046770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.078 [2024-11-20 12:54:39.046937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.078 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.047063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.047313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.047626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.047872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.047990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.048031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.048196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.048322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.048347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.048486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.048663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.048691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.048824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.048985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.049138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.049436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.049691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.049856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.049990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.050098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.050139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.050288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.050448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.050495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.050650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.050768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.050793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.050921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.051225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.051527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.051811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.051982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.052142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.052277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.052304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.052480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.052606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.052630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.052725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.052865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.052892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.053022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.053250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.053563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.053844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.079 [2024-11-20 12:54:39.053992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.079 qpair failed and we were unable to recover it. 00:27:06.079 [2024-11-20 12:54:39.054165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.054261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.054285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.054407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.054527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.054552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.054684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.054779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.054805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.054904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.055183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.055479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.055771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.055932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.056097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.056205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.056232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.056373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.056497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.056521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.056667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.056780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.056807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.056937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.057261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.057614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.057876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.057985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.058123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.058448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.058701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.058845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.058959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.059256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.059555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.059839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.059955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.060104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.060214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.060241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.080 qpair failed and we were unable to recover it. 00:27:06.080 [2024-11-20 12:54:39.060350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.060484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.080 [2024-11-20 12:54:39.060510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.060697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.060854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.060881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.060990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.061265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.061529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.061800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.061965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.062079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.062194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.062218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.062343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.062478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.062503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.062624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.062726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.062754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.062900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.063201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.063480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.063784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.063941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.064046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.064228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.064256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.064392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.064501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.064524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.064641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.064737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.064762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.064891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.065194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.065500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.065823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.065959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.081 [2024-11-20 12:54:39.066083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.066230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.081 [2024-11-20 12:54:39.066254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.081 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.066345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.066489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.066515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.066638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.066761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.066785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.066902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.067238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.067533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.067827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.067945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.068052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.068345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.068578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.068848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.068998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.069123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.069217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.069258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.069364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.069487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.069528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.069632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.069753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.069795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.069934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.070221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.070518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.070751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.070873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.070974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.071282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.071562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.071821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.071962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.072094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.072238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.072280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.082 qpair failed and we were unable to recover it. 00:27:06.082 [2024-11-20 12:54:39.072408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.082 [2024-11-20 12:54:39.072564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.072591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.072720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.072885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.072909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.073079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.073320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.073598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.073869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.073974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.074159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.074460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.074755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.074894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.075012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.075111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.075136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.075258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.075452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.075477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.075597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.075692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.075717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.075838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.076154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.076397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.076699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.076843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.076978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.077254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.077552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.077857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.077983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.078111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.078204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.078230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.078336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.078474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.078502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.083 qpair failed and we were unable to recover it. 00:27:06.083 [2024-11-20 12:54:39.078654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.083 [2024-11-20 12:54:39.078803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.078827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.078957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.079220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.079469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.079753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.079889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.080009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.080287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.080546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.080813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.080945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.081085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.081179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.081204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.081302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.081466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.081492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.081590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.081704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.081733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.081867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.082245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.082505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.082794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.082947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.083079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.083349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.083559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.083842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.083993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.084093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.084414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.084654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.084886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.084980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.085021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.085141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.085241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.085268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.085413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.085503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 12:54:39.085527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.084 qpair failed and we were unable to recover it. 00:27:06.084 [2024-11-20 12:54:39.085649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.085771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.085797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.085887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.085999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.086164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.086402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.086675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.086814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.086910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.087159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.087404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.087677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.087823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.087930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.088026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.088050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.088192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c52600 is same with the state(5) to be set 00:27:06.085 [2024-11-20 12:54:39.088381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.088548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.088593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.088692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.088810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.088838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.088957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.089252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.089474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.089749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.089890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.089989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.090221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.090499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.090716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.090883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.091033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.091256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.091533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.091777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 12:54:39.091895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.085 qpair failed and we were unable to recover it. 00:27:06.085 [2024-11-20 12:54:39.092043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.092266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.092533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.092822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.092982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.093139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.093385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.093655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.093873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.093995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.094103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.094225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.094251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.094384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.094471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.094497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.094648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.094768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.094793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.094884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.095143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.095369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.095668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.095814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.095939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.096034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.096060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.096201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.096300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.096326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.096447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.096540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 12:54:39.096566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.086 qpair failed and we were unable to recover it. 00:27:06.086 [2024-11-20 12:54:39.096696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.096831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.096858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.096981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.097264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.097513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.097782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.097922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.098051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.098293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.098555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.098790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.098942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.099048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.099283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.099564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.099813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.099955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.100093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.100324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.100606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.100872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.100993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.101120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.101248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.101274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.101411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.101536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.101561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.101654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.101802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.101827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.101950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.102237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.102498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.087 [2024-11-20 12:54:39.102716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 12:54:39.102847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.087 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.102962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.103195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.103514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.103758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.103939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.104038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.104302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.104602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.104876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.104991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.105110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.105232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.105257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.105354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.105500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.105525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.105616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.105767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.105792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.105917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.106074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.106101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.106238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.106371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.106396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.106509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.106699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.106741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.106888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.107196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.107452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.107759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.107882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.107978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.108250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.108493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.108767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.108893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.109009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.109112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.109149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.088 qpair failed and we were unable to recover it. 00:27:06.088 [2024-11-20 12:54:39.109272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.088 [2024-11-20 12:54:39.109364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.109405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.109509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.109675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.109699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.109814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.109952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.109977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.110066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.110275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.110604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.110868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.110975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.111171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.111382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.111688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.111875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.112009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.112143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.112168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.112287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.112457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.112481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.112624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.112760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.112787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.112984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.113245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.113504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.113767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.113921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.114033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.114158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.114184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.114304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.114440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.114472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.114640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.114809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.114836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.114944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.115221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.115425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.115719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.115933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.089 [2024-11-20 12:54:39.116063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.116207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.089 [2024-11-20 12:54:39.116232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.089 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.116328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.116475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.116500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.116644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.116771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.116798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.116936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.117249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.117517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.117861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.117998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.118142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.118262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.118287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.118456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.118549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.118576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.118700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.118831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.118858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.118969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.119207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.119458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.119842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.119964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.120102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.120461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.120718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.120883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.121051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.121166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.121191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.121290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.121408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.121435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.121560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.121738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.121765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.121900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.122198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.122460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.122728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.122874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.090 [2024-11-20 12:54:39.122996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.123126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.090 [2024-11-20 12:54:39.123152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.090 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.123263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.123388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.123414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.123554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.123686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.123713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.123849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.123958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.123985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.124093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.124341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.124611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.124878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.124990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.125090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.125177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.125202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.125302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.125447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.125474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.125612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.125763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.125806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.125942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.126215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.126439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.126737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.126892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.127029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.127286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.127557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.127805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.127978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.128132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.128341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.128566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.128857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.128976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.129019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.091 qpair failed and we were unable to recover it. 00:27:06.091 [2024-11-20 12:54:39.129138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.091 [2024-11-20 12:54:39.129229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.129254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.129348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.129494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.129521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.129704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.129833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.129858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.129950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.130231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.130449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.130757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.130917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.131024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.131321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.131583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.131821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.131957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.132055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.132304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.132517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.132820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.132959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.133109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.133231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.133256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.133362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.133498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.133525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.133672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.133789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.133813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.092 [2024-11-20 12:54:39.133968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.134118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.092 [2024-11-20 12:54:39.134144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.092 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.134275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.134446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.134474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.134599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.134730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.134756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.134878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.135188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.135459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.135763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.135920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.136024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.136282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.136527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.136858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.136996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.137126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.137256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.137281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.137394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.137519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.137546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.137679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.137806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.137833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.137979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.138270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.138563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.138813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.138960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.139049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.139333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.139624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.139831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.139985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.140099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.140209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.140234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.140350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.140442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.093 [2024-11-20 12:54:39.140467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.093 qpair failed and we were unable to recover it. 00:27:06.093 [2024-11-20 12:54:39.140587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.140671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.140713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.140849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.140985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.141097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.141322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.141551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.141845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.141993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.142106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.142365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.142661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.142785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.094 [2024-11-20 12:54:39.142967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.143096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.094 [2024-11-20 12:54:39.143122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.094 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.143234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.143380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.143406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.143532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.143630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.143654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.143771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.143883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.143914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.144007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.144284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.144551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.144843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.144951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.145047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.145283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.145574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.145839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.145980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.374 [2024-11-20 12:54:39.146093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.146239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.374 [2024-11-20 12:54:39.146263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.374 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.146356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.146451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.146476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.146567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.146661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.146686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.146826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.146958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.146985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.147082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.147344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.147558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.147829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.147970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.148111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.148227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.148252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.148393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.148530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.148558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.148652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.148779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.148806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.148987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.149261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.149560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.149801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.149956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.150061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.150353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.150647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.150857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.150999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.151114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.151216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.151244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.151393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.151486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.151510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.151612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.151756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.151781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.151874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.152182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.152432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.375 qpair failed and we were unable to recover it. 00:27:06.375 [2024-11-20 12:54:39.152664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.375 [2024-11-20 12:54:39.152758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.152783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.152898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.153183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.153486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.153748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.153888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.153976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.154246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.154570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.154844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.154987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.155134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.155345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.155562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.155783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.155904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.156020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.156326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.156563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.156793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.156901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.156998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.157246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.157531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.157780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.157909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.158020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.158162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.158190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.158359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.158444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.158473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.376 qpair failed and we were unable to recover it. 00:27:06.376 [2024-11-20 12:54:39.158593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.158755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.376 [2024-11-20 12:54:39.158779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.158872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.159222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.159486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.159750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.159879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.160014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.160263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.160477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.160776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.160921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.161033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.161290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.161525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.161738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.161892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.162029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.162309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.162575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.162840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.162974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.163127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.163229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.163254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.163392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.163531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.163559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.163655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.163752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.163780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.163925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.164206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.164489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.164814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.164952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.165095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.165205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.165233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.165353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.165484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.165510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.165656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.165744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.165771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.165886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.166174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.166389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.166634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.166823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.166950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.167055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.377 [2024-11-20 12:54:39.167089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.377 qpair failed and we were unable to recover it. 00:27:06.377 [2024-11-20 12:54:39.167233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.167352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.167376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.167526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.167679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.167704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.167794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.167910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.167937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.168088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.168302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.168560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.168832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.168988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.169117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.169263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.169291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.169394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.169503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.169530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.169647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.169762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.169787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.169902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.170170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.170486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.170811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.170951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.171085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.171348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.171591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.171845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.171987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.172148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.172243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.172274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.172405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.172556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.172584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.172720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.172822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.172852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.172969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.173251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.173517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.173796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.173976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.174118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.174238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.174264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.174365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.174491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.174517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.174643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.174764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.174789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.174907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.175237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.175481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.175831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.175962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.176080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.176353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.176590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.378 qpair failed and we were unable to recover it. 00:27:06.378 [2024-11-20 12:54:39.176818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.378 [2024-11-20 12:54:39.176952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.177077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.177179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.177205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.177319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.177464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.177490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.177642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.177789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.177820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.178218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.178521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.178754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.178900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.179016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.179250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.179510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.179827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.179959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.180124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.180228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.180255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.180348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.180472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.180502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.180650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.180762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.180790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.180924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.181205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.181414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.181738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.181901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.182006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.182231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.182496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.182773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.182918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.183015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.183284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.183564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.183799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.183917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.184075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.184176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.184217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.184312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.184469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.184494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.184618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.184723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.184752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.184889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.185063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.185110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.379 [2024-11-20 12:54:39.185227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.185330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.379 [2024-11-20 12:54:39.185357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.379 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.185494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.185595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.185638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.185764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.185907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.185935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.186063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.186290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.186565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.186821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.186980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.187124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.187379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.187614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.187902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.187995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.188121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.188431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.188654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.188827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.188965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.189268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.189481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.189711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.189860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.189987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.190268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.190575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.190825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.190965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.191065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.191218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.191246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.191355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.191493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.191518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.191650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.191801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.191826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.191944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.192081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.192108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.192211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.192333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.192360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.192507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.192597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.380 [2024-11-20 12:54:39.192623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.380 qpair failed and we were unable to recover it. 00:27:06.380 [2024-11-20 12:54:39.192760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.192864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.192893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.193042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.193165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.193191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.193288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.193445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.193470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.193642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.193780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.193806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.193928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.194239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.194539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.194778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.194936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.195063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.195335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.195615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.195832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.195978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.196146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.196436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.196738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.196923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.197081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.197184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.197213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.197378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.197522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.197546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.197695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.197798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.197823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.197999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.198105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.198133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.198268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.198427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.198455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.198572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.198693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.198719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.198860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.199158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.199409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.199679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.381 [2024-11-20 12:54:39.199790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.381 qpair failed and we were unable to recover it. 00:27:06.381 [2024-11-20 12:54:39.199888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.199988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.200166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.200374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.200634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.200888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.200988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.201130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.201412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.201726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.201864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.201982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.202213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.202479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.202746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.202936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.203043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.203184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.203212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.203335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.203468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.203493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.203622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.203725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.203753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.203905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.204124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.204365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.204643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.204886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.204989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.205112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.205369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.205639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.205756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.205900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.206161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.206386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.206612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.206775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.206907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.207049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.382 [2024-11-20 12:54:39.207105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.382 qpair failed and we were unable to recover it. 00:27:06.382 [2024-11-20 12:54:39.207206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.207328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.207352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.207528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.207690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.207719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.207872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.207968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.207994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.208094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.208205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.208231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.208349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.208476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.208502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.208639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.208770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.208798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.208933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.209190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.209456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.209741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.209864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.209985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.210277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.210582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.210845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.210994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.211095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.211190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.211214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.211310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.211433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.211458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.211605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.211708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.211735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.211846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.212187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.212453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.212720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.212926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.213038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.213155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.213181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.213299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.213424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.213450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.213621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.213722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.213750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.213910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.214134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.214421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.214665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.214798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.383 [2024-11-20 12:54:39.214920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.215054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.383 [2024-11-20 12:54:39.215101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.383 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.215284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.215405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.215431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.215528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.215674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.215699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.215836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.215932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.215974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.216080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.216332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.216641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.216853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.216980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.217162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.217436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.217727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.217867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.218043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.218297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.218573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.218807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.218945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.219047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.219175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.219201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.219297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.219441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.219469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.219589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.219711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.219737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.219876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.220220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.220513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.220828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.220954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.221128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.221221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.221247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.221356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.221481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.221506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.221600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.221692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.221723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.221873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.222169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.222421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.222668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.222820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.222922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.223213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.223523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.223753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.223923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.224081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.224204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.384 [2024-11-20 12:54:39.224240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.384 qpair failed and we were unable to recover it. 00:27:06.384 [2024-11-20 12:54:39.224381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.224512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.224552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.224676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.224768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.224794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.224889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.225192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.225436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.225744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.225892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.226025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.226176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.226202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.226329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.226452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.226478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.226602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.226735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.226765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.226937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.227190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.227473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.227703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.227839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.227987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.228362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.228610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.228872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.228992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.229140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.229447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.229717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.229863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.230044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.230158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.230185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.230338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.230483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.230511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.230653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.230744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.230768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.230909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.231258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.231554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.231847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.231983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.232118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.232434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.232728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.232902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.233016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.233117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.233146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.233302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.233420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.233445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.385 [2024-11-20 12:54:39.233557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.233732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.385 [2024-11-20 12:54:39.233757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.385 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.233879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.233992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.234161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.234482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.234782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.234921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.235066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.235166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.235191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.235318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.235442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.235467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.235616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.235769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.235793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.235890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.236167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.236409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.236703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.236874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.236990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.237122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.237163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.237313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.237480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.237504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.237640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.237760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.237785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.237927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.238158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.238451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.238658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.238768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.238939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.239222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.239483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.239756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.239894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.239979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.240226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.240531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.240815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.240933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.241049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.241201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.241228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.241327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.241460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.241487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.241595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.241747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.241773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.241899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.242034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.242061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.386 qpair failed and we were unable to recover it. 00:27:06.386 [2024-11-20 12:54:39.242219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.386 [2024-11-20 12:54:39.242368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.242392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.242540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.242658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.242683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.242844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.243151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.243405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.243629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.243867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.243987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.244106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.244241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.244267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.244398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.244545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.244576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.244679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.244787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.244815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.244935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.245163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.245399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.245699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.245849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.245991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.246248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.246534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.246799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.246961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.247110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.247254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.247283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.247406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.247507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.247534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.247671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.247816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.247843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.247947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.248217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.248459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.387 qpair failed and we were unable to recover it. 00:27:06.387 [2024-11-20 12:54:39.248707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.387 [2024-11-20 12:54:39.248850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.248964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.249255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.249523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.249805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.249928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.250053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.250232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.250262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.250384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.250498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.250527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.250642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.250762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.250787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.250924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.251177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.251478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.251731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.251910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.252036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.252182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.252210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.252319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.252437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.252462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.252667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.252822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.252850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.252958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.253243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.253466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.253659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.253812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.253936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.254178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.254399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.254648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.254792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.254897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.255041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.255078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.255189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.255350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.255376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.388 qpair failed and we were unable to recover it. 00:27:06.388 [2024-11-20 12:54:39.255476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-20 12:54:39.255600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.255625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.255760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.255870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.255897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.256002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.256105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.256133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.256278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.256404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.256428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.256644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.256755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.256784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.256915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.257189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.257403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.257644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.257885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.257991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.258113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.258404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.258692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.258843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.258968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.259236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.259524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.259732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.259881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.260024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.260313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.260572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.260854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.260990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.261132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.261400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.261636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.261807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.261926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.262194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.262553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.262859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.262977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.263117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.263385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.263619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-20 12:54:39.263810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.389 qpair failed and we were unable to recover it. 00:27:06.389 [2024-11-20 12:54:39.263949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.264225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.264518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.264781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.264916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.265017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.265282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.265532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.265802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.265933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.266059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.266327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.266586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.266901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.266997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.267168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.267434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.267671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.267818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.267966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.268240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.268513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.268763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.268883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.268974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.269217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.269432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.269726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.269869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.270014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.270262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.270565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.270848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.270975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.271096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.271219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.271244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.271370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.271481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.271513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.271611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.271704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.271729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.390 [2024-11-20 12:54:39.271855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.272012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-20 12:54:39.272040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.390 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.272224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.272344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.272384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.272533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.272657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.272682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.272835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.273205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.273507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.273801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.273929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.274094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.274225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.274254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.274377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.274471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.274496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.274650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.274777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.274805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.274939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.275231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.275450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.275714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.275847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.276083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.276225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.276250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.276394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.276498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.276525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.276664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.276768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.276795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.276911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.277170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.277429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.277697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.277845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.277964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.278191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.278498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.278718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.278832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.278983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.279276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.279533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.279835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.279971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.280103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.280251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.280277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.280427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.280563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.280590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.391 [2024-11-20 12:54:39.280695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.280833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.391 [2024-11-20 12:54:39.280857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.391 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.280955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.281200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.281499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.281772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.281923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.282032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.282307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.282623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.282853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.282984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.283175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.283502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.283718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.283860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.283957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.284253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.284508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.284826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.284997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.285153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.285408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.285723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.285890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.286143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.286271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.286296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.286397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.286536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.286563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.286734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.286862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.286885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.286980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.287117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.287143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.287286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.287411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.287434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.287578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.287685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.287712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.287855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.288005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.288029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.288157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.288301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.288327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.392 qpair failed and we were unable to recover it. 00:27:06.392 [2024-11-20 12:54:39.288416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.392 [2024-11-20 12:54:39.288506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.288531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.288660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.288780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.288805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.288924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.289255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.289521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.289818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.289948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.290054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.290358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.290586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.290801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.290923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.291019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.291116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.291144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.291267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.291389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.291414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.291552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.291690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.291718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.291853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.292172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.292409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.292724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.292875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.292998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.293131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.293159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.293266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.293422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.293449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.293540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.293688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.293713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.293859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.294197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.294454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.294729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.294878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.295017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.295290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.295555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.295821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.295983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.296008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.296132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.296236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.393 [2024-11-20 12:54:39.296262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.393 qpair failed and we were unable to recover it. 00:27:06.393 [2024-11-20 12:54:39.296367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.296505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.296533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.296635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.296770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.296795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.296917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.297228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.297480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.297762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.297919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.298064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.298205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.298234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.298345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.298441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.298468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.298615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.298747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.298772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.298920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.299247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.299465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.299697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.299860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.300036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.300277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.300543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.300806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.300942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.301058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.301279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.301514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.301801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.301914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.302012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.302280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.302619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.302856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.302990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.303168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.303423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.303719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.303874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.394 qpair failed and we were unable to recover it. 00:27:06.394 [2024-11-20 12:54:39.304003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.394 [2024-11-20 12:54:39.304124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.304252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.304506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.304790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.304951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.305065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.305170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.305199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.305318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.305453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.305477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.305598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.305721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.305745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.305917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.306168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.306395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.306678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.306785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.306915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.307260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.307545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.307770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.307914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.308052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.308360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.308593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.308819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.308943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.309096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.309354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.309593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.309861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.309976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.310095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.310197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.310223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.310351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.310463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.310498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.310623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.310740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.310764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.310879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.311026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.311053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.311159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.311313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.311339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.311464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.311566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.395 [2024-11-20 12:54:39.311590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.395 qpair failed and we were unable to recover it. 00:27:06.395 [2024-11-20 12:54:39.311711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.311822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.311849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.311983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.312276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.312545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.312803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.312917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.313074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.313189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.313213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.313367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.313499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.313527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.313663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.313830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.313855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.313972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.314199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.314444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.314766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.314892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.315004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.315245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.315461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.315743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.315931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.316067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.316354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.316623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.316889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.316984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.317107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.317408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.317705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.317895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.318009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.318107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.318131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.318283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.318428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.396 [2024-11-20 12:54:39.318454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.396 qpair failed and we were unable to recover it. 00:27:06.396 [2024-11-20 12:54:39.318593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.318709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.318735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.318883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.318973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.318997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.319096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.319249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.319278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.319383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.319530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.319556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.319650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.319774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.319801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.319904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.320165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.320480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.320807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.320992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.321094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.321234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.321258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.321379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.321498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.321522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.321670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.321777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.321804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.321943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.322223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.322473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.322703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.322878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.323018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.323296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.323573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.323869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.323989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.324097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.324198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.324226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.324374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.324532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.324560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.324682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.324803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.324827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.324936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.325263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.325583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.325867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.325999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.326027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.326156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.326293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.326318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.397 qpair failed and we were unable to recover it. 00:27:06.397 [2024-11-20 12:54:39.326417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.397 [2024-11-20 12:54:39.326537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.326563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.326655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.326795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.326823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.326991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.327289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.327505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.327770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.327918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.328047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.328286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.328519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.328796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.328935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.329088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.329301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.329553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.329829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.329978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.330151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.330385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.330622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.330875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.330973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.331132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.331415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.331670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.331829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.331974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.332102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.332128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.332239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.332409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.332434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.332579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.332739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.332765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.332909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.333228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.333565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.333820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.333969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.398 [2024-11-20 12:54:39.334103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.334215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.398 [2024-11-20 12:54:39.334240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.398 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.334332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.334429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.334454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.334586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.334675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.334701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.334843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.334976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.335141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.335415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.335635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.335781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.335915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.336214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.336431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.336724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.336883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.336997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.337250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.337527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.337780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.337923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.338027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.338154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.338181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.338271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.338394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.338423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.338590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.338737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.338781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.338922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.339243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.339523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.339764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.339881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.339971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.340211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.340505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.340766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.340909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.341034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.341263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.341539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.399 qpair failed and we were unable to recover it. 00:27:06.399 [2024-11-20 12:54:39.341834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.399 [2024-11-20 12:54:39.341957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.341982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.342080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.342194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.342222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.342326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.342471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.342497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.342618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.342724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.342748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.342890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.343190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.343474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.343742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.343912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.344040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.344325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.344562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.344797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.344999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.345148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.345238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.345262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.345395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.345492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.345518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.345652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.345797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.345822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.345933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.346167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.346410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.346680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.346804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.346903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.347201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.347488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.347711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.347850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.347990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.348313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.348545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.348833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.348969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.349117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.349234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.349260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.400 [2024-11-20 12:54:39.349397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.349512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.400 [2024-11-20 12:54:39.349540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.400 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.349664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.349773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.349800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.349922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.350203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.350494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.350723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.350899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.351046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.351309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.351559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.351855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.351984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.352139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.352453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.352695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.352853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.352965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.353222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.353500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.353744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.353909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.354055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.354309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.354580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.354891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.354982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.355108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.355415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.355695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.355840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.355950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.356243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.356568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.401 [2024-11-20 12:54:39.356873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.356976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.401 [2024-11-20 12:54:39.357004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.401 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.357119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.357392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.357652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.357870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.357997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.358096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.358220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.358244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.358382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.358551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.358578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.358721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.358829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.358857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.358995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.359309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.359604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.359897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.359997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.360187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.360482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.360772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.360922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.361035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.361294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.361535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.361803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.361987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.362121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.362256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.362284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.362431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.362529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.362553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.362646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.362760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.362787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.362922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.363168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.363457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.363699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.363829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.364012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.364292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.364602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.364847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.364990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.365149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.365283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.365313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.402 [2024-11-20 12:54:39.365427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.365524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.402 [2024-11-20 12:54:39.365553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.402 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.365676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.365797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.365822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.365996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.366292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.366500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.366808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.366969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.367104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.367212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.367239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.367353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.367472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.367498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.367583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.367735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.367761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.367899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.368205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.368494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.368780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.368906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.369049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.369317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.369603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.369875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.369994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.370108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.370234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.370260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.370359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.370525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.370553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.370669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.370794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.370819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.370943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.371199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.371412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.371650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.371811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.371954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.372259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.372554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.372843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.372991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.373123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.373219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.373245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.373344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.373491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.373515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.373653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.373792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.373820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.403 qpair failed and we were unable to recover it. 00:27:06.403 [2024-11-20 12:54:39.373934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.374059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.403 [2024-11-20 12:54:39.374110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.374237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.374356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.374381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.374497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.374631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.374671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.374784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.374902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.374927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.375081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.375346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.375611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.375858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.375982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.376161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.376434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.376750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.376894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.376983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.377225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.377529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.377820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.377993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.378142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.378310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.378338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.378439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.378567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.378594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.378706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.378877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.378901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.378991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.379251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.379550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.379820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.379998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.380135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.380235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.380261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.380357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.380524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.380553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.380673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.380770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.380796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.380946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.381090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.381119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.381256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.381391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.381418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.381595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.381687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.381712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.381857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.382177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.382426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.404 qpair failed and we were unable to recover it. 00:27:06.404 [2024-11-20 12:54:39.382675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.404 [2024-11-20 12:54:39.382803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.382831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.382991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.383267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.383561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.383798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.383963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.384099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.384195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.384220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.384346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.384437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.384464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.384563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.384703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.384731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.384849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.385161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.385407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.385709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.385828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.385929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.386223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.386522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.386793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.386929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.387059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.387223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.387247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.387344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.387458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.387482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.387623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.387764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.387789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.387887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.388152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.388395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.388679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.388841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.388955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.389218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.389479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.389758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.389925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.405 [2024-11-20 12:54:39.390062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.390175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.405 [2024-11-20 12:54:39.390202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.405 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.390316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.390418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.390461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.390613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.390735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.390764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.390862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.390955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.390980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.391074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.391188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.391217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.391356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.391478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.391503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.391620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.391719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.391746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.391879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.392194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.392477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.392730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.392868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.393008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.393175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.393201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.393305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.393395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.393425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.393578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.393746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.393774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.393910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.394235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.394576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.394838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.394988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.395218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.395504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.395763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.395885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.396009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.396133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.396162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.396326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.396486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.396518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.396666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.396795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.396821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.396972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.397277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.397565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.397799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.397937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.398106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.398242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.398269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.398419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.398510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.398537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.398685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.398801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.398827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.398970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.399227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.399467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.406 qpair failed and we were unable to recover it. 00:27:06.406 [2024-11-20 12:54:39.399769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.406 [2024-11-20 12:54:39.399871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.399897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.400054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.400288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.400582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.400898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.400990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.401119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.401386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.401680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.401899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.401991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.402143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.402411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.402728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.402891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.402996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.403286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.403548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.403851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.403971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.404104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.404196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.404221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.404347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.404465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.404507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.404678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.404842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.404868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.404995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.405142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.405166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.405310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.405450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.405477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.405618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.405741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.405766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.405919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.406207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.406463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.406754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.406928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.407024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.407173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.407198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.407315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.407458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.407484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.407619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.407742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.407767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.407952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.408286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.408555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.408840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.408998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.409026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.407 [2024-11-20 12:54:39.409159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.409259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.407 [2024-11-20 12:54:39.409285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.407 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.409444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.409610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.409638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.409741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.409845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.409873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.410058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.410207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.410233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.410360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.410483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.410507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.410613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.410769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.410794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.410921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.411263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.411527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.411821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.411995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.412118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.412265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.412289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.412449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.412556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.412585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.412749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.412857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.412883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.413020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.413245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.413510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.413794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.413946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.414089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.414245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.414274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.414410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.414560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.414585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.414705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.414826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.414850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.414999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.415158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.415187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.415318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.415476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.415503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.415647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.415794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.415819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.415947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.416243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.416547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.416794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.416905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.417083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.417236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.417262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.417378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.417466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.417491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.417637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.417796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.417824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.417988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.418260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.418522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.408 [2024-11-20 12:54:39.418786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.408 [2024-11-20 12:54:39.418955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.408 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.419080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.419228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.419253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.419377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.419530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.419555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.419707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.419853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.419877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.419998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.420252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.420536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.420820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.420958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.421150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.421280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.421308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.421477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.421598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.421622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.421745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.421867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.421891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.422012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.422104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.422146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.422249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.422416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.422443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.422646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.422765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.422806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.422939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.423235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.423484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.423814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.423952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.424056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.424170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.424196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.424319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.424419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.424443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.424535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.424681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.424709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.424876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.425221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.425558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.425849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.425983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.426115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.426329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.426584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.426868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.426993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.427197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.427466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.427751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.427870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.427957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.428081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.428107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.409 qpair failed and we were unable to recover it. 00:27:06.409 [2024-11-20 12:54:39.428262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.409 [2024-11-20 12:54:39.428409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.428436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.428579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.428728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.428752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.428929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.429254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.429496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.429785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.429942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.430083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.430227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.430255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.430398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.430527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.430551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.430687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.430827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.430855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.430991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.431274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.431566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.431878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.431974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.432172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.432464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.432734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.432871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.432995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.433246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.433587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.433832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.433981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.434127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.434395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.434722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.434869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.434960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.435260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.435502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.435769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.435942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.436064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.436175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.436204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.436352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.436437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.436462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.436560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.436680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.436705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.436860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.437181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.437455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.437877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.437998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.438023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.438129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.438266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.438291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.438458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.438563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.438591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.410 qpair failed and we were unable to recover it. 00:27:06.410 [2024-11-20 12:54:39.438724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.410 [2024-11-20 12:54:39.438824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.438851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.438994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.439236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.439503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.439842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.439967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.440158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.440410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.440667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.440809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.440948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.441049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.441084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.441261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.441381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.441405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.441555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.441678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.441702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.441853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.442226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.442557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.442834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.442982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.443157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.443395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.443665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.443861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.443985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.444249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.444482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.444749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.444871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.445042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.445191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.445217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.445316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.445458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.445486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.445624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.445759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.445788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.445940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.446266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.446588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.446871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.446989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.447114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.447349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.447640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.447787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.447931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.448177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.448451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.448727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.448903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.449001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.449132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.449160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.411 [2024-11-20 12:54:39.449311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.449458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.411 [2024-11-20 12:54:39.449481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.411 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.449641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.449791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.449816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.449935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.450224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.450450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.450785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.450972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.451090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.451244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.451268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.451377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.451499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.451523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.451655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.451750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.451792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.451952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.452227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.452570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.452843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.452987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.453136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.453249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.453277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.453373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.453497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.453524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.453667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.453761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.453784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.453909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.454172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.454453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.454732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.454904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.455005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.455169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.455198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.455314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.455452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.455477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.455619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.455724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.455751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.455902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.456165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.456530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.456810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.456971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.457119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.457219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.457244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.457938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.458096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.458126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.458275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.458379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.458424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.458562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.458677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.458702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.458867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.459012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.459040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.412 [2024-11-20 12:54:39.459170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.459260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.412 [2024-11-20 12:54:39.459285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.412 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.459377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.459466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.459491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.459636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.459757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.459785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.459893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.459994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.460157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.460402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.460693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.460836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.460952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.461240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.461476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.461725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.461868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.462002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.462271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.462532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.462847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.462988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.463174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.463442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.463691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.463807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.463978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.464211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.464473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.464750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.464911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.465047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.465146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.465171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.465272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.465363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.465388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.465474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.465597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.695 [2024-11-20 12:54:39.465622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.695 qpair failed and we were unable to recover it. 00:27:06.695 [2024-11-20 12:54:39.465723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.465832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.465861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.465968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.466257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.466518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.466846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.466996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.467123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.467358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.467675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.467841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.468010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.468303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.468530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.468828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.468997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.469177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.469263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.469287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.469406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.469504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.469529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.469678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.469824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.469851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.470063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.470309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.470588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.470885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.470996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.471132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.471274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.471302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.471449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.471570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.471595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.471724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.471846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.471870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.471993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.472233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.472481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.472756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.472902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.473013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.473163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.696 [2024-11-20 12:54:39.473189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.696 qpair failed and we were unable to recover it. 00:27:06.696 [2024-11-20 12:54:39.473285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.473408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.473433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.473573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.473705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.473732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.473866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.473993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.474148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.474418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.474667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.474821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.474947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.475256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.475521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.475793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.475950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.476097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.476222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.476246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.476378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.476526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.476551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.476676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.476775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.476802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.476985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.477239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.477502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.477764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.477951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.478115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.478230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.478254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.478368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.478521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.478545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.478726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.478830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.478858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.479025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.479168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.479197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.479313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.479464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.479489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.479649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.479782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.479809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.697 [2024-11-20 12:54:39.479915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.480021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.697 [2024-11-20 12:54:39.480046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.697 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.480150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.480323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.480368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.480494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.480637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.480662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.480748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.480864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.480887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.481042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.481150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.481175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.481322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.481449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.481475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.481605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.481699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.481726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.481880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.482199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.482496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.482809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.482952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.483044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.483312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.483588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.483809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.483959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.484092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.484193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.484219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.484345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.484441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.484465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.484608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.484709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.484752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.484873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.485174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.485401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.485703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.485842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.485954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.486206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.486506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.486848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.486962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.487099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.487203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.487228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.698 qpair failed and we were unable to recover it. 00:27:06.698 [2024-11-20 12:54:39.487368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.698 [2024-11-20 12:54:39.487498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.487527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.487699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.487798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.487822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.487947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.488042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.488092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.488231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.488335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.488378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.488532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.488651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.488694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.488870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.489145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.489427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.489645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.489814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.489938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.490219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.490506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.490799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.490985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.491173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.491298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.491341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.491474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.491607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.491635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.491764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.491883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.491907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.492037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.492135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.492160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.492279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.492458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.492482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.492627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.492777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.492803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.492960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.493186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.493439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.493709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.493860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.493969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.494200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.494427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.699 qpair failed and we were unable to recover it. 00:27:06.699 [2024-11-20 12:54:39.494692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.699 [2024-11-20 12:54:39.494815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.494839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.494979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.495233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.495502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.495804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.495999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.496100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.496192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.496216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.496344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.496505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.496532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.496670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.496802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.496829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.497013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.497145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.497187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.497328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.497491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.497518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.497655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.497765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.497802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.497945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.498232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.498524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.498842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.498989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.499013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.499210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.499336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.499360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.499528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.499697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.499722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.499824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.499980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.500136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.500417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.500685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.500831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.500985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.501263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.501523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.700 [2024-11-20 12:54:39.501775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.700 [2024-11-20 12:54:39.501938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.700 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.502125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.502252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.502277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.502435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.502572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.502614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.502714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.502814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.502866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.502996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.503342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.503573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.503849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.503989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.504179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.504392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.504649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.504809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.504957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.505282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.505512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.505824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.505975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.506080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.506243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.506269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.506406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.506550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.506575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.506726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.506822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.506856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.507006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.507334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.507571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.507806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.507952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.508081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.508260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.508287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.508456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.508605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.508648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.508824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.508991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.509019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.509190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.509314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.509339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.509536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.509699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.509728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.509877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.509995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.510019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.701 [2024-11-20 12:54:39.510147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.510241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.701 [2024-11-20 12:54:39.510265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.701 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.510380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.510472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.510496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.510603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.510707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.510733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.510876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.511192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.511515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.511803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.511959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.512080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.512242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.512267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.512411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.512511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.512539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.512675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.512779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.512807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.512951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.513187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.513517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.513796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.513994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.514136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.514234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.514260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.514407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.514511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.514539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.514677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.514832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.514864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.515015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.515165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.515194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.515334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.515493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.515521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.515692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.515840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.515882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.515989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.516255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.516553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.516779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.516985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.702 qpair failed and we were unable to recover it. 00:27:06.702 [2024-11-20 12:54:39.517145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.702 [2024-11-20 12:54:39.517302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.517330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.517474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.517622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.517648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.517772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.517879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.517923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.518097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.518295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.518321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.518466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.518589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.518614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.518738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.518873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.518900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.519003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.519264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.519516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.519811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.519982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.520109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.520354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.520596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.520834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.520956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.521079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.521179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.521205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.521344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.521491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.521516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.521639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.521794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.521820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.521966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.522249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.522518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.522812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.522938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.523081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.523218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.523244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.523394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.523539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.523582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.523728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.523868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.523895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.524054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.524308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.524578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.524844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.703 [2024-11-20 12:54:39.524997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.703 qpair failed and we were unable to recover it. 00:27:06.703 [2024-11-20 12:54:39.525173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.525305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.525329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.525451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.525541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.525566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.525662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.525777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.525800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.525892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.526216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.526506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.526828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.526975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.527171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.527466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.527837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.527961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.528087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.528223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.528251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.528379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.528504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.528532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.528653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.528775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.528800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.528951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.529103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.529129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.529273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.529453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.529478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.529627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.529751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.529797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.529906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.530186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.530523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.530787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.530919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.531053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.531229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.531255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.531382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.531512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.531536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.531653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.531755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.531782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.704 qpair failed and we were unable to recover it. 00:27:06.704 [2024-11-20 12:54:39.531891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.532025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.704 [2024-11-20 12:54:39.532052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.532206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.532327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.532351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.532461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.532589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.532621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.532727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.532827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.532853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.533024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.533113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.533138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.533287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.533451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.533478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.533611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.533746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.533775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.533913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.534223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.534556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.534851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.534991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.535148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.535285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.535326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.535462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.535613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.535644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.535763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.535886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.535911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.536030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.536135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.536162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.536345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.536433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.536459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.536560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.536710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.536734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.536879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.537197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.537430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.537708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.537852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.537999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.538147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.538173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.538362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.538493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.538518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.538653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.538810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.538836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.538994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.539135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.539176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.539299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.539394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.539419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.705 qpair failed and we were unable to recover it. 00:27:06.705 [2024-11-20 12:54:39.539505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.539635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.705 [2024-11-20 12:54:39.539675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.539809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.539908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.539935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.540118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.540214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.540239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.540363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.540457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.540498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.540607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.540748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.540772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.540860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.541181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.541514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.541853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.541975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.542092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.542333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.542597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.542843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.542966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.543131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.543270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.543297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.543440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.543523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.543547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.543716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.543815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.543839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.543933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.544246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.544478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.544815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.544964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.545079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.545348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.545614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.545853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.545990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.546144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.546366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.546600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.706 [2024-11-20 12:54:39.546853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.546975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.706 [2024-11-20 12:54:39.547003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.706 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.547155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.547278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.547303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.547404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.547520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.547544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.547688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.547780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.547821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.547917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.548218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.548484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.548752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.548911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.549081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.549170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.549194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.549338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.549470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.549497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.549607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.549742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.549769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.549937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.550060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.550095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.550229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.550389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.550415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.550549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.550685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.550713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.550884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.551162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.551465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.551740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.551915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.552033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.552217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.552242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.552356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.552491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.552519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.552659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.552775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.552799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.552911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.553194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.553548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.553804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.553977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.554100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.554244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.554272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.707 qpair failed and we were unable to recover it. 00:27:06.707 [2024-11-20 12:54:39.554422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.707 [2024-11-20 12:54:39.554544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.554568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.554671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.554807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.554832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.554955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.555131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.555159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.555329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.555458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.555483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.555650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.555781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.555809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.555945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.556273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.556567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.556857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.556959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.557106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.557362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.557682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.557842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.557942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.558089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.558115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.558238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.558371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.558404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.558568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.558708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.558732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.558883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.559238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.559503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.559745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.559929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.560047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.560246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.560276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.560409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.560545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.560573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.560686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.560788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.560813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.560904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.561227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.561503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.561795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.561940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.562058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.562214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.562241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.562352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.562450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.562475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.708 qpair failed and we were unable to recover it. 00:27:06.708 [2024-11-20 12:54:39.562597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.708 [2024-11-20 12:54:39.562750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.562775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.562884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.563180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.563480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.563761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.563915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.564016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.564291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.564573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.564876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.564999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.565154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.565288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.565315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.565414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.565519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.565546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.565725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.565848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.565873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.565964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.566203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.566486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.566750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.566894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.567054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.567195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.567219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.567312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.567468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.567492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.567674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.567795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.567820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.567964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.568294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.568603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.568885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.568992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.569019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.569171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.569322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.569346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.569495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.569602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.569630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.709 qpair failed and we were unable to recover it. 00:27:06.709 [2024-11-20 12:54:39.569795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.709 [2024-11-20 12:54:39.569982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.570145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.570370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.570634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.570818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.570917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.571077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.571103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.571254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.571399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.571425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.571575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.571723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.571751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.571896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.572233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.572544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.572785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.572965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.573089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.573202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.573236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.573373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.573532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.573560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.573704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.573829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.573854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.573959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.574249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.574552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.574794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.574935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.575037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.575314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.575576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.575848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.575980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.576144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.576389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.576698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.576847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.576991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.577145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.577171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.577329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.577495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.577524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.577680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.577797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.577823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.710 qpair failed and we were unable to recover it. 00:27:06.710 [2024-11-20 12:54:39.577914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.578031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.710 [2024-11-20 12:54:39.578055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.578187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.578274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.578316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.578444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.578576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.578604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.578753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.578874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.578902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.579005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.579121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.579146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.579235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.579396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.579420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.579543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.579664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.579688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.583240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.583379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.583411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.583523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.583682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.583709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.583833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.583989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.584127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.584455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.584722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.584875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.584977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.585102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.585127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.585297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.585464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.585492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.585629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.585760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.585784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.585899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.586239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.586545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.586807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.586977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.587088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.587240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.587267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.587391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.587517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.587543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.587669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.587783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.587810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.587926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.588242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.588532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.588837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.588973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.589002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.589154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.589277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.589303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.711 qpair failed and we were unable to recover it. 00:27:06.711 [2024-11-20 12:54:39.589406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.711 [2024-11-20 12:54:39.589548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.589576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.589724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.589855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.589880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.589977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.590270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.590541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.590870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.590991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.591169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.591461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.591766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.591891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.592061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.592204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.592229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.592390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.592508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.592532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.592632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.592725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.592749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.592871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.593204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.593476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.593703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.593853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.594049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.594337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.594601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.594844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.594975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.595145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.595375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.595603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.595798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.595912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.596060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.596093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.596245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.596381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.596409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.596541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.596702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.596729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.596875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.597008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.597033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.597159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.597255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.597282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.712 qpair failed and we were unable to recover it. 00:27:06.712 [2024-11-20 12:54:39.597428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.712 [2024-11-20 12:54:39.597552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.597577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.597670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.597796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.597821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.597964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.598241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.598543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.598809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.598968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.599077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.599328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.599546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.599766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.599901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.600010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.600264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.600574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.600812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.600976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.601121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.601247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.601273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.601417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.601584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.601609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.601733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.601826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.601851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.601948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.602066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.602099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.602274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.602404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.602431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.602580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.602699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.602724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.602892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.603218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.603581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.603836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.603978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.604134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.604406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.604706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.604877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.605027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.605150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.605191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.713 [2024-11-20 12:54:39.605318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.605450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.713 [2024-11-20 12:54:39.605475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.713 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.605632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.605766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.605791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.605912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.606208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.606490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.606769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.606951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.607084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.607217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.607243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.607345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.607496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.607521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.607663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.607807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.607832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.607928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.608205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.608450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.608705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.608848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.609027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.609279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.609497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.609786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.609924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.610018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.610296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.610565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.610869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.610994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.611146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.611417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.611719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.611887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.611977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.612096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.612122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.714 [2024-11-20 12:54:39.612245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.612377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.714 [2024-11-20 12:54:39.612405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.714 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.612564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.612671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.612699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.612809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.612926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.612950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.613091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.613196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.613222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.613355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.613494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.613521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.613632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.613765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.613791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.613928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.614215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.614494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.614768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.614908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.615031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.615164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.615189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.615317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.615405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.615429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.615552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.615713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.615741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.615877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.616191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.616535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.616804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.616951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.617078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.617231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.617256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.617376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.617482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.617508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.617658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.617847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.617872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.617967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.618209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.618499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.618748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.618893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.619039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.619227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.619252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.619342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.619467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.619498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.619597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.619717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.619742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.619914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.620094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.620119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.620246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.620362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.715 [2024-11-20 12:54:39.620389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.715 qpair failed and we were unable to recover it. 00:27:06.715 [2024-11-20 12:54:39.620525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.620640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.620665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.620795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.620923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.620950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.621097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.621224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.621252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.621429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.621578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.621621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.621750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.621850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.621879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.622014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.622148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.622176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.622324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.622450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.622479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.622612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.622749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.622777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.622900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.623170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.623406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.623701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.623841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.623963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.624263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.624541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.624828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.624976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.625181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.625268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.625298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.625418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.625571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.625597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.625708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.625832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.625858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.625978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.626237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.626545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.626815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.626991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.627123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.627258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.627287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.627437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.627540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.627565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.627691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.627845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.627870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.628000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.628100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.628143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.628290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.628395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.628421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.716 qpair failed and we were unable to recover it. 00:27:06.716 [2024-11-20 12:54:39.628584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.716 [2024-11-20 12:54:39.628683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.628711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.628854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.628984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.629148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.629381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.629666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.629800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.629910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.630206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.630501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.630767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.630910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.631032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.631299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.631609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.631853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.631985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.632132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.632418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.632679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.632834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.632934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.633236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.633540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.633851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.633980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.634116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.634368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.634650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.634813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.634927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.635199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.635497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.635761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.635906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.636025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.636169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.636195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.717 qpair failed and we were unable to recover it. 00:27:06.717 [2024-11-20 12:54:39.636287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.636432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.717 [2024-11-20 12:54:39.636460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.636614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.636731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.636756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.636895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.637176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.637466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.637748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.637900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.638045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.638321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.638550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.638792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.638908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.638999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.639305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.639589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.639833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.639947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.640067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.640237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.640262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.640351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.640466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.640495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.640605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.640745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.640770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.640880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.641183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.641477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.641691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.641817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.641965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.642257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.642543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.642852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.642978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.643156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.643412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.718 qpair failed and we were unable to recover it. 00:27:06.718 [2024-11-20 12:54:39.643691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.718 [2024-11-20 12:54:39.643882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.644024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.644143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.644169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.644297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.644423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.644452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.644586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.644719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.644747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.644943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.645230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.645473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.645765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.645931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.646064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.646332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.646575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.646783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.646930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.647043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.647361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.647599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.647843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.647999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.648115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.648213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.648238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.648357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.648492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.648520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.648648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.648772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.648817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.648910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.649163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.649452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.649703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.649822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.649909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.650268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.650591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.650846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.650972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.651001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.651129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.651251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.719 [2024-11-20 12:54:39.651278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.719 qpair failed and we were unable to recover it. 00:27:06.719 [2024-11-20 12:54:39.651371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.651490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.651516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.651626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.651768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.651796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.651941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.652221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.652493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.652757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.652908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.653053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.653341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.653589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.653867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.653984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.654128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.654269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.654298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.654469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.654562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.654588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.654708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.654828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.654854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.655005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.655278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.655530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.655779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.655903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.656054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.656340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.656577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.656880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.656996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.657180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.657298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.657323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.657464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.657620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.657648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.657797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.657909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.657937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.658090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.658400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.658634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.658889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.658994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.659019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.720 [2024-11-20 12:54:39.659154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.659273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.720 [2024-11-20 12:54:39.659299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.720 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.659462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.659605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.659633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.659809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.659961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.660159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.660396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.660668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.660815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.660964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.661062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.661130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.661267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.661372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.661415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.661565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.661696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.661737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.661901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.662251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.662520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.662814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.662972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.663091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.663396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.663598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.663837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.663977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.664133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.664436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.664644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.664790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.664910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.665234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.665492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.665802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.665950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.666082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.666200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.666226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.666368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.666505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.666533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.666646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.666743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.666769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.666860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.667010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.667039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.721 qpair failed and we were unable to recover it. 00:27:06.721 [2024-11-20 12:54:39.667189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.721 [2024-11-20 12:54:39.667285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.667316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.667441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.667569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.667594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.667710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.667896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.667921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.668042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.668319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.668520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.668786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.668920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.669038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.669217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.669244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.669364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.669500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.669527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.669625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.669735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.669760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.669910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.670170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.670440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.670673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.670786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.670946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.671214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.671493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.671709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.671836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.671938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.672092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.672121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.672264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.672387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.672413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.672556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.672700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.672731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.672874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.673162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.673452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.673714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.673931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.674079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.674296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.674584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.674867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.674989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.722 [2024-11-20 12:54:39.675015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.722 qpair failed and we were unable to recover it. 00:27:06.722 [2024-11-20 12:54:39.675173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.675332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.675361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.675466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.675593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.675621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.675763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.675913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.675938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.676051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.676294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.676563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.676845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.676976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.677181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.677434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.677694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.677871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.677971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.678241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.678499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.678788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.678921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.679077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.679304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.679530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.679828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.679999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.680209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.680458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.680721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.680837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.680959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.681240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.681513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.681814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.723 [2024-11-20 12:54:39.681977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.723 qpair failed and we were unable to recover it. 00:27:06.723 [2024-11-20 12:54:39.682084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.682213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.682241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.682380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.682505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.682529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.682650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.682740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.682767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.682886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.683244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.683526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.683816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.683986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.684117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.684332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.684645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.684891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.684985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.685107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.685348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.685637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.685844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.685995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.686166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.686433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.686692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.686857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.686965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.687056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.687094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.687261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.687347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.687372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.687530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.687643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.687668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.687833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.688177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.688423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.688652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.688792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.688910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.689175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.689473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.724 qpair failed and we were unable to recover it. 00:27:06.724 [2024-11-20 12:54:39.689758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.724 [2024-11-20 12:54:39.689906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.690019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.690338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.690595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.690856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.690991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.691148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.691301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.691328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.691502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.691615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.691640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.691786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.691883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.691911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.692028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.692320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.692564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.692781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.692943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.693096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.693355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.693564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.693792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.693935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.694075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.694238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.694265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.694408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.694533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.694576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.694696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.694784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.694813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.694954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.695265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.695544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.695744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.695894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.696061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.696209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.696235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.696357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.696482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.696508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.696652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.696788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.696815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.696917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.697052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.697109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.725 [2024-11-20 12:54:39.697226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.697375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.725 [2024-11-20 12:54:39.697401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.725 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.697534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.697638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.697666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.697791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.697889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.697915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.698011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.698275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.698578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.698788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.698965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.699124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.699346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.699618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.699888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.699996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.700152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.700364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.700695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.700838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.700940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.701203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.701471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.701747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.701883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.701998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.702276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.702546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.702870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.702994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.703143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.703416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.703724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.703840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.703960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.704185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.704433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.704682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.726 [2024-11-20 12:54:39.704837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.726 qpair failed and we were unable to recover it. 00:27:06.726 [2024-11-20 12:54:39.704950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.705251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.705512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.705810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.705932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.706078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.706179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.706203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.706314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.706474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.706502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.706601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.706732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.706761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.706881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.707145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.707420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.707703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.707847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.708005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.708250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.708517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.708801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.708948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.709051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.709200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.709228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.709397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.709496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.709521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.709680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.709794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.709822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.709927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.710175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.710458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.710732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.710854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.711004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.711289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.711592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.711840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.711959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.712084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.712215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.712243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.712347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.712500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.712525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.727 [2024-11-20 12:54:39.712648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.712770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.727 [2024-11-20 12:54:39.712796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.727 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.712897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.713229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.713570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.713866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.713993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.714131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.714279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.714311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.714407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.714530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.714555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.714673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.714776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.714806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.714906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.715227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.715505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.715761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.715897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.716022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.716268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.716580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.716817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.716935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.717036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.717349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.717560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.717829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.717956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.718088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.718339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.718558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.718841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.718973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.719003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.719116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.719213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.719238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.719387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.719530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.719557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.728 qpair failed and we were unable to recover it. 00:27:06.728 [2024-11-20 12:54:39.719663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.728 [2024-11-20 12:54:39.719830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.719855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.719976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.720253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.720519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.720821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.720968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.721105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.721233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.721261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.721392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.721502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.721544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.721669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.721762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.721786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.721923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.722210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.722473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.722706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.722872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.723049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.723295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.723583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.723838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.723985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.724141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.724238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.724264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.724369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.724526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.724555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.724695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.724795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.724825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.724963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.725257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.725486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.725735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.725885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.725999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.726264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.726471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.726733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.726928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.727062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.727231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.727257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.729 [2024-11-20 12:54:39.727371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.727462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.729 [2024-11-20 12:54:39.727486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.729 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.727582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.727698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.727725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.727862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.727986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.728154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.728395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.728657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.728849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.728989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.729267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.729540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.729803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.729918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.730014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.730287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.730534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.730787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.730956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.731081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.731345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.731584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.731856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.731974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.732146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.732392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.732704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.732842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.732973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.733278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.733547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.733879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.733977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.734095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.734376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.734675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.734824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.730 qpair failed and we were unable to recover it. 00:27:06.730 [2024-11-20 12:54:39.734966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.730 [2024-11-20 12:54:39.735080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.735202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.735506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.735803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.735927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.736038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.736179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.736209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.736357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.736482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.736509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.736618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.736723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.736767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.736872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.737196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.737458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.737810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.737940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.738082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.738365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.738616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.738891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.738985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.739132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.739410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.739713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.739828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.739939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.740239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.740494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.740730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.740854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.740960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.741102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.741127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.741236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.741333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.741358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.731 [2024-11-20 12:54:39.741445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.741589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.731 [2024-11-20 12:54:39.741619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.731 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.741731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.741836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.741865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.742013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.742267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.742589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.742878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.742998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.743149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.743368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.743635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.743846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.743991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.744088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.744356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.744559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.744822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.744949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.745077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.745177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.745203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.745293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.745443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.745473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.745609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.745766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.745795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.745905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.746167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.746451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.746721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.746893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.747053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.747185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.747211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.747345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.747457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.747486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.747630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.747746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.747771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.747880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.748184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.748426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.748698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.748823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.732 [2024-11-20 12:54:39.748954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.749085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.732 [2024-11-20 12:54:39.749114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.732 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.749241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.749356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.749381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.749509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.749657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.749686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.749809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.749972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.750160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.750443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.750692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.750834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.750953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.751237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.751523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.751792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.751937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.752031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.752197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.752226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.752330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.752489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.752522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.752660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.752805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.752831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.752980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.753305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.753576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.753838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.753982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.754157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.754406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.754717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.754860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.755011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.755125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.755155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.755304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.755425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.755455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.755605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.755705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.755734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.755880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.756158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.756415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.756683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.756829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.733 qpair failed and we were unable to recover it. 00:27:06.733 [2024-11-20 12:54:39.756945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.733 [2024-11-20 12:54:39.757083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.757219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.757465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.757761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.757935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.758050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.758306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.758590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.758836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.758979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.759097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.759219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.759246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.759364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.759483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.759509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.759649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.759771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.759799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.759929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.760174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.760441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.760760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.760927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.761081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.761198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.761224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.761345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.761447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.761492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.761619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.761744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.761770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.761888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.762162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.762419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.762727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.762872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.762978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.763156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.763182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.763341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.763487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.763516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.763659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.763781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.763806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.763923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.764056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.764098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.764240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.764360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.764385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.764479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.764574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.734 [2024-11-20 12:54:39.764599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.734 qpair failed and we were unable to recover it. 00:27:06.734 [2024-11-20 12:54:39.764743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.764900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.764926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.765032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.765209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.765238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.765387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.765484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.765511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.765639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.765745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.765773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.765909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.766162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.766426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.766669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.766837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.766939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.767196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.767466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.767762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.767888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.767984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.768219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.768528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.768796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.768926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.769097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.769238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.769270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.769449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.769623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.769651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.769773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.769874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.769916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.770037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.770320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.770553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.770829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.770986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.771093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.771292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.771531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.771763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.771903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.772058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.772194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.772220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.735 [2024-11-20 12:54:39.772362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.772494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.735 [2024-11-20 12:54:39.772522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.735 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.772663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.772759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.772784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.772911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.773224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.773497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.773706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.773867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.773986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.774242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.774514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.774804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.774931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.775033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.775279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.775582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.775792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.775906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.776023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.776270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.776564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.776809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.776935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.777083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.777221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.777250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.777392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.777509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.777534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.777654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.777759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.777787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.777893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.778216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.778437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.778683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.736 [2024-11-20 12:54:39.778834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:06.736 qpair failed and we were unable to recover it. 00:27:06.736 [2024-11-20 12:54:39.778957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.779105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.779134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.779260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.779431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.779460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.779566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.779692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.779721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.779869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.780143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.780425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.780696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.780876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.781032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.781289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.781554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.781776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.781916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.782040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.782293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.782535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.782790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.782925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.783035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.783345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.783644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.783873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.783997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.784177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.784440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.784735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.784873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.785020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.785282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.785548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.785786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.785923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.021 qpair failed and we were unable to recover it. 00:27:07.021 [2024-11-20 12:54:39.786047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.021 [2024-11-20 12:54:39.786169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.786301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.786595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.786846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.786999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.787117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.787247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.787272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.787364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.787457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.787482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.787624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.787754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.787782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.787902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.788237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.788577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.788813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.788936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.789060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.789342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.789585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.789818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.789956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.790082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.790365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.790572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.790816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.790977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.791129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.791344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.791581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.791863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.791987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.792129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.792330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.792651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.792794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.792896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.793008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.793036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.793184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.793273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.022 [2024-11-20 12:54:39.793298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.022 qpair failed and we were unable to recover it. 00:27:07.022 [2024-11-20 12:54:39.793386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.793506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.793535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.793638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.793732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.793759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.793902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.794207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.794480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.794786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.794954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.795066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.795326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.795590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.795839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.795983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.796110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.796267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.796300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.796434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.796537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.796566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.796714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.796837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.796862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.796959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.797210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.797497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.797708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.797845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.797947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.798218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.798539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.798778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.798930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.799049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.799203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.799229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.799387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.799486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.799513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.799689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.799781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.799806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.799960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.800186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.800489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.800749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.023 [2024-11-20 12:54:39.800901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.023 qpair failed and we were unable to recover it. 00:27:07.023 [2024-11-20 12:54:39.801038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.801300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.801571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.801815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.801979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.802093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.802196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.802225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.802346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.802441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.802466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.802582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.802729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.802756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.802918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.803210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.803502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.803791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.803991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.804142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.804234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.804259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.804364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.804475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.804502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.804642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.804749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.804778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.804944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.805196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.805493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.805770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.805948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.806162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.806417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.806646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.806886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.806976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.807099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.807476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.807721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.807859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.807966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.808091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.808120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.808262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.808399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.808426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.024 qpair failed and we were unable to recover it. 00:27:07.024 [2024-11-20 12:54:39.808580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.024 [2024-11-20 12:54:39.808779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.808822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.808990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.809245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.809456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.809687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.809814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.809957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.810084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.810111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.810243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.810352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.810380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.810585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.810710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.810737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.810907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.811206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.811576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.811844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.811985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.812152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.812349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.812392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.812560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.812657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.812686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.812829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.812928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.812953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.813054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.813304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.813549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.813778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.813923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.814050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.814226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.814254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.814401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.814522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.814547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.814651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.814785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.814814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.025 qpair failed and we were unable to recover it. 00:27:07.025 [2024-11-20 12:54:39.814925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.025 [2024-11-20 12:54:39.815065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.815253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.815516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.815783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.815951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.816101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.816252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.816278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.816463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.816555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.816580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.816668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.816816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.816844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.816992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.817149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.817192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.817319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.817445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.817472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.817644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.817767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.817796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.817932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.818188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.818461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.818761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.818910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.819061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.819206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.819231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.819357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.819489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.819517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.819667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.819784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.819809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.819949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.820236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.820557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.820777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.820909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.821064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.821169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.821195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.821313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.821408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.821435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.821582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.821708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.821737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.821876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.822221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.822509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.822841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.822988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.823114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.823207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.026 [2024-11-20 12:54:39.823233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.026 qpair failed and we were unable to recover it. 00:27:07.026 [2024-11-20 12:54:39.823352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.823519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.823545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.823664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.823804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.823832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.823940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.824175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.824449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.824760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.824918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.825060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.825339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.825616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.825858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.825997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.826109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.826205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.826233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.826378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.826463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.826488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.826629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.826756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.826783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.826883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.827164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.827429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.827734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.827895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.828041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.828180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.828206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.828365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.828486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.828512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.828657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.828762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.828792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.828950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.829198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.829431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.829703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.829848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.829958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.830225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.830514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.830816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.830967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.027 qpair failed and we were unable to recover it. 00:27:07.027 [2024-11-20 12:54:39.831064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.027 [2024-11-20 12:54:39.831188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.831213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.831311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.831392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.831417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.831560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.831716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.831742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.831859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.831976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.832102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.832378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.832608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.832803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.832976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.833196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.833403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.833645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.833870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.833988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.834179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.834403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.834694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.834889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.835021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.835270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.835493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.835768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.835901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.836039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.836283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.836635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.836849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.836992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.837114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.837345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.837568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.837854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.837982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.838126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.838281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.838310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.028 qpair failed and we were unable to recover it. 00:27:07.028 [2024-11-20 12:54:39.838412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.028 [2024-11-20 12:54:39.838504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.838529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.838643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.838777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.838805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.838912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.839180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.839476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.839786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.839909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.840053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.840177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.840203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.840348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.840476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.840505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.840599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.840710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.840751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.840902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.841228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.841435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.841681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.841799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.841927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.842216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.842454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.842753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.842890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.842994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.843234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.843474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.843778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.843921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.844014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.844266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.844506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.844783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.844900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.845004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.845298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.845568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.029 qpair failed and we were unable to recover it. 00:27:07.029 [2024-11-20 12:54:39.845813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.029 [2024-11-20 12:54:39.845951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.846084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.846347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.846629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.846869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.846995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.847135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.847235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.847261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.847374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.847483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.847508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.847629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.847791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.847819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.847936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.848163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.848402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.848663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.848811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.848949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.849215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.849458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.849703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.849899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.850031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.850334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.850592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.850829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.850969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.851059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.851200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.851225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.851364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.851516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.851541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.851657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.851794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.851822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.851941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.852036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.852062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.852223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.852362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.852390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.030 qpair failed and we were unable to recover it. 00:27:07.030 [2024-11-20 12:54:39.852536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.030 [2024-11-20 12:54:39.852630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.852654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.852772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.852870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.852897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.853009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.853248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.853486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.853703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.853872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.853977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.854126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.854153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.854310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.854427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.854452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.854570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.854694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.854722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.854892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.855169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.855419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.855621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.855789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.855938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.856243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.856469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.856750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.856869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.856998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.857302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.857546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.857813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.857952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.858050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.858162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.858191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.858315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.858430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.858456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.858629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.858732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.858760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.858857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.859183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.859394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.859649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.859788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.031 [2024-11-20 12:54:39.859887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.860020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.031 [2024-11-20 12:54:39.860048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.031 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.860206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.860331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.860357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.860454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.860552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.860578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.860702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.860818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.860844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.860974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.861208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.861495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.861760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.861923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.862088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.862372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.862623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.862902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.862993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.863121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.863460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.863701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.863848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.863968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.864196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.864470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.864745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.864887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.865045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.865237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.865263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.865433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.865616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.865664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.865777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.865897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.865923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.866019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.866317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.866559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.866804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.866933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.867105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.867375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.867596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.032 qpair failed and we were unable to recover it. 00:27:07.032 [2024-11-20 12:54:39.867848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.032 [2024-11-20 12:54:39.867983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.868129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.868386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.868628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.868788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.868925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.869187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.869459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.869734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.869883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.869995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.870137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.870162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.870287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.870464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.870493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.870606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.870763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.870789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.870900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.871208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.871462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.871711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.871868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.871994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.872259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.872513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.872811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.872967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.873061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.873314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.873630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.873863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.873975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.874123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.874259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.874286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.874451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.874540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.874568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.874733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.874824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.874849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.874991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.875129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.875157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.875264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.875365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.875393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.875565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.875688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.033 [2024-11-20 12:54:39.875713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.033 qpair failed and we were unable to recover it. 00:27:07.033 [2024-11-20 12:54:39.875873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.875989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.876153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.876428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.876700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.876883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.876978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.877254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.877477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.877747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.877915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.878060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.878213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.878238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.878375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.878555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.878581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.878706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.878841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.878869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.878979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.879219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.879480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.879730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.879879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.879993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.880221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.880498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.880758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.880895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.881004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.881275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.881521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.881795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.881989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.882111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.882246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.882271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.882416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.882527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.882557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.882737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.882830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.882856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.034 qpair failed and we were unable to recover it. 00:27:07.034 [2024-11-20 12:54:39.883009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.883157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.034 [2024-11-20 12:54:39.883202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.883335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.883446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.883474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.883605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.883782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.883806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.883963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.884275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.884569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.884846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.884990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.885141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.885264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.885289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.885772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.885890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.885918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.886058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.886302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.886580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.886886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.886981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.887105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.887385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.887664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.887816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.887935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.888186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.888483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.888749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.888886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.889033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.889364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.889580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.889872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.889979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.890167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.890426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.890675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.890812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.035 qpair failed and we were unable to recover it. 00:27:07.035 [2024-11-20 12:54:39.890956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.035 [2024-11-20 12:54:39.891051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.891203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.891494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.891782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.891930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.892032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.892281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.892565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.892839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.892991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.893098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.893209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.893236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.893343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.893467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.893493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.893635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.893809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.893834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.893948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.894230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.894444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.894719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.894906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.895005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.895256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.895529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.895833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.895947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.896126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.896234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.896262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.896425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.896530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.896559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.896708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.896798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.896824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.896931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.897193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.897514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.897780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.897905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.898032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.898202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.898231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.898347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.898483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.898508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.898647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.898784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.036 [2024-11-20 12:54:39.898812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.036 qpair failed and we were unable to recover it. 00:27:07.036 [2024-11-20 12:54:39.898953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.899237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.899523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.899859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.899994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.900156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.900393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.900663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.900833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.900956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.901274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.901554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.901770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.901911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.902006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.902263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.902574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.902835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.902995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.903167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.903430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.903646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.903769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.903857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.904186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.904500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.904762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.904918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.905141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.905265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.905290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.905432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.905530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.905559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.905687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.905787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.905830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.905952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.906090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.906117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.906242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.906446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.906474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.906636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.906745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.906775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.037 qpair failed and we were unable to recover it. 00:27:07.037 [2024-11-20 12:54:39.906922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.907015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.037 [2024-11-20 12:54:39.907040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.907189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.907351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.907379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.907487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.907597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.907624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.907752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.907853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.907879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.907980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.908105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.908149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.908240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.908385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.908413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.908584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.908785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.908813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.908964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.909222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.909514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.909807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.909925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.910075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.910231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.910256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.910385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.910525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.910554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.910703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.910865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.910910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.911049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.911194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.911220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.911326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.911490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.911533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.911649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.911806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.911850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.911969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.912230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.912506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.912752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.912898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.912992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.913253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.913583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.913860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.913984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.914080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.914277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.914303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.914435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.914567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.914592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.914676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.914824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.914849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.914972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.915106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.038 [2024-11-20 12:54:39.915132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.038 qpair failed and we were unable to recover it. 00:27:07.038 [2024-11-20 12:54:39.915230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.915325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.915351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.915500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.915596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.915622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.915714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.915814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.915839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.915961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.916272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.916522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.916741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.916869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.917001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.917301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.917506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.917812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.917936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.918035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.918294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.918583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.918807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.918918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.919041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.919288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.919532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.919764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.919931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.920027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.920146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.920172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.920300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.920443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.920471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.920622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.920753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.920781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.920949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.921089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.921114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.921216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.921390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.921424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.921620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.921816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.039 [2024-11-20 12:54:39.921844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.039 qpair failed and we were unable to recover it. 00:27:07.039 [2024-11-20 12:54:39.921951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.922114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.922157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.922247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.922366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.922394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.922665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.922818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.922846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.922941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.923210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.923475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.923816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.923951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.924087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.924204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.924229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.924319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.924459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.924486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.924594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.924744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.924787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.924886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.925175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.925420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.925642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.925769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.925878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.926169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.926409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.926674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.926807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.926939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.927221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.927487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.927815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.927960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.928085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.928208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.928234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.928326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.928475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.928502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.928664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.928794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.928821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.928931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.929234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.929479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.040 [2024-11-20 12:54:39.929791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.040 [2024-11-20 12:54:39.929953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.040 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.930116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.930239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.930263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.930369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.930494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.930522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.930619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.930754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.930782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.930943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.931260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.931478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.931770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.931974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.932101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.932205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.932230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.932330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.932481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.932508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.932667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.932794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.932821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.932950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.933223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.933454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.933799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.933958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.934089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.934210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.934234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.934324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.934447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.934472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.934610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.934751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.934779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.934893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.935184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.935475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.935786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.935943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.936060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.936171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.936196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.936318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.936456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.936484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.936593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.936731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.936759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.936891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.937166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.937411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.937702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.937858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.041 qpair failed and we were unable to recover it. 00:27:07.041 [2024-11-20 12:54:39.937960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.938086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.041 [2024-11-20 12:54:39.938130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.938248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.938417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.938444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.938608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.938700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.938725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.938846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.938980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.939131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.939397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.939719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.939862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.939959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.940217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.940463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.940753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.940914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.941042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.941319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.941557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.941838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.941982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.942079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.942249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.942277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.942416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.942592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.942617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.942733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.942848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.942873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.942963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.943254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.943535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.943861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.943980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.944140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.944417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.944778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.944928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.945060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.945342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.945582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.945820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.945980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.042 qpair failed and we were unable to recover it. 00:27:07.042 [2024-11-20 12:54:39.946134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.042 [2024-11-20 12:54:39.946293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.946336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.946488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.946611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.946636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.946725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.946874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.946899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.947060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.947275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.947573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.947900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.947996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.948115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.948315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.948642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.948787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.948952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.949201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.949424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.949743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.949877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.950009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.950303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.950518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.950748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.950879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.951026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.951179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.951204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.951351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.951488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.951515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.951696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.951816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.951841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.951965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.952114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.952140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.952319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.952450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.952478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.952606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.952734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.952762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.952918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.953178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.953459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.953734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.953848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.953950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.954041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.043 [2024-11-20 12:54:39.954066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.043 qpair failed and we were unable to recover it. 00:27:07.043 [2024-11-20 12:54:39.954223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.954319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.954347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.954468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.954553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.954578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.954703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.954800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.954824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.954920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.955235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.955467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.955703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.955830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.955964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.956091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.956116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.956234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.956371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.956399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.956561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.956694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.956721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.956830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.957153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.957395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.957649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.957806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.957977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.958263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.958559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.958850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.958985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.959142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.959465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.959732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.959859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.959986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.960299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.960569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.960811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.044 [2024-11-20 12:54:39.960951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.044 qpair failed and we were unable to recover it. 00:27:07.044 [2024-11-20 12:54:39.961119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.961219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.961243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.961359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.961458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.961483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.961595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.961712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.961737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.961894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.962221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.962544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.962809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.962956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.963095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.963232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.963259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.963392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.963546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.963574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.963685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.963810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.963834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.964015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.964249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.964576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.964893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.964993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.965137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.965406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.965703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.965875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.966017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.966296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.966532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.966827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.966992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.967101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.967221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.967249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.967386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.967527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.967554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.967690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.967813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.967838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.967987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.968275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.968536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.968827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.968965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.045 [2024-11-20 12:54:39.969130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.969257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.045 [2024-11-20 12:54:39.969282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.045 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.969370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.969555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.969579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.969699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.969831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.969859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.969954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.970243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.970454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.970693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.970869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.970978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.971279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.971584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.971826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.971998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.972147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.972437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.972742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.972865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.972989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.973288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.973599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.973902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.973995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.974124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.974385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.974672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.974789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.974929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.975233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.975455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.975693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.975843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.975983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.976094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.976121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.976212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.976332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.976357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.046 qpair failed and we were unable to recover it. 00:27:07.046 [2024-11-20 12:54:39.976452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.976561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.046 [2024-11-20 12:54:39.976588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.976694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.976784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.976811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.976957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.977254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.977510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.977790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.977909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.978019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.978180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.978208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.978371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.978494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.978520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.978641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.978791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.978815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.978964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.979245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.979493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.979703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.979906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.980044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.980352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.980590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.980837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.980994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.981150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.981424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.981713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.981850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.981970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.982250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.982554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.982859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.982993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.983018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.983155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.983290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.983318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.047 qpair failed and we were unable to recover it. 00:27:07.047 [2024-11-20 12:54:39.983479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.983573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.047 [2024-11-20 12:54:39.983600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.983719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.983842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.983866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.983989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.984135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.984163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.984302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.984409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.984452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.984543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.984668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.984693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.984831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.985171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.985513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.985814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.985951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.986113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.986240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.986267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.986409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.986556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.986596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.986725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.986849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.986876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.986971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.987290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.987522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.987849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.987982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.988129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.988447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.988745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.988893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.989013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.989257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.989488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.989788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.989927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.990057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.990158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.990183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.990335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.990450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.990478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.990625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.990747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.990772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.048 qpair failed and we were unable to recover it. 00:27:07.048 [2024-11-20 12:54:39.990908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.991002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.048 [2024-11-20 12:54:39.991029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.991147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.991257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.991286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.991431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.991557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.991582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.991682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.991780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.991806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.991893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.992171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.992475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.992760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.992921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.993067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.993175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.993200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.993323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.993466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.993493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.993637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.993741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.993768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.993906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.994182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.994404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.994710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.994868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.995026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.995150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.995175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.995336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.995466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.995494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.995671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.995766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.995795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.995918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.996224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.996505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.996772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.996936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.997039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.997149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.997177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.049 qpair failed and we were unable to recover it. 00:27:07.049 [2024-11-20 12:54:39.997334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.997455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.049 [2024-11-20 12:54:39.997480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.997620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.997744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.997769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.997923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.998220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.998473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.998770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.998933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.999139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.999308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.999335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.999473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.999597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.999624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:39.999728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.999863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:39.999890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.000065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.000212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.000255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.000393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.000528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.000555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.000689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.000851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.000879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.001047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.001323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.001572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.001885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.001983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.002138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.002363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.002613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.002880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.002983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.003099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.003333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.003686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.003860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.003960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.004201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.004418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.050 qpair failed and we were unable to recover it. 00:27:07.050 [2024-11-20 12:54:40.004643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.050 [2024-11-20 12:54:40.004788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.004933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.005237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.005450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.005758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.005905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.006004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.006284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.006569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.006804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.006928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.007026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.007263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.007511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.007744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.007885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.007987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.008280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.008524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.008796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.008919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.009034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.009289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.009560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.009779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.009953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.010107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.010351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.010595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.010808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.010951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.011057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.011209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.011235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.051 [2024-11-20 12:54:40.011336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.011427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.051 [2024-11-20 12:54:40.011453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.051 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.011602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.011717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.011742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.011865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.011962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.011988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.012087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.012223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.012252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.012350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.012446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.012471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.012592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.012743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.012768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.012896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.013145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.013390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.013656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.013782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.013883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.014187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.014424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.014717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.014851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.014988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.015226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.015505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.015806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.015944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.016096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.016360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.016648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.016862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.016978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.017119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.017361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.052 [2024-11-20 12:54:40.017629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-11-20 12:54:40.017777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.052 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.017903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.018021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.018047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.018187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.018366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.018397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.018623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.018757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.018783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.018885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.019185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.019527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.019803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.019921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.020027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.020158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.020202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.020366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.020529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.020574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.020673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.020791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.020817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.020908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.021211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.021511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.021735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.021858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.021946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.022094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.022137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.022276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.022390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.022417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.022548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.022753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.022781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.022897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.023147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.023387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.023638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.023862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.023982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.024112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.024403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.024693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.024856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.024981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.025083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-11-20 12:54:40.025111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.053 qpair failed and we were unable to recover it. 00:27:07.053 [2024-11-20 12:54:40.025217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.025308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.025333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.025478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.025613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.025641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.025774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.025909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.025936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.026038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.026162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.026188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.026288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.026407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.026431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.026542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.026674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.026701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.026907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.027221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.027510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.027805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.027950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.028125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.028373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.028608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.028862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.028998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.029113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.029206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.029231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.029371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.029502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.029530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.029640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.029770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.029798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.029915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.030204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.030434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.030704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.030873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.054 [2024-11-20 12:54:40.030976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.031141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-11-20 12:54:40.031167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.054 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.031287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.031433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.031459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.031596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.031724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.031752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.031861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.031967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.031995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.032137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.032231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.032255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.032349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.032547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.032572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.032752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.032885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.032912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.033132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.033226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.033250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.033396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.033501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.033529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.033660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.033824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.033851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.033955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.034221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.034486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.034788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.034955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.035127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.035247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.035272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.035364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.035462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.035506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.035609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.035747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.035774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.035909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.036232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.036536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.036848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.036995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.037117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.037255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.037283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.037381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.037476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.037504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.037643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.037735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.037762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.037897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.038027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.038055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.038194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.038328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.038355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.038472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.038595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-11-20 12:54:40.038621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.055 qpair failed and we were unable to recover it. 00:27:07.055 [2024-11-20 12:54:40.038724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.038810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.038835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.038953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.039237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.039482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.039779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.039928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.040053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.040309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.040613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.040882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.040994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.041132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.041400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.041680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.041804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.041902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.042063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.042097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.042239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.042372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.042401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.042539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.042687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.042712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.042886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.043153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.043402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.043698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.043838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.043933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.044187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.044417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.044640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.044768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.044891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.045225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.045526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.045795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.045937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.056 qpair failed and we were unable to recover it. 00:27:07.056 [2024-11-20 12:54:40.046130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.046220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-11-20 12:54:40.046245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.046361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.046529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.046557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.046697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.046820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.046846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.047018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.047275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.047506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.047706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.047878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.048023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.048296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.048613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.048884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.048985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.049162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.049419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.049681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.049869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.049989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.050269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.050529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.050848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.050992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.051132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.051240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.051268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.051395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.051566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.051591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.051690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.051784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.051809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.051949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.052217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.052530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.052804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.052940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.053050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.053207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.053232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.053352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.053505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.053530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.053662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.053762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.053789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.057 qpair failed and we were unable to recover it. 00:27:07.057 [2024-11-20 12:54:40.053973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-11-20 12:54:40.054080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.054230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.054429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.054717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.054850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.054998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.055217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.055536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.055799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.055946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.056084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.056236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.056260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.056378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.056510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.056538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.056681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.056799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.056825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.056978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.057242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.057507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.057781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.057920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.058054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.058195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.058224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.058364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.058485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.058509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.058630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.058762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.058789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.058928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.059160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.059406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.059644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.059780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.059938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.060239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.060475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.060751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.060907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.061026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.061138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.061166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.058 qpair failed and we were unable to recover it. 00:27:07.058 [2024-11-20 12:54:40.061281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-11-20 12:54:40.061375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.061402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.061543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.061666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.061691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.061810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.061923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.061947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.062050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.062327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.062588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.062861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.062995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.063108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.063239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.063265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.063401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.063542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.063567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.063684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.063829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.063853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.063954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.064214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.064541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.064816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.064958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.065045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.065295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.065517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.065780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.065912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.066033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.066171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.066198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.066330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.066454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.066479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.066609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.066723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.066751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.066904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.067188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.067424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.059 qpair failed and we were unable to recover it. 00:27:07.059 [2024-11-20 12:54:40.067681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.059 [2024-11-20 12:54:40.067814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.067841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.067987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.068206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.068458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.068755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.068897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.069001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.069269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.069527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.069782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.069902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.070027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.070187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.070212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.070332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.070453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.070479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.070648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.070778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.070805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.070931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.071216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.071445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.071703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.071851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.071969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.072244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.072479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.072820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.072959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.073054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.073180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.073206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.073300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.073433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.073460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.073644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.073782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.073814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.073948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.074233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.074550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.074850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.074973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.060 [2024-11-20 12:54:40.075091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.075179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.060 [2024-11-20 12:54:40.075204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.060 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.075301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.075386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.075410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.075551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.075647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.075675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.075806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.075900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.075927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.076062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.076208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.076234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.076324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.076474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.076499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.076641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.076770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.076797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.076941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.077210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.077493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.077846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.077982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.078131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.078420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.078701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.078821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.078938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.079224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.079524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.079776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.079916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.080063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.080197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.080222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.080314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.080404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.080428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.080569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.080701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.080728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.080867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.081182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.081428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.081696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.081896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.082025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.082128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.082154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.082254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.082389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.082417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.061 [2024-11-20 12:54:40.082559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.082679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.061 [2024-11-20 12:54:40.082704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.061 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.082852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.082965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.082989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.083116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.083346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.083616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.083863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.083994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.084139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.084269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.084295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.084412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.084502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.084528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.084650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.084774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.084798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.084902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.085203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.085414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.085680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.085810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.085929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.086199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.086442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.086755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.086899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.087013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.087293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.087554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.087833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.087982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.088144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.088461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.088794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.088936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.089084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.089194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.089219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.089342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.089435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.089460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.062 [2024-11-20 12:54:40.089549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.089695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.062 [2024-11-20 12:54:40.089719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.062 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.089891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.090178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.090455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.090736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.090880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.091017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.091312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.091603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.091842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.091988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.092129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.092261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.092288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.092418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.092555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.092582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.092722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.092879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.092906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.093043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.093291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.093551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.093804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.093927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.094056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.094276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.094559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.094792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.094983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.095129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.095392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.095648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.095792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.095912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.096025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.096050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.096176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.096331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.096372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.063 qpair failed and we were unable to recover it. 00:27:07.063 [2024-11-20 12:54:40.096550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.096672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.063 [2024-11-20 12:54:40.096697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.096820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.096989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.097129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.097432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.097708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.097870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.098005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.098248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.098538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.098838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.098989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.099137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.099440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.099690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.064 [2024-11-20 12:54:40.099839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.064 qpair failed and we were unable to recover it. 00:27:07.064 [2024-11-20 12:54:40.099981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.100251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.100511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.100716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.100863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.100985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.101226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.101513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.101779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.101932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.102018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.102288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.102588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.102867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.102977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.103124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.103256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.103299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.103417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.103519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.103561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.065 [2024-11-20 12:54:40.103666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.103807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.065 [2024-11-20 12:54:40.103831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.065 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.103943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.104043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.104077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.104248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.104372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.104397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.104573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.104736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.104764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.104880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.105191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.105461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.105805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.105955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.106059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.106315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.106595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.106890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.106980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.107106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.107349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.107601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.107859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.107992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.108144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.108377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.108703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.108880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.109019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.109150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.109178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.347 [2024-11-20 12:54:40.109323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.109409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.347 [2024-11-20 12:54:40.109434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.347 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.109560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.109708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.109733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.109859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.109962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.109989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.110126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.110347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.110630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.110840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.110961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.111114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.111282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.111310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.111453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.111569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.111595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.111746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.111835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.111859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.111980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.112144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.112170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.112317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.112429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.112456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.112589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.112729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.112756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.113214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.113488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.113773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.113933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.114096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.114357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.114608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.114879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.114990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.115115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.115213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.115238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.115389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.115511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.115537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.115649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.115757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.115782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.115879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.116212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.116453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.348 qpair failed and we were unable to recover it. 00:27:07.348 [2024-11-20 12:54:40.116727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.348 [2024-11-20 12:54:40.116852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.116968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.117228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.117518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.117810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.117973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.118083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.118219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.118246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.118403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.118525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.118550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.118693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.118822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.118855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.119017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.119153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.119178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.119274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.119404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.119432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.119576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.119696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.119721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.119892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.120034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.120062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.120214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.120338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.120380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.120518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.120650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.120690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.120869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.121176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.121501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.121746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.121901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.122067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.122334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.122564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.122894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.122990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.123154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.123449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.123663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.123859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.123975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.124253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.124508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.349 [2024-11-20 12:54:40.124804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.349 [2024-11-20 12:54:40.124972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.349 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.125116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.125246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.125271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.125395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.125487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.125512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.125658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.125786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.125813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.125924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.126197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.126455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.126711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.126900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.127048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.127198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.127226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.127389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.127495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.127522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.127635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.127762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.127787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.127893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.128217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.128476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.128775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.128915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.129039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.129208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.129236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.129366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.129494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.129522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.129650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.129804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.129829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.129949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.130207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.130479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.130763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.130912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.131034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.131262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.131517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.131801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.131967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.132115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.132238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.350 [2024-11-20 12:54:40.132264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.350 qpair failed and we were unable to recover it. 00:27:07.350 [2024-11-20 12:54:40.132368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.132458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.132483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.132628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.132770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.132794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.132918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.133160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.133493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.133813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.133957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.134051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.134174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.134200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.134316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.134440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.134465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.134684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.134827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.134852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.134972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.135056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.135086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.135264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.135394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.135421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.135626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.135748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.135773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.135890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.136175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.136441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.136764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.136878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.136967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.137290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.137541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.137826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.137946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.138096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.138296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.138337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.138439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.138604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.138629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.138775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.138914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.138942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.139108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.139206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.139231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.139392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.139559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.139586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.139712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.139807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.139834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.139986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.140081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.351 [2024-11-20 12:54:40.140106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.351 qpair failed and we were unable to recover it. 00:27:07.351 [2024-11-20 12:54:40.140267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.140359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.140384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.140505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.140606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.140647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.140751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.140877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.140902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.141025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.141326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.141584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.141837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.141988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.142164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.142293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.142321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.142482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.142573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.142599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.142731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.142828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.142855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.142984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.143269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.143515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.143748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.143855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.143976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.144075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.144119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.144252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.144420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.144447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.144564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.144711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.144735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.144858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.145136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.145451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.145781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.145891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.146010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.146109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.146135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.352 qpair failed and we were unable to recover it. 00:27:07.352 [2024-11-20 12:54:40.146285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.146426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.352 [2024-11-20 12:54:40.146454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.146628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.146751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.146776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.146902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.147275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.147535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.147797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.147961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.148083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.148296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.148625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.148877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.148989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.149174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.149467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.149758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.149879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.150032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.150134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.150159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.150317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.150408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.150433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.150553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.150708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.150735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.150867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.151145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.151454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.151745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.151910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.152039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.152192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.152217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.152340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.152433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.152460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.152582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.152796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.152825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.152997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.153238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.153568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.153812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.153968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.353 qpair failed and we were unable to recover it. 00:27:07.353 [2024-11-20 12:54:40.154117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.353 [2024-11-20 12:54:40.154216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.154244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.154358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.154457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.154485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.154616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.154820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.154847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.154995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.155240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.155506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.155804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.155923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.156038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.156145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.156170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.156291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.156390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.156432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.156574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.156736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.156764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.156913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.157130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.157397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.157759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.157915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.158049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.158156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.158184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.158325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.158458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.158483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.158656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.158758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.158786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.158890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.159173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.159478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.159686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.159858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.159953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.160172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.160450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.160693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.160866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.160997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.161267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.161534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.354 qpair failed and we were unable to recover it. 00:27:07.354 [2024-11-20 12:54:40.161857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.161992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.354 [2024-11-20 12:54:40.162020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.162191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.162286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.162315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.162428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.162551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.162576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.162697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.162823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.162848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.163040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.163311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.163572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.163838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.163961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.164109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.164241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.164270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.164426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.164519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.164543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.164675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.164778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.164818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.164965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.165088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.165118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.165267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.165395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.165423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.165569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.165688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.165714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.165866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.166131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.166391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.166670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.166817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.166956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.167271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.167526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.167797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.167954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.168100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.168244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.168269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.168357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.168477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.168502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.168701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.168848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.168873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.169022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.169166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.169194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.355 [2024-11-20 12:54:40.169302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.169474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.355 [2024-11-20 12:54:40.169499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.355 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.169625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.169775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.169799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.169981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.170114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.170141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.170357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.170489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.170518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.170618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.170781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.170806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.170894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.171232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.171540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.171821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.171978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.172109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.172354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.172598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.172860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.172995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.173171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.173385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.173654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.173818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.173927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.174287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.174592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.174875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.174995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.175120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.175241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.175269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.175412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.175532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.175557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.175675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.175808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.175836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.175967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.176100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.176128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.176299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.176404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.176431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.176572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.176664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.356 [2024-11-20 12:54:40.176689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.356 qpair failed and we were unable to recover it. 00:27:07.356 [2024-11-20 12:54:40.176859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.177131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.177376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.177719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.177861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.177978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.178250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.178522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.178774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.178912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.179048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.179193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.179221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.179353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.179564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.179592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.179724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.179819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.179850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.179994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.180296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.180553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.180835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.180970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.181090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.181307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.181578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.181837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.181986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.182216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.182505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.182806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.182935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.183084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.183235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.183260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.183378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.183475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.183500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.357 [2024-11-20 12:54:40.183585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.183681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.357 [2024-11-20 12:54:40.183706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.357 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.183828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.183944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.183971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.184083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.184184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.184227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.184375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.184492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.184517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.184638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.184795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.184823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.184956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.185199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.185471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.185755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.185916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.186049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.186298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.186549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.186830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.186983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.187110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.187355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.187630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.187811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.187958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.188230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.188487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.188753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.188901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.189036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.189337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.189583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.189859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.189975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.190062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.190242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.190269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.190376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.190520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.190545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.190639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.190783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.190808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.190928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.191050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.191090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.191249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.191345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.191373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.358 qpair failed and we were unable to recover it. 00:27:07.358 [2024-11-20 12:54:40.191576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.358 [2024-11-20 12:54:40.191722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.191765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.191894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.192232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.192467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.192760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.192885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.192985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.193290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.193623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.193839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.193962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.194101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.194243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.194270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.194382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.194503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.194527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.194629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.194773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.194798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.194910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.195235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.195509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.195778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.195939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.196042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.196187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.196215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.196337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.196472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.196496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.196616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.196747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.196772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.196927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.197203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.197517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.197836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.197948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.198085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.198244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.198269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.198429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.198573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.198600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.198762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.198914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.198938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.199029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.199167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.199192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.359 [2024-11-20 12:54:40.199327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.199431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.359 [2024-11-20 12:54:40.199458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.359 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.199580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.199673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.199698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.199804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.199894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.199920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.200081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.200240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.200264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.200389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.200525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.200552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.200705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.200821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.200845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.200976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.201274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.201490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.201723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.201891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.201992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.202128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.202156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.202276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.202365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.202390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.202529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.202704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.202739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.202886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.203169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.203427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.203710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.203878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.204049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.204239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.204269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.204396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.204528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.204562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.204703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.204822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.204847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.205001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.205142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.205187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.205297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.205424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.205450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.205577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.205705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.205735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.205883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.206172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.206447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.206796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.206984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.207144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.207280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.207313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.207489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.207660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.207687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.360 qpair failed and we were unable to recover it. 00:27:07.360 [2024-11-20 12:54:40.207825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.360 [2024-11-20 12:54:40.207966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.207993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.208142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.208235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.208260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.208364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.208486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.208511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.208644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.208758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.208800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.208925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.209234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.209453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.209678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.209835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.209970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.210248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.210551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.210818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.210959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.211083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.211183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.211207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.211306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.211445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.211477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.211601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.211690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.211715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.211854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.212136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.212369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.212662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.212900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.212999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.213159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.213415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.213675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.213848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.361 qpair failed and we were unable to recover it. 00:27:07.361 [2024-11-20 12:54:40.213966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.214075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.361 [2024-11-20 12:54:40.214100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.214192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.214308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.214333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.214469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.214595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.214619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.214724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.214813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.214840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.214977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.215240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.215490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.215793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.215937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.216049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.216202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.216227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.216378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.216507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.216534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.216679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.216779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.216804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.216935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.217184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.217512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.217790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.217920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.218066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.218164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.218188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.218289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.218444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.218468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.218586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.218713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.218739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.218877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.219153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.219402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.219656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.219819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.219979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.220226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.220531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.220823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.220946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.221041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.221331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.221598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.362 qpair failed and we were unable to recover it. 00:27:07.362 [2024-11-20 12:54:40.221901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.362 [2024-11-20 12:54:40.221999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.222204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.222450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.222663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.222863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.222990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.223257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.223517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.223784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.223898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.224020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.224236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.224490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.224733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.224872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.225008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.225263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.225581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.225848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.225982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.226168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.226480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.226746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.226891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.227004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.227270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.227605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.227862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.227975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.228093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.228240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.228265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.228382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.228540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.228567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.228689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.228780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.228805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.228928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.229018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.229044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.363 qpair failed and we were unable to recover it. 00:27:07.363 [2024-11-20 12:54:40.229177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.363 [2024-11-20 12:54:40.229269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.229294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.229411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.229530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.229555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.229673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.229830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.229858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.229968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.230215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.230563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.230811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.230976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.231088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.231222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.231247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.231405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.231501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.231544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.231635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.231757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.231782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.231912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.232230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.232470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.232786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.232967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.233127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.233266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.233293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.233421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.233512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.233536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.233711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.233809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.233851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.233967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.234268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.234535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.234805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.234918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.235035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.235294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.235603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.235858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.235996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.236121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.236222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.236249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.236349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.236496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.236522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.236670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.236762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.236786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.236934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.237031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.237079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.364 qpair failed and we were unable to recover it. 00:27:07.364 [2024-11-20 12:54:40.237202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.364 [2024-11-20 12:54:40.237327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.237352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.237482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.237620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.237644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.237770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.237860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.237885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.238013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.238183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.238209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.238358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.238508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.238535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.238690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.238814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.238840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.238933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.239223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.239448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.239702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.239865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.239983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.240251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.240590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.240804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.240947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.241094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.241192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.241217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.241408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.241507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.241532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.241677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.241771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.241798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.241922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.242226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.242529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.242821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.242956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.243088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.243283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.243308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.243405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.243526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.243550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.243673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.243814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.243842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.243947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.244223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.244491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.365 [2024-11-20 12:54:40.244743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.365 [2024-11-20 12:54:40.244930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.365 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.245079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.245226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.245253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.245409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.245532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.245556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.245705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.245797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.245821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.245966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.246265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.246508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.246793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.246938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.247038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.247169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.247212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.247358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.247455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.247480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.247569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.247753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.247778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.247907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.248201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.248445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.248666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.248796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.248967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.249058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.249100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.249264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.249383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.249408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.249545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.249691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.249716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.249866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.250186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.250412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.250713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.250882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.251016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.251147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.251175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.251296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.251414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.251439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.366 [2024-11-20 12:54:40.251527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.251686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.366 [2024-11-20 12:54:40.251711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.366 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.251838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.251955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.251980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.252117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.252252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.252279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.252425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.252546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.252571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.252687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.252783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.252810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.252949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.253207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.253464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.253708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.253830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.253945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.254199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.254510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.254808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.254983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.255134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.255274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.255302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.255451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.255541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.255566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.255689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.255804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.255829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.255972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.256238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.256538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.256792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.256909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.257043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.257327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.257563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.257793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.257935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.258096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.258265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.258290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.258387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.258524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.258551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.258714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.258810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.258838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.258948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.259075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.259102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.367 qpair failed and we were unable to recover it. 00:27:07.367 [2024-11-20 12:54:40.259223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.259349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.367 [2024-11-20 12:54:40.259376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.259523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.259679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.259704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.259863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.260183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.260437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.260732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.260880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.261011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.261186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.261212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.261335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.261449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.261474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.261616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.261746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.261774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.261879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.262152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.262447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.262686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.262820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.262970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.263212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.263463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.263742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.263873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.264005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.264258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.264547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.264784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.264984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.265160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.265315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.265345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.265441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.265567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.265594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.265700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.265794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.265825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.265944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.266225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.266505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.368 [2024-11-20 12:54:40.266794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.368 [2024-11-20 12:54:40.266949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.368 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.267082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.267207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.267234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.267367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.267574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.267631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.267785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.267915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.267942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.268076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.268186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.268213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.268319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.268441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.268467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.268589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.268696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.268723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.268864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.269196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.269484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.269777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.269940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.270049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.270212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.270239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.270406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.270518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.270544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.270642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.270765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.270809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.270993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.271090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.271117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.271212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.271344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.271398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.271559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.271768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.271812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.271985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.272118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.272167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.272271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.272369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.272411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.272580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.272743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.272773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.272926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.273084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.273122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.273217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.273320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.273363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.273504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.273669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.273702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.273843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.274170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.274408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.274649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.274792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.369 [2024-11-20 12:54:40.274895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.275009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.369 [2024-11-20 12:54:40.275039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.369 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.275168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.275276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.275303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.275422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.275543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.275569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.275696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.275819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.275850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.275945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.276079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.276106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.276237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.276334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.276360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.276458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.276606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.276639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.276806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.277016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.277046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.277132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c52600 (9): Bad file descriptor 00:27:07.370 [2024-11-20 12:54:40.277329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.277504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.277532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.277671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.277785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.277811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.277931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.278197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.278444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.278742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.278893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.278991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.279322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.279595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.279822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.279993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.280117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.280215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.280241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.280329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.280437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.280462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.280588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.280789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.280815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.280943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.281197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.281413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.281680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.281812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.281908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.282034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.282060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.282180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.282285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.282315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.370 qpair failed and we were unable to recover it. 00:27:07.370 [2024-11-20 12:54:40.282432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.282571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.370 [2024-11-20 12:54:40.282603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.282711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.282820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.282849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.282993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.283201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.283228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.283433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.283594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.283626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.283755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.283877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.283904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.284035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.284273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.284535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.284862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.284996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.285024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.285165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.285258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.285285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.285468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.285617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.285647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.285842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.285973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.286003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.286187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.286314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.286357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.286508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.286686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.286715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.286913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.287117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.287144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.287299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.287515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.287542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.287758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.287896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.287930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.288081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.288180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.288207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.288332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.288425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.288450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.288568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.288683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.288717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.288837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.289055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.289126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.289259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.289388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.289415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.289545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.289652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.289683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.289859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.290000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.290029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.290171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.290278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.290304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.371 qpair failed and we were unable to recover it. 00:27:07.371 [2024-11-20 12:54:40.290424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.290527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.371 [2024-11-20 12:54:40.290571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.290746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.290882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.290911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.291052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.291202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.291231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.291363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.291472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.291500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.291618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.291748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.291778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.291985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.292163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.292195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.292295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.292421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.292447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.292561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.292730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.292760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.292905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.293047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.293084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.293216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.293396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.293427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.293605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.293737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.293766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.293900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.294029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.294057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.294197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.294366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.294398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.294521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.294694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.294729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.294859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.295208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.295515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.295818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.295995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.296162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.296291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.296323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.296462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.296595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.296628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.296774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.296873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.296901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.297035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.297179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.297208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.297351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.297444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.297470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.297587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.297737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.297770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.297910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.298250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.298564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.372 qpair failed and we were unable to recover it. 00:27:07.372 [2024-11-20 12:54:40.298839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.372 [2024-11-20 12:54:40.298990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.299129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.299254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.299282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.299438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.299581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.299607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.299755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.299906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.299935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.300089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.300215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.300241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.300421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.300546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.300574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.300693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.300822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.300853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.300973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.301302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.301597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.301869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.301998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.302159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.302387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.302650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.302825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.302999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.303123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.303176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.303321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.303514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.303552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.303789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.303952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.303990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.304157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.304289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.304344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.304493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.304628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.304657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.304784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.304932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.304957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.305106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.305196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.305221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.305318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.305474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.305503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.305621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.305748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.305773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.305909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.306216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.306481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.306750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.306941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.307043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.307167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.307201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.373 qpair failed and we were unable to recover it. 00:27:07.373 [2024-11-20 12:54:40.307352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.373 [2024-11-20 12:54:40.307467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.307492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.307610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.307783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.307809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.307942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.308280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.308561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.308790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.308963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.309085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.309326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.309594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.309864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.309991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.310190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.310437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.310726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.310851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.310966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.311236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.311515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.311765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.311927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.312060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.312344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.312558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.312849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.312988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.313146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.313396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.313740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.313879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.314020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.314277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.314535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.314762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.314907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.374 qpair failed and we were unable to recover it. 00:27:07.374 [2024-11-20 12:54:40.315007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.315137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.374 [2024-11-20 12:54:40.315165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.315282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.315403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.315427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.315528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.315626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.315652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.315782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.315902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.315928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.316053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.316346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.316633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.316896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.316996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.317152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.317489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.317737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.317910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.318058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.318198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.318224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.318325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.318489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.318516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.318686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.318793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.318822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.318989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.319352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.319591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.319836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.319983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.320083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.320222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.320249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.320393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.320500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.320527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.320641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.320767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.320793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.320925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.321269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.321520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.321797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.321917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.322028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.322156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.375 [2024-11-20 12:54:40.322185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.375 qpair failed and we were unable to recover it. 00:27:07.375 [2024-11-20 12:54:40.322292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.322414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.322440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.322554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.322688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.322715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.322860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.322973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.323134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.323444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.323759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.323913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.324054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.324173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.324201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.324330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.324456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.324485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.324616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.324711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.324739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.324878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.325252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.325557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.325866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.325981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.326095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.326367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.326642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.326853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.326977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.327187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.327462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.327722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.327889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.327991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.328193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.328235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.328389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.328538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.328563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.328679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.328813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.328841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.328946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.329052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.329087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.329233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.329446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.329474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.329677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.329783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.329810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.376 qpair failed and we were unable to recover it. 00:27:07.376 [2024-11-20 12:54:40.329929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.376 [2024-11-20 12:54:40.330111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.330262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.330484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.330783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.330921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.331048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.331287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.331500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.331765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.331879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.332004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.332176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.332206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.332414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.332556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.332582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.332703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.332829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.332855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.332945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.333087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.333115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.333274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.333485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.333513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.333663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.333785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.333812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.333981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.334143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.334173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.334313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.334443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.334471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.334673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.334772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.334798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.335016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.335178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.335206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.335312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.335452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.335480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.335594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.335743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.335768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.335910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.336220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.336489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.336742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.336882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.336988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.337273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.337491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.377 qpair failed and we were unable to recover it. 00:27:07.377 [2024-11-20 12:54:40.337838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.377 [2024-11-20 12:54:40.337996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.338178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.338486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.338769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.338948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.339076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.339173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.339198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.339359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.339488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.339516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.339652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.339759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.339787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.339936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.340193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.340492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.340727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.340903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.341083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.341220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.341248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.341384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.341554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.341579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.341707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.341797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.341822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.341968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.342255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.342517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.342817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.342966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.343061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.343243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.343272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.343387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.343481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.343508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.343613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.343754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.343781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.343950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.344234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.344510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.344757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.344882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.345006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.345140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.345166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.345289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.345427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.345455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.345597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.345724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.345753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.378 [2024-11-20 12:54:40.345927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.346081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.378 [2024-11-20 12:54:40.346106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.378 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.346276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.346377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.346402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.346567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.346665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.346693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.346834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.346926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.346952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.347067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.347190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.347218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.347364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.347485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.347514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.347643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.347735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.347761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.347885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.348196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.348433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.348691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.348864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.349015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.349313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.349547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.349836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.349973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.350122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.350381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.350648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.350800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.350922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.351280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.351568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.351783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.351929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.352017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.352270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.352567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.352865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.352973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.353007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.353160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.353310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.353335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.353426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.353572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.353597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.379 qpair failed and we were unable to recover it. 00:27:07.379 [2024-11-20 12:54:40.353733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.379 [2024-11-20 12:54:40.353867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.353895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.354019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.354316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.354577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.354872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.354972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.355123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.355442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.355727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.355837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.355940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.356196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.356470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.356736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.356887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.357060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.357221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.357249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.357393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.357494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.357537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.357626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.357749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.357774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.357925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.358213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.358522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.358787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.358965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.359139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.359232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.359259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.359351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.359471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.359496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.359616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.359762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.359787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.359938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.360037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.360066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.360220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.360343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.360370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.380 qpair failed and we were unable to recover it. 00:27:07.380 [2024-11-20 12:54:40.360557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.360644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.380 [2024-11-20 12:54:40.360669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.360794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.360928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.360956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.361104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.361230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.361255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.361377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.361499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.361524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.361678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.361851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.361877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.361997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.362220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.362499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.362818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.362977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.363134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.363288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.363313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.363410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.363536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.363561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.363654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.363774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.363799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.363937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.364246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.364498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.364760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.364894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.365007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.365260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.365499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.365796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.365931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.366046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.366271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.366485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.366762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.366939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.367094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.367224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.367252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.367381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.367488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.367513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.367602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.367693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.367718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.381 [2024-11-20 12:54:40.367858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.368005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.381 [2024-11-20 12:54:40.368030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.381 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.368183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.368445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.368649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.368890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.368980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.369157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.369413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.369653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.369792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.369969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.370302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.370585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.370839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.370957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.371096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.371275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.371303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.371447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.371594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.371620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.371747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.371876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.371901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.372045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.372150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.372179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.372315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.372459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.372484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.372639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.372768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.372809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.372909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.373203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.373522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.373830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.373953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.374080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.374188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.374216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.374338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.374450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.374475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.374616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.374753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.374781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.374917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.375192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.375481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.382 qpair failed and we were unable to recover it. 00:27:07.382 [2024-11-20 12:54:40.375815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.382 [2024-11-20 12:54:40.375952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.375980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.376123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.376249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.376276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.376452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.376586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.376615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.376723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.376829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.376857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.377004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.377220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.377526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.377858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.377976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.378127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.378231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.378259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.378371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.378512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.378538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.378666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.378814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.378840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.378956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.379231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.379536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.379784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.379952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.380056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.380330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.380586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.380873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.380982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.381182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.381529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.381765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.381876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.381992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.382300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.382577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.382877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.382999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.383024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.383 [2024-11-20 12:54:40.383199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.383360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.383 [2024-11-20 12:54:40.383388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.383 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.383520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.383627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.383656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.383769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.383920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.383945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.384093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.384237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.384265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.384371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.384478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.384506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.384649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.384763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.384789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.384926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.385236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.385569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.385834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.385987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.386157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.386414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.386692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.386883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.387027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.387293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.387546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.387829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.387962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.388104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.388229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.388254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.388392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.388518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.388546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.388641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.388756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.388782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.388899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.389176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.389470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.389721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.389898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.390015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.390338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.390574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.390835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.390952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.391062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.391177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.384 [2024-11-20 12:54:40.391205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.384 qpair failed and we were unable to recover it. 00:27:07.384 [2024-11-20 12:54:40.391351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.391474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.391499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.391633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.391763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.391789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.391935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.392230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.392521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.392795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.392993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.393092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.393212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.393237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.393382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.393518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.393547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.393651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.393752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.393781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.393900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.394154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.394416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.394692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.394836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.394954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.395229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.395517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.395798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.395958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.396054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.396223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.396251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.396394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.396517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.396542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.396659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.396791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.396819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.396925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.397030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.397059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.397194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.397321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.397348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.385 qpair failed and we were unable to recover it. 00:27:07.385 [2024-11-20 12:54:40.397476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.385 [2024-11-20 12:54:40.397613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.397641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.397782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.397941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.397969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.398116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.398244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.398276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.398382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.398553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.398581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.398715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.398841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.398868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.399007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.399311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.399599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.399866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.399983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.400135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.400235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.400261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.400387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.400528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.400557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.400698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.400848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.400873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.401022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.401307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.401536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.401824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.401990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.402106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.402243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.402271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.402386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.402517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.402542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.402667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.402810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.402835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.402962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.403239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.403529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.403776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.403952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.404081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.404180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.404205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.404305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.404438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.404467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.404608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.404742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.404769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.404886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.405006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.405031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.386 qpair failed and we were unable to recover it. 00:27:07.386 [2024-11-20 12:54:40.405142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.386 [2024-11-20 12:54:40.405241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.405358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.405568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.405783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.405914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.406038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.406182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.406209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.406304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.406433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.406457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.406583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.406748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.406773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.406908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.407276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.407501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.407765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.407924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.408097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.408215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.408241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.408391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.408529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.408556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.408660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.408770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.408798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.408914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.409266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.409547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.409792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.409941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.410078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.410186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.410215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.410362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.410481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.410506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.410629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.410752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.410777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.410899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.411193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.411475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.411764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.411925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.412080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.412204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.412229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.387 [2024-11-20 12:54:40.412321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.412471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.387 [2024-11-20 12:54:40.412497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.387 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.412604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.412733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.412760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.412890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.412992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.413167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.413467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.413702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.413867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.414036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.414176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.414202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.414325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.414491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.414519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.414654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.414766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.414793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.414908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.415188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.415504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.415785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.415908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.416031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.416343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.416588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.416812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.416959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.417084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.417256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.417284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.417489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.417587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.417613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.417757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.417884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.417912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.418062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.418345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.418572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.418861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.418978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.419103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.419206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.419232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.419369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.419464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.419492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.419639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.419744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.419772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.419914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.420045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.420084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.388 qpair failed and we were unable to recover it. 00:27:07.388 [2024-11-20 12:54:40.420238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.420342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.388 [2024-11-20 12:54:40.420369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.420528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.420653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.420678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.420834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.421167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.421396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.421708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.421849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.421949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.422265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.422514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.422734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.422896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.423004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.423232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.423504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.423833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.423995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.424118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.424316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.424341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.424509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.424614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.424657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.424753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.424903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.424928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.425027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.425279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.425616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.425871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.425992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.426152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.426486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.426769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.426943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.427040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.427157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.427182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.427312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.427835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.427864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.428025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.428293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.428544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.428759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.428916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.429054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.429169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.429195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.389 qpair failed and we were unable to recover it. 00:27:07.389 [2024-11-20 12:54:40.429292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.389 [2024-11-20 12:54:40.429430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.429455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.390 [2024-11-20 12:54:40.429577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.429731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.429756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.390 [2024-11-20 12:54:40.429854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.390 [2024-11-20 12:54:40.430146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.390 [2024-11-20 12:54:40.430391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.390 [2024-11-20 12:54:40.430650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.430774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.390 [2024-11-20 12:54:40.430899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.431011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.390 [2024-11-20 12:54:40.431037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.390 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.431159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.431411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.431655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.431901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.431992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.432131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.432401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.432691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.432858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.432965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.433269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.433542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.433860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.433996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.434118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.434240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.434266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.434372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.434486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.434515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.434644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.434747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.434775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.434892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.435182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.435430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.435697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.435848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.435968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.436212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.436488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.673 qpair failed and we were unable to recover it. 00:27:07.673 [2024-11-20 12:54:40.436810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.673 [2024-11-20 12:54:40.436916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.436944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.437042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.437176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.437202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.437351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.437477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.437504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.437639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.437771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.437805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.437910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.438194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.438514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.438769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.438928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.439041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.439145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.439171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.439268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.439408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.439436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.439584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.439686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.439713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.439878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.440188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.440412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.440727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.440854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.440945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.441244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.441620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.441873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.441981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.442146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.442544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.442815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.442989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.443117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.443217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.443243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.443376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.443471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.443498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.443651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.443773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.443799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.443915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.444198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.444446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.674 qpair failed and we were unable to recover it. 00:27:07.674 [2024-11-20 12:54:40.444680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.674 [2024-11-20 12:54:40.444846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.444874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.444987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.445237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.445544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.445876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.445979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.446137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.446378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.446633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.446781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.446945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.447276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.447587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.447808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.447921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.448019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.448279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.448581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.448848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.448963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.449096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.449199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.449224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.449338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.449495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.449523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.449661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.449767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.449795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.449914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.450260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.450508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.450808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.450968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.451145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.451307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.451343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.451505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.451646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.451676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.451821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.451919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.451945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.452114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.452209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.452234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.452404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.452507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.452535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.675 [2024-11-20 12:54:40.452659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.452786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.675 [2024-11-20 12:54:40.452811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.675 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.452950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.453117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.453147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.453314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.453459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.453484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.453609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.453734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.453759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.453904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.454221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.454464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.454747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.454914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.455098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.455309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.455334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.455457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.455542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.455566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.455679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.455799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.455826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.455926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.456175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.456454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.456713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.456915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.457030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.457243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.457461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.457758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.457874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.458094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.458276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.458303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.458432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.458584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.458610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.458737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.458831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.458857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.459002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.459269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.459547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.459783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.459971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.460080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.460355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.460576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.676 qpair failed and we were unable to recover it. 00:27:07.676 [2024-11-20 12:54:40.460858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.676 [2024-11-20 12:54:40.460989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.461138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.461369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.461662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.461802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.461922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.462153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.462419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.462741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.462900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.463039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.463241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.463267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.463370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.463496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.463539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.463689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.463784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.463811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.463947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.464254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.464533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.464758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.464994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.465198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.465329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.465364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.465510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.465630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.465655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.465755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.465913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.465940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.466101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.466243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.466271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.466395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.466495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.466521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.466660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.466808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.466834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.466934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.467207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.467492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.677 qpair failed and we were unable to recover it. 00:27:07.677 [2024-11-20 12:54:40.467731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.677 [2024-11-20 12:54:40.467866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.467895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.468032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.468298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.468573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.468853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.468999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.469135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.469416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.469681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.469891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.469989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.470141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.470398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.470667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.470786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.470923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.471208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.471415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.471751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.471897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.472024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.472158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.472184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.472345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.472495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.472520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.472660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.472786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.472814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.472924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.473153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.473376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.473720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.473869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.473963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.474128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.474157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.474291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.474385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.474429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.474626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.474753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.474779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.474880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.475027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.475051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.475184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.475313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.475338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.678 [2024-11-20 12:54:40.475461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.475557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.678 [2024-11-20 12:54:40.475581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.678 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.475694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.475792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.475820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.475974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.476237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.476504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.476770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.476949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.477046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.477174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.477200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.477318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.477450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.477487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.477636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.477790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.477815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.477912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.478278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.478590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.478883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.478998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.479123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.479401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.479696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.479865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.479985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.480274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.480580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.480837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.480984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.481107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.481333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.481579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.481732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.481857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.482217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.482454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.482691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.482815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.482920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.483041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.483081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.483203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.483334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.483360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.679 qpair failed and we were unable to recover it. 00:27:07.679 [2024-11-20 12:54:40.483566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.679 [2024-11-20 12:54:40.483691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.483718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.483854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.483952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.483979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.484105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.484228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.484254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.484395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.484526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.484552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.484677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.484803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.484829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.484972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.485257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.485587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.485857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.485973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.486120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.486437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.486800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.486975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.487080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.487178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.487203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.487332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.487468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.487493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.487619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.487760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.487786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.487915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.488165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.488394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.488676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.488811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.488931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.489160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.489427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.489652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.489823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.489945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.490215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.490476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.490741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.490863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.490961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.491058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.491099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.491191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.491295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.680 [2024-11-20 12:54:40.491320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.680 qpair failed and we were unable to recover it. 00:27:07.680 [2024-11-20 12:54:40.491445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.491578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.491603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.491731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.491829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.491853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.491949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.492243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.492461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.492740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.492854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.492939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.493209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.493448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.493671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.493816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.493945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.494214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.494433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.494671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.494785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.494905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.495203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.495483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.495800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.495946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.496116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.496209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.496235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.496337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.496456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.496481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.496685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.496820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.496845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.496970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.497224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.497471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.497742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.497892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.497986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.498242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.498567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.681 qpair failed and we were unable to recover it. 00:27:07.681 [2024-11-20 12:54:40.498817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.681 [2024-11-20 12:54:40.498966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.499091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.499299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.499564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.499808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.499927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.500052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.500301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.500512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.500784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.500933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.501034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.501292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.501525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.501828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.501977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.502100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.502324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.502558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.502769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.502889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.503009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.503281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.503632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.503876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.503994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.504129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.504220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.504244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.504342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.504464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.504489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.504687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.504819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.504844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.504969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.505061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.505095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.682 [2024-11-20 12:54:40.505187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.505292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.682 [2024-11-20 12:54:40.505317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.682 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.505407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.505501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.505526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.505624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.505745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.505770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.505896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.505994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.506146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.506371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.506669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.506809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.506909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.507166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.507464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.507681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.507802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.507950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.508184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.508446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.508715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.508831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.508947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.509211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.509465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.509721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.509868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.509975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.510257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.510533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.510756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.510879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.510979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.511247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.511445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.511683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.511835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.511964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.512082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.512108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.512230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.512356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.512382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.683 qpair failed and we were unable to recover it. 00:27:07.683 [2024-11-20 12:54:40.512511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.683 [2024-11-20 12:54:40.512608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.512633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.512755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.512878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.512903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.513006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.513276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.513504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.513720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.513841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.513964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.514243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.514490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.514712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.514837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.514939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.515170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.515396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.515598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.515851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.515970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.516059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.516338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.516589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.516857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.516984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.517082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.517300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.517551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.517791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.517941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.518081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.518328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.518566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.518793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.518906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.519027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.519132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.519158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.684 [2024-11-20 12:54:40.519258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.519415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.684 [2024-11-20 12:54:40.519445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.684 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.519570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.519693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.519718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.519835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.519954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.519979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.520081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.520326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.520653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.520877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.520987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.521113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.521232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.521257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.521385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.521507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.521534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.521636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.521764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.521790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.521990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.522260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.522534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.522787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.522904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.523027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.523337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.523584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.523809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.523939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.524026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.524234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.524448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.524679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.524897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.524997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.525148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.525419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.525660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.525809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.525905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.526153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.526423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.685 qpair failed and we were unable to recover it. 00:27:07.685 [2024-11-20 12:54:40.526690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.685 [2024-11-20 12:54:40.526814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.526839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.526938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.527186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.527457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.527681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.527851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.527978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.528249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.528464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.528708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.528821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.528963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.529265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.529530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.529790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.529975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.530080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.530309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.530545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.530845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.530968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.531061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.531321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.531567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.531782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.531927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.532044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.532334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.532566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.532862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.532983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.533009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.533135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.533227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.533253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.686 qpair failed and we were unable to recover it. 00:27:07.686 [2024-11-20 12:54:40.533353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.533480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.686 [2024-11-20 12:54:40.533505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.533626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.533724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.533750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.533856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.533953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.533978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.534107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.534352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.534591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.534873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.534999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.535125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.535354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.535613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.535761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.535922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.536212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.536433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.536715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.536867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.536966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.537208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.537485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.537759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.537881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.537974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.538224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.538449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.538687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.538840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.538962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.539216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.539448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.539689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.539834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.539968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.540065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.540096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.540223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.540365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.540391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.687 qpair failed and we were unable to recover it. 00:27:07.687 [2024-11-20 12:54:40.540484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.687 [2024-11-20 12:54:40.540589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.540615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.540739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.540859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.540884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.541014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.541139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.541166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.541325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.541446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.541471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.541603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.541700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.541727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.541852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.542054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.542086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.542209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.542411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.542437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.542565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.542685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.542711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.542852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.543141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.543418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.543681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.543799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.543936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.544213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.544483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.544718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.544891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.545041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.545359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.545622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.545837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.545962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.546089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.546433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.546667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.546885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.546999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.547156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.547398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.547648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.547769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.547968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.548095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.548121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.548250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.548373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.688 [2024-11-20 12:54:40.548398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.688 qpair failed and we were unable to recover it. 00:27:07.688 [2024-11-20 12:54:40.548492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.548591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.548616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.548732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.548818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.548844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.548963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.549184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.549424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.549634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.549858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.549986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.550111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.550260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.550286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.550411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.550501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.550529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.550728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.550855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.550880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.550977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.551245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.551478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.551748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.551862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.551958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.552181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.552430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.552725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.552876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.553000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.553236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.553513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.553764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.553912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.554013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.554283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.554499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.554742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.554893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.554990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.555089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.555115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.555242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.555367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.555392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.689 qpair failed and we were unable to recover it. 00:27:07.689 [2024-11-20 12:54:40.555518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.555618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.689 [2024-11-20 12:54:40.555643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.555765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.555892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.555918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.556035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.556340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.556605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.556835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.556955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.557044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.557266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.557542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.557836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.557954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.558088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.558336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.558581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.558818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.558938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.559060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.559359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.559565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.559807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.559928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.560026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.560159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.560185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.560335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.560455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.560481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.560606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.560729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.560754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.560878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.561193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.561469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.561780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.561910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.562011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.562260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.562464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.562740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.562884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.690 qpair failed and we were unable to recover it. 00:27:07.690 [2024-11-20 12:54:40.562978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.690 [2024-11-20 12:54:40.563101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.563324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.563602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.563851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.563998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.564118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.564350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.564640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.564872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.564990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.565096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.565316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.565528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.565742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.565861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.565965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.566220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.566463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.566696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.566838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.566955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.567258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.567494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.567703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.567815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.567914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.568164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.568381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.568636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.568877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.568999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.569023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.691 qpair failed and we were unable to recover it. 00:27:07.691 [2024-11-20 12:54:40.569115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.691 [2024-11-20 12:54:40.569212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.569238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.569361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.569456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.569482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.569599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.569752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.569777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.569975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.570249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.570505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.570778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.570949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.571078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.571356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.571584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.571850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.571976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.572098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.572337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.572610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.572821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.572968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.573067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.573173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.573200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.573399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.573526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.573551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.573698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.573785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.573811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.573917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.574156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.574464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.574759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.574913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.575064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.575296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.575541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.575809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.575930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.576056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.576185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.576211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.576344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.576470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.576495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.692 [2024-11-20 12:54:40.576649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.576746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.692 [2024-11-20 12:54:40.576771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.692 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.576859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.576949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.576974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.577107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.577410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.577620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.577902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.577996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.578115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.578337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.578553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.578834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.578957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.579095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.579372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.579629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.579864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.579985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.580107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.580367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.580580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.580824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.580970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.581121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.581244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.581268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.581360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.581460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.581485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.581637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.581764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.581789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.581937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.582210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.582510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.582751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.582896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.583024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.583253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.583485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.583734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.583891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.693 qpair failed and we were unable to recover it. 00:27:07.693 [2024-11-20 12:54:40.583990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.693 [2024-11-20 12:54:40.584110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.584230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.584474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.584715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.584858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.584957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.585206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.585468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.585742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.585865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.585990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.586261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.586471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.586751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.586901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.586991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.587268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.587496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.587784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.587909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.588037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.588341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.588608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.588817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.588924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.589024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.589278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.589537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.589810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.589927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.590083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.590301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.590546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.590839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.590956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.591059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.591236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.694 [2024-11-20 12:54:40.591262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.694 qpair failed and we were unable to recover it. 00:27:07.694 [2024-11-20 12:54:40.591387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.591490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.591515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.591627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.591714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.591740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.591859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.591981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.592101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.592316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.592585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.592875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.592993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.593093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.593372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.593645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.593875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.593994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.594090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.594217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.594242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.594339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.594492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.594517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.594640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.594768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.594793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.594883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.595169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.595463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.595698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.595848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.595972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.596262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.596476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.596743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.596862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.596985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.597244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.597473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.597747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.597895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.597994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.598109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.598135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.598231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.598320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.598345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.695 qpair failed and we were unable to recover it. 00:27:07.695 [2024-11-20 12:54:40.598475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.598619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-20 12:54:40.598643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.598778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.598898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.598923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.599048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.599333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.599623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.599840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.599989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.600097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.600319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.600570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.600835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.600954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.601082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.601332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.601578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.601821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.601946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.602083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.602311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.602550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.602787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.602913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.603014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.603260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.603508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.603740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.603863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.603959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.604197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.604462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.604720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-20 12:54:40.604863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.696 qpair failed and we were unable to recover it. 00:27:07.696 [2024-11-20 12:54:40.604992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.605235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.605490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.605690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.605818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.605913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.606211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.606473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.606715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.606837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.606924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.607024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.607055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.607178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.607294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.607319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.607440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.607952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.607980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.608148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.608247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.608272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.608415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.608570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.608595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.608692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.608793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.608819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.608948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.609195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.609469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.609714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.609856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.609993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.610275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.610519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.610772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.610893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.610985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.611240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.611512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.611730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.611892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.612014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.612114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.612141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.612235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.612357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.612382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.697 [2024-11-20 12:54:40.612480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.612579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-20 12:54:40.612603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.697 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.612707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.612832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.612858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.613007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.613235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.613448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.613706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.613852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.613953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.614181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.614421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.614696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.614849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.614945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.615238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.615546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.615814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.615949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.616116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.616267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.616292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.616446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.616568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.616593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.616693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.616813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.616838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.616960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.617246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.617503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.617748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.617864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.617966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.618265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.618481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.618698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.618806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.618909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.619187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.619429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.619740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.619890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.698 qpair failed and we were unable to recover it. 00:27:07.698 [2024-11-20 12:54:40.619993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-20 12:54:40.620131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.620258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.620471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.620815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.620989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.621089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.621316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.621560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.621831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.621974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.622105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.622326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.622596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.622835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.622979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.623081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.623311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.623575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.623810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.623934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.624025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.624285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.624582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.624897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.624992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.625126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.625365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.625674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.625847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.625999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.626280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.626529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.626775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.626889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.626983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.627102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.627128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.627223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.627316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.699 [2024-11-20 12:54:40.627340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.699 qpair failed and we were unable to recover it. 00:27:07.699 [2024-11-20 12:54:40.627438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.627534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.627559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.627688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.627839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.627865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.627965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.628201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.628476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.628823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.628936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.629032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.629249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.629456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.629680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.629829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.630028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.630281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.630555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.630798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.630957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.631086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.631298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.631529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.631801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.631926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.632047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.632294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.632602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.632866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.632989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.633090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.633183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.633209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.633312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.633399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.633425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.633515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.633609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.700 [2024-11-20 12:54:40.633634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.700 qpair failed and we were unable to recover it. 00:27:07.700 [2024-11-20 12:54:40.633759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.633862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.633887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.634010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.634260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.634476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.634713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.634873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.634994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.635241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.635509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.635753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.635872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.635978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.636253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.636531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.636800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.636920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.637020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.637270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.637501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.637734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.637877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.637966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.638220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.638445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.638700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.638818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.638909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.639166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.639419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.639638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.639795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.639920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.640157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.640366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.701 [2024-11-20 12:54:40.640610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.701 [2024-11-20 12:54:40.640732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.701 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.640831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.640917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.640943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.641038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.641166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.641193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.641312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.641510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.641535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.641666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.641758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.641783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.641907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.642213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.642473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.642796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.642970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.643102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.643351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.643601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.643843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.643966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.644061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.644298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.644646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.644866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.644991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.645079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.645353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.645584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.645817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.645939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.646033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.646253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.646628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.646850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.646979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.647112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.647382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.647612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.647856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.647968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.702 qpair failed and we were unable to recover it. 00:27:07.702 [2024-11-20 12:54:40.648059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.702 [2024-11-20 12:54:40.648265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.648292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.648414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.648537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.648567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.648654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.648778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.648803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.648925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.649185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.649402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.649703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.649822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.649913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.650210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.650420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.650681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.650814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.650912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.651182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.651457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.651708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.651828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.651944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.652211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.652457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.652679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.652806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.652932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.653194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.653430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.653679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.653801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.653928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.654228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.654510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.654779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.654926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.655029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.655161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.655187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.655392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.655508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.703 [2024-11-20 12:54:40.655533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.703 qpair failed and we were unable to recover it. 00:27:07.703 [2024-11-20 12:54:40.655663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.655810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.655836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.655921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.656171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.656418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.656665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.656806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.656909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.657125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.657344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.657669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.657810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.657903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.658186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.658392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.658633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.658893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.658993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.659134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.659354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.659599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.659742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.659884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.660169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.660417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.660657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.660789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.660914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.661147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.661358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.661608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.661853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.661978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.662115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.662203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.662228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.662349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.662467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.662493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.704 qpair failed and we were unable to recover it. 00:27:07.704 [2024-11-20 12:54:40.662618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.662713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.704 [2024-11-20 12:54:40.662738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.662846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.662966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.662991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.663114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.663222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.663248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.663372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.663530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.663554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.663673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.663766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.663792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.663911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.664186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.664403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.664647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.664886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.664977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.665126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.665405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.665641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.665765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.665884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.666194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.666436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.666698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.666838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.666933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.667192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.667432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.667655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.667803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.667903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.668195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.668507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.668745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.668861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.668981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.669078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.705 [2024-11-20 12:54:40.669116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.705 qpair failed and we were unable to recover it. 00:27:07.705 [2024-11-20 12:54:40.669245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.669341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.669367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.669514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.669661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.669686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.669779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.669875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.669900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.670032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.670163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.670190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.670315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.671281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.671563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.671789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.671941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.672058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.672298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.672577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.672850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.672979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.673097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.673231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.673256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.673384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.673496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.673522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.673657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.673773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.673797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.673913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.674191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.674464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.674684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.674832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.674983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.675263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.675504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.675775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.675891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.676009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.676237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.676515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.676795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.676957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.677108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.677211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.677236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.706 qpair failed and we were unable to recover it. 00:27:07.706 [2024-11-20 12:54:40.677336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.706 [2024-11-20 12:54:40.677462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.677487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.677621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.677740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.677770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.677922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.678226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.678477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.678700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.678873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.678987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.679203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.679451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.679731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.679861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.679998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.680236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.680520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.680765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.680939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.681036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.681342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.681605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.681849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.681971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.682095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.682197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.682222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.682342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.682463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.682488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.682612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.682733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.682760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.682916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.683183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.683393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.683602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.683762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.683885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.684199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.684420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.707 [2024-11-20 12:54:40.684669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.707 [2024-11-20 12:54:40.684815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.707 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.684935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.685195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.685445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.685726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.685876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.685970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.686257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.686499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.686725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.686842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.686933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.687184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.687376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.687615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.687823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.687998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.688124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.688229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.688254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.688985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.689286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.689507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.689768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.689918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.690007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.690242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.690450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.690745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.690892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.690984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.691223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.691500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.691768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.691919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.692082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.692189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.692215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.692335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.692433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.692458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.708 qpair failed and we were unable to recover it. 00:27:07.708 [2024-11-20 12:54:40.692552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.708 [2024-11-20 12:54:40.692647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.692673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.692799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.692889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.692914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.693034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.693290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.693566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.693853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.693965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.694099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.694205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.694232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.694331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.694452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.694478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.694600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.694748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.694773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.694896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.695157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.695414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.695657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.695780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.695907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.696242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.696531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.696794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.696922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.697048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.697276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.697528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.697740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.697858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.697985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.698245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.698475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.698681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.698829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.709 qpair failed and we were unable to recover it. 00:27:07.709 [2024-11-20 12:54:40.698959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.709 [2024-11-20 12:54:40.699057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.699224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.699437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.699712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.699862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.700013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.700319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.700592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.700832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.700945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.701043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.701359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.701631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.701847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.701999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.702127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.702401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.702675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.702793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.702920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.703196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.703447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.703666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.703793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.703889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.704143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.704390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.704633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.704853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.704972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.705098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.705318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.705632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.705862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.705978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.710 [2024-11-20 12:54:40.706103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.706229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.710 [2024-11-20 12:54:40.706254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.710 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.706357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.706482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.706508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.706656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.706781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.706807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.706923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.707180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.707412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.707642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.707765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.707888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.708154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.708366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.708573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.708783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.708927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.709016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.709266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.709494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.709768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.709881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.709999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.710247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.710490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.710703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.710820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.710943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.711201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.711411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.711695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.711908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.711997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.712130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.712398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.712651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.712792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.712922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.713044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.713078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.711 qpair failed and we were unable to recover it. 00:27:07.711 [2024-11-20 12:54:40.713178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.711 [2024-11-20 12:54:40.713275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.713402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.713603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.713841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.713965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.714067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.714211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.714235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.714364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.714480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.714505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.714631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.714728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.714754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.714883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.715160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.715399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.715615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.715816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.715936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.716027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.716275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.716497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.716793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.716914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.717009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.717248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.717520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.717769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.717918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.718007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.718247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.718508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.718726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.718869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.718970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.719216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.719460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.719685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.719856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.719952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.720066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.712 [2024-11-20 12:54:40.720099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.712 qpair failed and we were unable to recover it. 00:27:07.712 [2024-11-20 12:54:40.720224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.720319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.720345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.720438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.720561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.720587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.720711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.720835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.720861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.720991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.721208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.721442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.721681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.721832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.721934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.722192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.722413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.722672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.722845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.722942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.723200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.723444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.723681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.723805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.723904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.724154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.724420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.724676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.724825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.724919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.725197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.725439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.725712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.725857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.725969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.726225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.726461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.726726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.726872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.726970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.727066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.727099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.713 qpair failed and we were unable to recover it. 00:27:07.713 [2024-11-20 12:54:40.727259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.713 [2024-11-20 12:54:40.727384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.727410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.727510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.727628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.727654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.727786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.727907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.727933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.728026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.728273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.728503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.728756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.728896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.729017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.729244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.729516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.729759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.729869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.730000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.730244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.730480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.730715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.730834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.730924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.731174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.731423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.731661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.731868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.731989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.732118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.732358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.732586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.732797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.732951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.733682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.733826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.733852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.714 qpair failed and we were unable to recover it. 00:27:07.714 [2024-11-20 12:54:40.733952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.714 [2024-11-20 12:54:40.734052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.734195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.734418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.734667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.734787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.734891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.735187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.735439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.735682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.735826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.735949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.736224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.736510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.736813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.736940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.737056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.737324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.737575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.737845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.737967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.738062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.738370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.738653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.738870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.738996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.739090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.739182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.739209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.739302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.739393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.739418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.739537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.739677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.739706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.739843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.740216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.740460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.740729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.740873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.740995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.741095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.741122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.741221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.741320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.715 [2024-11-20 12:54:40.741346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.715 qpair failed and we were unable to recover it. 00:27:07.715 [2024-11-20 12:54:40.741479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.741578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.741603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.741697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.741848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.741873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.741969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.742219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.742569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.742813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.742938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.743058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.743278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.743552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.743762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.743906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.744027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.744283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.744537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.744803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.744927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.745056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.745346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.745621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.745867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.745993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.746122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.746383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.746730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.746848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.746971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.747206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.747416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.747712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.747829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.747923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.748178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.748474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.748747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.748899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.749023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.749153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.749179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.716 qpair failed and we were unable to recover it. 00:27:07.716 [2024-11-20 12:54:40.749273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.716 [2024-11-20 12:54:40.749400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.749425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.749553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.749648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.749673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.749768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.749899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.749924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.750042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.750275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.750509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.750731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.750880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.750973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.751201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.751548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.751826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.751948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.752076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.752202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.752228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.752433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.752524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.752549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.752644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.752771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.752801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.752929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.753196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.753437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.753664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.753804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.753895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.754194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.754435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.754731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.754853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.754944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.755203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.755472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.755785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.755908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.756001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.756124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.717 [2024-11-20 12:54:40.756155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:07.717 qpair failed and we were unable to recover it. 00:27:07.717 [2024-11-20 12:54:40.756261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.756355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.756381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.756493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.756612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.756638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.756781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.756871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.756896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.757004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.757259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.757513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.757727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.757905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.758030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.758298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.758587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.758841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.758984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.759087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.759342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.759583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.759842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.759964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.760113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.760330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.760586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.760836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.760949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.761077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.761162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.761188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.761309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.761400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.761426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.013 qpair failed and we were unable to recover it. 00:27:08.013 [2024-11-20 12:54:40.761552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.013 [2024-11-20 12:54:40.761697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.761723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.761812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.761902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.761927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.762030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.762342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.762609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.762831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.762978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.763114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.763316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.763350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.763483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.763682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.763707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.763831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.763923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.763949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.764078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.764332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.764631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.764876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.764999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.765128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.765376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.765651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.765893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.765988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.766164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.766419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.766677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.766801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.766924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.767165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.767440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.767651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.767773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.767925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.768158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.768428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.768682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.768807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.014 [2024-11-20 12:54:40.768907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.769056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.014 [2024-11-20 12:54:40.769089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.014 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.769189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.769418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.769629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.769874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.769992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.770139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.770412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.770652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.770893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.770983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.771158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.771437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.771702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.771811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.771935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.772214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.772422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.772690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.772839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.772930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.773212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.773491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.773769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.773878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.773997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.774243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.774542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.774814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.774987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.775107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.775233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.775257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.775413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.775506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.775531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.775631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.775756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.775781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.775896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.776017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.776041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.776166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.776282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.776311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.015 qpair failed and we were unable to recover it. 00:27:08.015 [2024-11-20 12:54:40.776407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.015 [2024-11-20 12:54:40.776534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.776557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.776677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.776838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.776863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.776992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.777236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.777480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.777774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.777917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.778007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.778297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.778500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.778721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.778843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.778940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.779172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.779398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.779689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.779905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.779995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.780154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.780422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.780704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.780853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.781000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.781217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.781466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.781731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.781901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.782024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.782293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.782537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.782808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.782978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.783090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.783183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.783207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.783294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.783421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.783446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.016 [2024-11-20 12:54:40.783561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.783683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.016 [2024-11-20 12:54:40.783707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.016 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.783835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.783923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.783947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.784079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.784355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.784564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.784832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.784943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.785043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.785291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.785533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.785751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.785879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.785971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.786196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.786484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.786730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.786882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.786980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.787276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.787530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.787797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.787917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.788017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.788303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.788536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.788750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.788924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.017 qpair failed and we were unable to recover it. 00:27:08.017 [2024-11-20 12:54:40.789017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.017 [2024-11-20 12:54:40.789149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.789261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.789548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.789792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.789935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.790033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.790320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.790587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.790845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.790981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.791109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.791317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.791565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.791799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.791947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.792062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.792289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.792536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.792799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.792971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.793094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.793372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.793633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.793882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.793981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.794149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.794407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.794670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.794888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.794987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.795112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.795380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.795630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.795865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.795986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.796011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.018 qpair failed and we were unable to recover it. 00:27:08.018 [2024-11-20 12:54:40.796115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.018 [2024-11-20 12:54:40.796214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.796364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.796606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.796877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.796996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.797095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.797307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.797586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.797807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.797955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.798097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.798332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.798560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.798835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.798973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.799099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.799383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.799629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.799974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.800095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.800353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.800615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.800879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.800991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.801147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.801412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.801632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.801803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.801901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.802209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.802502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.802749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.802925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.019 qpair failed and we were unable to recover it. 00:27:08.019 [2024-11-20 12:54:40.803046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.803157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.019 [2024-11-20 12:54:40.803183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.803292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.803399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.803423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.803562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.803680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.803705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.803829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.803942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.803966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.804093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.804334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.804635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.804862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.804980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.805098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.805353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.805587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.805770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.805897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.806184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.806464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.806754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.806930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.807024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.807136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.807163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.807318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.807422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.807453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.807579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.807704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.807730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.807881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.808199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.808439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.808682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.808826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.808941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.809170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.809422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.809671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.809887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.809977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.810001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.810125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.810217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.810242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.810364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.810455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.020 [2024-11-20 12:54:40.810480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.020 qpair failed and we were unable to recover it. 00:27:08.020 [2024-11-20 12:54:40.810630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.810751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.810776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.810896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.811183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.811414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.811708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.811822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.811920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.812175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.812450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.812666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.812838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.812964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.813220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.813483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.813718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.813834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.813931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.814252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.814462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.814732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.814851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.814950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.815233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.815500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.815796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.815938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.816060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.816334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.816553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.816830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.816950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.817082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.817179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.817203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.817329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.817420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.817444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.817588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.817735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.817759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.021 [2024-11-20 12:54:40.817881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.818013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.021 [2024-11-20 12:54:40.818038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.021 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.818150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.818368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.818618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.818847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.818998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.819090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.819339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.819600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.819838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.819977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.820110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.820351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.820598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.820811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.820958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.821060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.821295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.821562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.821795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.821965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.822066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.822313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.822577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.822856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.822998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.823153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.823275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.823300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.823415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.823509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.823532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.823654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.823773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.823797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.823895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.824011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.824036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.022 [2024-11-20 12:54:40.824143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.824240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.022 [2024-11-20 12:54:40.824264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.022 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.824374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.824521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.824545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.824649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.824765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.824790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.824893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.825139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.825384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.825634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.825779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.825927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.826188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.826432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.826636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.826844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.826996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.827118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.827362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.827582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.827821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.827943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.828100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.828231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.828256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.828361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.828508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.828532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.828653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.828777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.828801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.828893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.829133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.829380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.829622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.829840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.829966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.830059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.830318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.830563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.830847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.830990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.831091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.831177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.831202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.023 qpair failed and we were unable to recover it. 00:27:08.023 [2024-11-20 12:54:40.831302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.831401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.023 [2024-11-20 12:54:40.831426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.831547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.831633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.831658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.831774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.831893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.831918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.832023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.832257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.832474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.832732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.832877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.833000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.833267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.833524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.833794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.833937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.834059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.834316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.834571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.834786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.834927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.835021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.835295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.835587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.835805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.835943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.836037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.836275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.836496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.836724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.836871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.836988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.837212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.837499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.837753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.837897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.838021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.838118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.838145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.838271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.838383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.838408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.024 qpair failed and we were unable to recover it. 00:27:08.024 [2024-11-20 12:54:40.838503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.024 [2024-11-20 12:54:40.838598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.838622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.838746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.838857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.838880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.838972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.839198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.839552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.839795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.839941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.840066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.840336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.840547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.840823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.840943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.841088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.841335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.841581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.841824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.841975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.842134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.842253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.842277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.842378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.842519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.842544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.842674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.842820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.842846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.842938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.843207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.843463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.843862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.843984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.844114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.844387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.844617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.844880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.844976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.845136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.845356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.845654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.845804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.845930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.846051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.846083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.025 qpair failed and we were unable to recover it. 00:27:08.025 [2024-11-20 12:54:40.846206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.025 [2024-11-20 12:54:40.846333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.846358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.846475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.846567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.846593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.846712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.846826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.846849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.846942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.847196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.847438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.847689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.847800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.847899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.848178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.848425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.848669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.848814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.848921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.849185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.849417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.849690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.849827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.849949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.850239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.850470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.850680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.850828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.850943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.851222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.851477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.851773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.851920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.852045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.852333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.852539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.852812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.852933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.853065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.853167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.853192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.853343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.853467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.026 [2024-11-20 12:54:40.853491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.026 qpair failed and we were unable to recover it. 00:27:08.026 [2024-11-20 12:54:40.853584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.853681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.853705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.853858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.853942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.853966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.854092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.854212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.854236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.854357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.854483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.854507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.854656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.854780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.854804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.854936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.855154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.855366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.855637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.855759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.855912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.856182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.856431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.856689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.856832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.856953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.857216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.857421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.857714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.857838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.857936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.858222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.858494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.858731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.858876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.859000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.859121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.859145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.859262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.859381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.859406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.027 qpair failed and we were unable to recover it. 00:27:08.027 [2024-11-20 12:54:40.859491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.027 [2024-11-20 12:54:40.859645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.859668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.859794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.859884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.859908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.860032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.860290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.860532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.860768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.860876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.860982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.861228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.861439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.861722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.861849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.861946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.862221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.862464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.862734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.862854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.862951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.863190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.863395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.863637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.863887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.863986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.864134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.864339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.864571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.864866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.864989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.865092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.865324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.865558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.865804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.865946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 [2024-11-20 12:54:40.866045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.866187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.866213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.028 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3644538 Killed "${NVMF_APP[@]}" "$@" 00:27:08.028 [2024-11-20 12:54:40.866310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.866403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.028 [2024-11-20 12:54:40.866427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.028 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.866558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:08.029 [2024-11-20 12:54:40.866708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.866732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 12:54:40 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:08.029 [2024-11-20 12:54:40.866878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:08.029 [2024-11-20 12:54:40.866970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.866995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 12:54:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:08.029 [2024-11-20 12:54:40.867101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- common/autotest_common.sh@10 -- # set +x 00:27:08.029 [2024-11-20 12:54:40.867200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.867336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.867573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.867788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.867936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.868065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.868287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.868546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.868831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.868946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.869082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.869321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.869558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.869850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.869998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.870131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.870349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.870558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.870799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.870909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 12:54:40 -- nvmf/common.sh@469 -- # nvmfpid=3645234 00:27:08.029 [2024-11-20 12:54:40.870997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:08.029 12:54:40 -- nvmf/common.sh@470 -- # waitforlisten 3645234 00:27:08.029 [2024-11-20 12:54:40.871115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.871141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.871237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- common/autotest_common.sh@829 -- # '[' -z 3645234 ']' 00:27:08.029 [2024-11-20 12:54:40.871367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.871394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 12:54:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:08.029 [2024-11-20 12:54:40.871547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.871646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.029 [2024-11-20 12:54:40.871671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.871798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:08.029 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:08.029 [2024-11-20 12:54:40.871901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.871927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 12:54:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.029 [2024-11-20 12:54:40.872053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 12:54:40 -- common/autotest_common.sh@10 -- # set +x 00:27:08.029 [2024-11-20 12:54:40.872157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.872183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.872308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.872749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.872778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.872928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.873054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.873086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.029 qpair failed and we were unable to recover it. 00:27:08.029 [2024-11-20 12:54:40.873214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.029 [2024-11-20 12:54:40.873337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.873363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.873513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.873605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.873630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.873730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.873821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.873846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.873974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.874292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.874536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.874755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.874902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.875011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.875239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.875484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.875702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.875853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.875985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.876240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.876499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.876721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.876937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.877085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.877346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.877613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.877836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.877980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.878108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.878324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.878586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.878798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.878911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.879027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.879343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.879637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.879900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.879994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.880020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.880142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.880263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.880289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.880423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.880515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.880540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.030 qpair failed and we were unable to recover it. 00:27:08.030 [2024-11-20 12:54:40.880639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.030 [2024-11-20 12:54:40.880783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.880808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.880896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.880988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.881126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.881378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.881679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.881825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.881929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.882187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.882430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.882667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.882815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.882910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.883168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.883396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.883620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.883848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.883993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.884122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.884347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.884618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.884830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.884953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.885051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.885325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.885568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.885839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.885975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.886095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.886335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.886545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.031 qpair failed and we were unable to recover it. 00:27:08.031 [2024-11-20 12:54:40.886779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.031 [2024-11-20 12:54:40.886891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.887014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.887251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.887488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.887689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.887800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.887921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.888164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.888403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.888619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.888862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.888986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.889106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.889352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.889592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.889810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.889951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.890044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.890315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.890559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.890815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.890929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.891062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.891293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.891536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.891776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.891903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.892033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.892293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.892512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.892771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.892897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.893007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.893252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.893472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.032 qpair failed and we were unable to recover it. 00:27:08.032 [2024-11-20 12:54:40.893702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.032 [2024-11-20 12:54:40.893794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.893818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.893917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.894224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.894437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.894723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.894836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.894957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.895215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.895463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.895714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.895829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.895950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.896043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.896075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.896176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.896294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.896318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.897086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.897366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.897597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.897878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.897996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.898097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.898311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.898568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.898842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.898951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.899047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.899328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.899547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.899777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.899929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.900029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.900272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.900547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.900778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.900911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.901011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.901140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.901165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.901263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.901359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.901392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.033 qpair failed and we were unable to recover it. 00:27:08.033 [2024-11-20 12:54:40.901528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.033 [2024-11-20 12:54:40.901691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.901716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.901813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.901938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.901964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.902086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.902310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.902557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.902828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.902949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.903048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.903295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.903562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.903813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.903983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.904086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.904334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.904541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.904836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.904985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.905094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.905303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.905544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.905808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.905933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.906025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.906243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.906450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.906721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.906871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.907018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.907239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.907470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.907710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.907835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.907940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.908066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.908095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.908221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.908321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.908344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.908455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.908576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.034 [2024-11-20 12:54:40.908601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.034 qpair failed and we were unable to recover it. 00:27:08.034 [2024-11-20 12:54:40.908698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.908811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.908835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.908934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.909155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.909398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.909645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.909794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.909920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.910165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.910428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.910649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.910905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.910998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.911118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.911474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.911793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.911933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.912060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.912281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.912549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.912784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.912900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.912991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.913234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.913504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.913767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.913878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.913968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.914190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.914448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.914687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.914802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.914932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.915151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.915395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.035 [2024-11-20 12:54:40.915619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.035 [2024-11-20 12:54:40.915760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.035 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.915858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.915917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:08.036 [2024-11-20 12:54:40.915953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.915981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.915992] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:08.036 [2024-11-20 12:54:40.916100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.916203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.916225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.916331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.916477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.916503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.916595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.916689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.916713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.916838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.917157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.917382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.917586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.917830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.917945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.918034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.918286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.918515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.918732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.918856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.918985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.919202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.919444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.919718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.919836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.919939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.920223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.920450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.920716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.920843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.920928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.921166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.921443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.036 qpair failed and we were unable to recover it. 00:27:08.036 [2024-11-20 12:54:40.921675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.036 [2024-11-20 12:54:40.921762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.921786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.921879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.922162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.922398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.922604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.922831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.922978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.923112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.923382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.923623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.923872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.923989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.924141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.924355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.924621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.924793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.924939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.925206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.925430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.925676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.925895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.925992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.926120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.926374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.926610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.926857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.926966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.927060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.927324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.927585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.927842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.927960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.928084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.928209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.928234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.928358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.928506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.928529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.928623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.928717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.037 [2024-11-20 12:54:40.928740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.037 qpair failed and we were unable to recover it. 00:27:08.037 [2024-11-20 12:54:40.928862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.928956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.928981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.929108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.929338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.929584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.929847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.929961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.930096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.930338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.930612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.930833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.930977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.931092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.931341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.931590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.931829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.931944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.932065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.932292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.932521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.932795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.932919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.933042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.933289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.933527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.933792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.933951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.934048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.934298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.934562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.934807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.934956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.935080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.935292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.935557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.935803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.038 [2024-11-20 12:54:40.935921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.038 qpair failed and we were unable to recover it. 00:27:08.038 [2024-11-20 12:54:40.936019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.936270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.936488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.936746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.936887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.936979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.937257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.937465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.937799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.937946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.938066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.938340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.938605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.938844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.938960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.939066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.939159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.939183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.939313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.939445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.939470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.939619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.939739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.939764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.939883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.940172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.940393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.940656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.940804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.940923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.941190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.941423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.941668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.941809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.941955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.942203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.942408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.942686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.942828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.942956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.943050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.943081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.039 qpair failed and we were unable to recover it. 00:27:08.039 [2024-11-20 12:54:40.943205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.943290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.039 [2024-11-20 12:54:40.943315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.943428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.943531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.943556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.943680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.943799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.943824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.943945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.944200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.944439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.944659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.944802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.944918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.945199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.945406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.945616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.945886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.945999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.946128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.946378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.946632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.946879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.946982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.947079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.947302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.947546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.947766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.947913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.948009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.948257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.948569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.948778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.948917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.949009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.949278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.949523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.040 [2024-11-20 12:54:40.949824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.040 [2024-11-20 12:54:40.949943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.040 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.950039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.950307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.950552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.950768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.950884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.950984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.951238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.951472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.951715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.951830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.951938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.952209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.952430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.952697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.952820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.952906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.953177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.953439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.953724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.953855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.953971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.954240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.954455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.954674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.954795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.954914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.955208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.955476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.955711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.955837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.955934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.956058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.956092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.956195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.956298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.956323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.041 qpair failed and we were unable to recover it. 00:27:08.041 [2024-11-20 12:54:40.956484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.041 [2024-11-20 12:54:40.956608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.041 [2024-11-20 12:54:40.956634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.956733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.956823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.956848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.956943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.957193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.957440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.957667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.957901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.957999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.958132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.958369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.958607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.958757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.958880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.959153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.959424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.959679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.959796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.959921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.960174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.960403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.960656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.960841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.960943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.961226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.961473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.961684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.961802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.961928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.962193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.962418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.962645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.962788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.962912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.963008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.963033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.963182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.963289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.963315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.963414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.963502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.042 [2024-11-20 12:54:40.963527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.042 qpair failed and we were unable to recover it. 00:27:08.042 [2024-11-20 12:54:40.963617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.963768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.963793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.963918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.964176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.964399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.964695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.964817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.964967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.965241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.965491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.965733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.965855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.965949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.966200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.966450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.966699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.966818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.966922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.967197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.967406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.967696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.967812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.967925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.968154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.968405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.968618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.968850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.968970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.969081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.969312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.969516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.969789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.969942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.970047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.970188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.970215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.970315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.970444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.970469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.043 qpair failed and we were unable to recover it. 00:27:08.043 [2024-11-20 12:54:40.970585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.970672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.043 [2024-11-20 12:54:40.970696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.970791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.970882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.970906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.971006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.971261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.971475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.971717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.971839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.971960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.972178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.972454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.972677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.972794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.972915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.973219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.973446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.973682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.973885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.973975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.974099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.974305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.974531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.974779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.974911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.975030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.975271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.975487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.975762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.975873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.975991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.976205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.976409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.976615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.976890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.976989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.977015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.977147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.977251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.977275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.044 qpair failed and we were unable to recover it. 00:27:08.044 [2024-11-20 12:54:40.977397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.044 [2024-11-20 12:54:40.977496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.977521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.977626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.977719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.977746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.977852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.977970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.977994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.978099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.978337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.978558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.978828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.978954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.979044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.979317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.979567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.979785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.979904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.980027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.980293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.980538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.980804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.980920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.981043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.981344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.981577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.981817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.981964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.982062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.982310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.982561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.982775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.982947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.983040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.983172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.983199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.983305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.983400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.983424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.045 qpair failed and we were unable to recover it. 00:27:08.045 [2024-11-20 12:54:40.983551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.045 [2024-11-20 12:54:40.983646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.983670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.983776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.983896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.983922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.984019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.984288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.984545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.984792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.984900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.985050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.985306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.985535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.985781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.985929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.986027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.986259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.986535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.986749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.986860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.986961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.987188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.987397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.987611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.987849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.987989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.988090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.988367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.988605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.988820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.988946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.989039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.989307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.989543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.989744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.989865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.989964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.990059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.990090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.046 [2024-11-20 12:54:40.990185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.990276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.046 [2024-11-20 12:54:40.990300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.046 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.990390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.990508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.990533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.990630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.990718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.990744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.990845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.990958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.990983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.991081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.991309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.991520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.991757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.991908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.992030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.992282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.992491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.992742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.992892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.992989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.993210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.993442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.993713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.993820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.993951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.994218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.994479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.994686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.994834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.994938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:08.047 [2024-11-20 12:54:40.995088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.995234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.995455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.995660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.995870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.995989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.996118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.996342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.996608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.996821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.996936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.047 qpair failed and we were unable to recover it. 00:27:08.047 [2024-11-20 12:54:40.997029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.047 [2024-11-20 12:54:40.997134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.997313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.997549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.997783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.997910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.998037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.998294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.998523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.998779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.998900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.999004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.999229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.999471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.999746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:40.999895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:40.999990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.000263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.000477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.000705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.000822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.000912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.001156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.001438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.001714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.001863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.001961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.002225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.002480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.002738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.002865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.002997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.003246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.003483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.003704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.003848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.048 [2024-11-20 12:54:41.003942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.004067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.048 [2024-11-20 12:54:41.004098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.048 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.004243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.004336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.004361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.004456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.004577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.004602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.004704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.004800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.004825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.004920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.005174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.005444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.005750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.005869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.005966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.006220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.006433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.006648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.006790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.006893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.007200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.007455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.007726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.007873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.008003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.008226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.008457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.008673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.008803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.008900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.009151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.009371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.009639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.009819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.009921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.010169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.010418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.010686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.010835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.010959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.011053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.011085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.049 qpair failed and we were unable to recover it. 00:27:08.049 [2024-11-20 12:54:41.011192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.049 [2024-11-20 12:54:41.011283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.011309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.011401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.011503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.011529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.011640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.011788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.011813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.011947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.012181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.012439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.012667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.012821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.012941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.013178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.013439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.013727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.013847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.013969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.014201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.014424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.014660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.014815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.014932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.015203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.015476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.015737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.015853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.015949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.016180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.016444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.016661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.016774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.016888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.017014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.017038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.017144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.017342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.017367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.050 qpair failed and we were unable to recover it. 00:27:08.050 [2024-11-20 12:54:41.017465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.050 [2024-11-20 12:54:41.017584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.017609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.017708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.017828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.017853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.017943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.018183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.018400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.018655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.018875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.018985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.019116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.019364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.019581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.019848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.019971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.020123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.020369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.020612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.020896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.020988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.021108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.021356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.021597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.021836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.021955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.022080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.022279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.022304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.022406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.022505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.022531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.022659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.022782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.022807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.022930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.023183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.023450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.023705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.023883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.023989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.024109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.024136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.024235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.024363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.024389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.024492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.024614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.051 [2024-11-20 12:54:41.024641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.051 qpair failed and we were unable to recover it. 00:27:08.051 [2024-11-20 12:54:41.024741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.024832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.024858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.024949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.025211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.025456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.025691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.025819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.025968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.026301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.026573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.026848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.026997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.027106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.027372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.027641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.027886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.027987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.028122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.028349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.028672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.028898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.028994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.029219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.029521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.029743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.029870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.029997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.030215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.030431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.030669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.030842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.030937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.031224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.031488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.031741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.031856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.052 qpair failed and we were unable to recover it. 00:27:08.052 [2024-11-20 12:54:41.031963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.052 [2024-11-20 12:54:41.032082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.032241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.032457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.032732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.032849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.032950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.033202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.033420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.033623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.033868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.033993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.034131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.034399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.034635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.034756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.034862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.035142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.035359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.035641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.035885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.035974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.036154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.036385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.036675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.036794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.036914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.037178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.037390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.037655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.037892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.037994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.038118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.038424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.038682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.038807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.038909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.039028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.053 [2024-11-20 12:54:41.039053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.053 qpair failed and we were unable to recover it. 00:27:08.053 [2024-11-20 12:54:41.039196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.039323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.039349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.039472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.039563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.039589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.039687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.039809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.039834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.039923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.040176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.040420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.040664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.040886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.040999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.041099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.041366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.041646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.041858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.041983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.042091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.042372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.042623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.042846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.042963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.043067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.043291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.043537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.043752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.043871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.043997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.044263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.044485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.044687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.044833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.044922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.045014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.054 [2024-11-20 12:54:41.045040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.054 qpair failed and we were unable to recover it. 00:27:08.054 [2024-11-20 12:54:41.045133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.045384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.045588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.045847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.045990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.046082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.046325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.046573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.046794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.046948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.047087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.047321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.047526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.047773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.047881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.048002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.048208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.048468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.048683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.048810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.048902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.049159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.049423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.049664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.049785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.049895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.050147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.050402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.050670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.050813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.050937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.051191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.051430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.051651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.051799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.051918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.052045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.052077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.052172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.052294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.052320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.052417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.052567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.055 [2024-11-20 12:54:41.052592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.055 qpair failed and we were unable to recover it. 00:27:08.055 [2024-11-20 12:54:41.052683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.052797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.052823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.052948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.053225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.053470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.053698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.053844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.053944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.054187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.054432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.054676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.054832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.054927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.055153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.055380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.055651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.055767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.055894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.056142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.056391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.056645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.056892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.056993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.057128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.057348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.057628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.057895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.057993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.058115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.058367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.058607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.058874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.058981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.059100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.059328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.059577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.059852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.059969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.056 [2024-11-20 12:54:41.060100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.060201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.056 [2024-11-20 12:54:41.060227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.056 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.060318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.060440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.060466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.060582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.060669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.060694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.060783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.060884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.060910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.061015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.061268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.061508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.061723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.061838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.061959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.062228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.062475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.062714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.062829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.062953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.063206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.063459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.063739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.063857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.064007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.064225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.064500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.064725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.064852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.064975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.065199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.065451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.065732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.065845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.065943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.066189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.066414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.066660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.066811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.066904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.067229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.067506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.057 qpair failed and we were unable to recover it. 00:27:08.057 [2024-11-20 12:54:41.067761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.057 [2024-11-20 12:54:41.067935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.068085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.068232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.068257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.068358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.068455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.068482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.068603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.068718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.068744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.068884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.069142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.069417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.069657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.069876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.069995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.070119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.070364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.070624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.070863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.070987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.071094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.071319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.071560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.071770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.071891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.072026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.072292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.072589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.072816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.072970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.073067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.073302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.073567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.073820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.073952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.074045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.074316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.074613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.074864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.074986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.075012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.075138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.075239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.058 [2024-11-20 12:54:41.075265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.058 qpair failed and we were unable to recover it. 00:27:08.058 [2024-11-20 12:54:41.075355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.075444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.075470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.075557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.075645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.075671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.075756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.075876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.075901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.076008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.076257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.076481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.076741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.076864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.076961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.077180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.077429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.077711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.077859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.077960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.078207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.078444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.078700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.078853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.078947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.079189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.079440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.079709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.079852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.079956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.080201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.080473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.059 qpair failed and we were unable to recover it. 00:27:08.059 [2024-11-20 12:54:41.080683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.059 [2024-11-20 12:54:41.080800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.080897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.080995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.081198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.081466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.081715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.081841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.081944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.082190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.082413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.082663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.082792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.082890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.083183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.083428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.083666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.083824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.083972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.084210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.084464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.084678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.084827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.084960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.085060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.085094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.060 qpair failed and we were unable to recover it. 00:27:08.060 [2024-11-20 12:54:41.085218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.085317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.060 [2024-11-20 12:54:41.085342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.085464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.085554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.085578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.085698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.085785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.085810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.085930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.086180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.086466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.086718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.086888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.345 qpair failed and we were unable to recover it. 00:27:08.345 [2024-11-20 12:54:41.086973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.345 [2024-11-20 12:54:41.087061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.087215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.087474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.087691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.087846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.087932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.088191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.088409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.088630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.088851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.088977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.089102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.089356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.089601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.089844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.089961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.090048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.090304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.090512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.090735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.090848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.090950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.091079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.091105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.346 qpair failed and we were unable to recover it. 00:27:08.346 [2024-11-20 12:54:41.091231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.091326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.346 [2024-11-20 12:54:41.091351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.091446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.091535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.091561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.091660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.091753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.091780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.091881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.091984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.092168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.092442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.092725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.092846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.092968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.093198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.093405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.093739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.093884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.093981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.094204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.094445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.094704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.094819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.094928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.095181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.095450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.347 qpair failed and we were unable to recover it. 00:27:08.347 [2024-11-20 12:54:41.095692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.347 [2024-11-20 12:54:41.095813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.095937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.096210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.096463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.096750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.096882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.096991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.097266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.097485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.097736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.097862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.097964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.098216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.098462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.098713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.098862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.098947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.099192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.099440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.099706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.099850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.099982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.100107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.100133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.100249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.100363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.100388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.348 qpair failed and we were unable to recover it. 00:27:08.348 [2024-11-20 12:54:41.100513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.348 [2024-11-20 12:54:41.100634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.100659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.100756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.100851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.100876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.100973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.101260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.101495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.101723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.101840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.101963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.102219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.102437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.102701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.102813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.102932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.103236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.103484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.103732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.103908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.103998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.104264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.104485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.104742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.104863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.104956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.105082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.105108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.349 qpair failed and we were unable to recover it. 00:27:08.349 [2024-11-20 12:54:41.105213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.349 [2024-11-20 12:54:41.105336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.105361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.105480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.105575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.105600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.105694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.105789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.105814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.105934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.106158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.106408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.106651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.106797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.106898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.107146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.107372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.107590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.107841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.107959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.108079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.108323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.108605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.108855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.108981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.109109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.109380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.109626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.109848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.109993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.110089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.110360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.110635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.110874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.110997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.111023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.111159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.111257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.111282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.350 qpair failed and we were unable to recover it. 00:27:08.350 [2024-11-20 12:54:41.111397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.350 [2024-11-20 12:54:41.111492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.111518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.111631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.111722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.111748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.111878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.111976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.112126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.112398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.112640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.112859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.112981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.113115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.113387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.113654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.113802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.113888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.114164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.114410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.114658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.114785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.114904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.115193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.115412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.115631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.115894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.115987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.116110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.116336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.116589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.351 [2024-11-20 12:54:41.116733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.351 qpair failed and we were unable to recover it. 00:27:08.351 [2024-11-20 12:54:41.116829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.116960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.116985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.117104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.117316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.117597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.117844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.117958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.118083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.118357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.118607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.118876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.118992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.119084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.119356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.119638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.119845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.119969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.120077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.120357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.120610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.352 qpair failed and we were unable to recover it. 00:27:08.352 [2024-11-20 12:54:41.120838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.352 [2024-11-20 12:54:41.120982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.121078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.121331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.121576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.121828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.121973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.122125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.122247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.122272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.122415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.122510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.122537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.122632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.122754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.122779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.122887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.123147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.123371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.123615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.123834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.123976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.124079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.124327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.124532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.124752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:08.353 [2024-11-20 12:54:41.124848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.124873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.124890] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:08.353 [2024-11-20 12:54:41.124908] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:08.353 [2024-11-20 12:54:41.124922] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:08.353 [2024-11-20 12:54:41.124971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.125056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.353 [2024-11-20 12:54:41.125086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.353 [2024-11-20 12:54:41.125006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:08.353 qpair failed and we were unable to recover it. 00:27:08.353 [2024-11-20 12:54:41.125036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:08.353 [2024-11-20 12:54:41.125188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.125063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:08.354 [2024-11-20 12:54:41.125066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:08.354 [2024-11-20 12:54:41.125289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.125313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.125443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.125566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.125591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.125693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.125789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.125814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.125950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.126234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.126506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.126729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.126846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.126939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.127166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.127395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.127637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.127857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.127980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.128082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.128334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.128553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.128822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.128940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.129036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.129143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.129171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.354 [2024-11-20 12:54:41.129279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.129369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.354 [2024-11-20 12:54:41.129396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.354 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.129519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.129643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.129670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.129792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.129876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.129901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.129993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.130233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.130487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.130730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.130844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.130949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.131196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.131437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.131663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.131879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.131997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.132123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.132348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.132629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.132865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.132989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.133112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.133211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.133237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.133333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.133435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.133460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.355 [2024-11-20 12:54:41.133585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.133676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.355 [2024-11-20 12:54:41.133701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.355 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.133798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.133919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.133944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.134037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.134269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.134514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.134755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.134872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.134972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.135209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.135444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.135665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.135794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.135891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.136138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.136356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.136583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.136851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.136969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.137054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.137301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.137513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.137742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.137863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.137968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.138088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.356 [2024-11-20 12:54:41.138114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.356 qpair failed and we were unable to recover it. 00:27:08.356 [2024-11-20 12:54:41.138205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.138333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.138359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.138464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.138567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.138592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.138689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.138809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.138835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.138922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.139186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.139453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.139669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.139845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.139941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.140205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.140421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.140644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.140874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.140998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.141149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.141370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.141611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.141841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.141955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.142048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.142148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.142178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.142283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.142374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.142399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.357 [2024-11-20 12:54:41.142497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.142615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.357 [2024-11-20 12:54:41.142640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.357 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.142737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.142858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.142883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.142999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.143242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.143447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.143678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.143801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.143905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.144137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.144380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.144605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.144849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.144975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.145076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.145336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.145549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.145769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.145920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.146015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.146257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.146491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.146741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.146891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.147036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.147164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.147190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.147294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.147394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.147420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.358 qpair failed and we were unable to recover it. 00:27:08.358 [2024-11-20 12:54:41.147541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.147674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.358 [2024-11-20 12:54:41.147699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.147794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.147886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.147912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.148013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.148254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.148534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.148757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.148872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.148975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.149234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.149458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.149690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.149804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.149901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.150147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.150392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.150607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.150885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.150981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.151106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.151326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.151534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.151754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.151883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.151974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.152218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.152448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.152691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.152804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.152925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.153157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.153366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.153609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.153835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.153954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.359 [2024-11-20 12:54:41.154059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.154207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.359 [2024-11-20 12:54:41.154232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.359 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.154329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.154451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.154476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.154571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.154665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.154691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.154785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.154937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.154963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.155050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.155312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.155514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.155754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.155930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.156050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.156281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.156530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.156741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.156890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.157015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.157246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.157488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.157698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.157817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.157944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.158170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.158407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.158638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.158762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.158889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.159130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.159380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.159620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.159864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.159979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.160131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.160346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.160590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.160806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.360 [2024-11-20 12:54:41.160952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.360 qpair failed and we were unable to recover it. 00:27:08.360 [2024-11-20 12:54:41.161042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.161311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.161597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.161826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.161943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.162042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.162303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.162560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.162833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.162945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.163064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.163302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.163519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.163756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.163879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.164009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.164245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.164465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.164699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.164817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.164923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.165197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.165444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.165678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.165822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.165916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.166172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.166404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.166631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.166875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.166998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.167119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.167344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.167566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.361 qpair failed and we were unable to recover it. 00:27:08.361 [2024-11-20 12:54:41.167833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.361 [2024-11-20 12:54:41.167927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.167952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.168049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.168283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.168527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.168776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.168891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.168985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.169228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.169482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.169755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.169894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.169986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.170220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.170438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.170670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.170878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.170977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.171111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.171329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.171601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.171860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.171972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.172060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.172337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.172560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.172802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.172926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.173043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.173304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.173580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.173783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.173898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.174018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.174104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.174130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.174260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.174358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.174383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.362 [2024-11-20 12:54:41.174508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.174594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.362 [2024-11-20 12:54:41.174619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.362 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.174710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.174792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.174817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.174915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.175142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.175386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.175602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.175839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.175955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.176053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.176290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.176529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.176746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.176859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.176986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.177274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.177504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.177713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.177843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.177927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.178181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.178393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.178607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.178812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.178924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.179047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.179311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.179570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.179846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.179957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.180057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.180207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.180232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.363 qpair failed and we were unable to recover it. 00:27:08.363 [2024-11-20 12:54:41.180327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.363 [2024-11-20 12:54:41.180414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.180444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.180535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.180619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.180643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.180770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.180870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.180895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.180992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.181287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.181497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.181718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.181831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.181952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.182222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.182458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.182733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.182846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.182945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.183200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.183422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.183621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.183852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.183976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.184126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.184331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.184541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.184785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.184898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.185021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.185248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.185452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.185664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.185789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.185879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.186153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.186362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.186599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.364 [2024-11-20 12:54:41.186859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.364 [2024-11-20 12:54:41.186980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.364 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.187075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.187302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.187524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.187761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.187884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.187967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.188239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.188443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.188659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.188777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.188874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.189178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.189409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.189615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.189853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.189977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.190124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.190335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.190601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.190813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.190962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.191052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.191300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.191511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.191725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.191868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.191955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.192209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.192446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.192694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.192814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.192946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.193195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.193433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.365 qpair failed and we were unable to recover it. 00:27:08.365 [2024-11-20 12:54:41.193675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.365 [2024-11-20 12:54:41.193769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.193795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.193894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.194173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.194388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.194598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.194835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.194987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.195112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.195327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.195556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.195807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.195932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.196030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.196341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.196556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.196778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.196895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.197017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.197271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.197536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.197786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.197907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.198000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.198252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.198471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.198708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.198859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.198958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.199216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.199448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.199659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.199878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.199995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.200112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.200204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.200231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.366 qpair failed and we were unable to recover it. 00:27:08.366 [2024-11-20 12:54:41.200356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.366 [2024-11-20 12:54:41.200480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.200505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.200594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.200721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.200746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.200869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.200982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.201127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.201372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.201619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.201866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.201987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.202113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.202395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.202597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.202817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.202963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.203058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.203275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.203545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.203794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.203950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.204039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.204268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.204515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.204751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.204873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.204963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.205198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.205411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.205664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.205871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.205986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.206085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.206319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.206545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.206771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.206890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.367 qpair failed and we were unable to recover it. 00:27:08.367 [2024-11-20 12:54:41.206988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.207076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.367 [2024-11-20 12:54:41.207101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.207201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.207324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.207349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.207454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.207552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.207578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.207673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.207768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.207793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.207919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.208239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.208451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.208694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.208838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.208963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.209202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.209416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.209680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.209884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.209978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.210101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.210336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.210555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.210786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.210902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.211029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.211249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.211495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.211705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.211823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.211923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.212195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.212401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.212664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.212780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.368 qpair failed and we were unable to recover it. 00:27:08.368 [2024-11-20 12:54:41.212932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.368 [2024-11-20 12:54:41.213016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.213195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.213408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.213639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.213756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.213907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.214125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.214359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.214594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.214808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.214931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.215047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.215274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.215483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.215694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.215899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.215995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.216154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.216353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.216600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.216814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.216922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.217019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.217244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.217449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.217720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.217837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.217926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.218191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.218441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.218643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.218909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.218996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.219021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.219114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.219215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.219241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.369 [2024-11-20 12:54:41.219338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.219454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.369 [2024-11-20 12:54:41.219478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.369 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.219580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.219701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.219726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.219811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.219907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.219931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.220049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.220314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.220547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.220768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.220885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.220983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.221227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.221483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.221694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.221854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.221943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.222158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.222400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.222617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.222846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.222965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.223064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.223289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.223488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.223728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.223854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.223957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.224234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.224502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.224752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.224893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.224991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.225241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.225494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.225714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.225862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.225953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.226054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.226084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.370 qpair failed and we were unable to recover it. 00:27:08.370 [2024-11-20 12:54:41.226183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-11-20 12:54:41.226331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.226356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.226481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.226585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.226611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.226745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.226839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.226864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.226959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.227230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.227443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.227681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.227893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.227987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.228116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.228352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.228554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.228792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.228906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.229001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.229244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.229460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.229700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.229852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.229947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.230161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.230433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.230647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.230890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.230981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.231104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.231311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.231550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.231773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.231914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.232034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.232271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.232548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.371 [2024-11-20 12:54:41.232763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-11-20 12:54:41.232883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.371 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.232969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.233194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.233402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.233669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.233782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.233898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.234139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.234387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.234647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.234882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.234998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.235109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.235320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.235554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.235774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.235901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.235992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.236239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.236463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.372 qpair failed and we were unable to recover it. 00:27:08.372 [2024-11-20 12:54:41.236702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-11-20 12:54:41.236851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.236945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.237222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.237430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.237647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.237898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.237997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.238150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.238395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.238644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.238844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.238995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.239116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.239354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.239628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.239882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.239980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.240120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.240366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.240605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.240847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.240964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.241086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.241304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.241549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.241791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.241943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.242034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.242295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.242507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.242743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.242884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.242974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.243059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.243092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.373 qpair failed and we were unable to recover it. 00:27:08.373 [2024-11-20 12:54:41.243199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.373 [2024-11-20 12:54:41.243297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.243322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.243447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.243542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.243567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.243655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.243747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.243773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.243907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.243995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.244115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.244370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.244587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.244820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.244941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.245041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.245261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.245503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.245745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.245863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.245959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.246178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.246420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.246645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.246880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.246996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.247098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.247314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.247514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.247767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.247914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.248011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.248232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.248476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.248716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.248828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.248930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.249207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.249463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.374 qpair failed and we were unable to recover it. 00:27:08.374 [2024-11-20 12:54:41.249670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.374 [2024-11-20 12:54:41.249813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.249903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.249997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.250160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.250380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.250594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.250817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.250962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.251055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.251306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.251523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.251731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.251853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.251944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.252200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.252462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.252672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.252901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.252991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.253119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.253354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.253631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.253865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.253987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.254082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.254315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.254577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.254814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.254960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.255052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.255290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.255524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.255758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.255865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.255986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.256130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.256156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.375 [2024-11-20 12:54:41.256254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.256352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.375 [2024-11-20 12:54:41.256377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.375 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.256470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.256577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.256602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.256698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.256791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.256816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.256900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.257149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.257391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.257622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.257874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.257994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.258141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.258377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.258629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.258855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.258967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.259064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.259286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.259542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.259808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.259918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.260018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.260292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.260487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.260734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.260848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.260946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.261223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.261445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.261657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.261875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.261976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.262089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.262334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.262584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.376 qpair failed and we were unable to recover it. 00:27:08.376 [2024-11-20 12:54:41.262816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.376 [2024-11-20 12:54:41.262940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.263062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.263297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.263512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.263774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.263894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.263981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.264242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.264465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.264683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.264823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.264915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.265166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.265402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.265630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.265868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.265986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.266081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.266334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.266567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.266805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.266946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.267078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.267297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.267508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.267752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.267869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.268010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.268232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.268450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.377 qpair failed and we were unable to recover it. 00:27:08.377 [2024-11-20 12:54:41.268664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.377 [2024-11-20 12:54:41.268783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.268909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.269132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.269377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.269614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.269890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.269987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.270109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.270352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.270625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.270748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.270831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.271147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.271387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.271653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.271870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.271989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.272138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.272375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.272619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.272852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.272963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.273090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.273303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.273519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.273754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.273903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.274004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.274249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.274489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.274687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.274818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.274915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.275001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.275026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.275124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.275221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.275246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.378 qpair failed and we were unable to recover it. 00:27:08.378 [2024-11-20 12:54:41.275345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.275466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.378 [2024-11-20 12:54:41.275492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.275591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.275690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.275714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.275829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.275949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.275977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.276077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.276329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.276566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.276810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.276939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.277064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.277319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.277562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.277783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.277894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.277988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.278230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.278480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.278702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.278820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.278943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.279191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.279409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.279716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.279839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.279929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.280186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.280417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.280653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.280893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.280981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.281101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.281335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.281559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.281802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.281978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.282105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.282201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.379 [2024-11-20 12:54:41.282226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.379 qpair failed and we were unable to recover it. 00:27:08.379 [2024-11-20 12:54:41.282319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.282443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.282469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.282567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.282661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.282688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.282775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.282893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.282920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.283020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.283275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.283489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.283736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.283889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.284022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.284264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.284517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.284761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.284917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.285016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.285241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.285466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.285684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.285830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.285929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.286143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.286360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.286563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.286802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.286928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.287053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.287282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.287529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.287739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.287860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.287951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.288204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.288423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.288662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.380 qpair failed and we were unable to recover it. 00:27:08.380 [2024-11-20 12:54:41.288900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.380 [2024-11-20 12:54:41.288997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.289121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.289364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.289598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.289809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.289921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.290018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.290235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.290441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.290641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.290847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.290961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.291052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.291319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.291562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.291773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.291917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.292009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.292247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.292460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.292693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.292833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.292927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.293203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.293455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.293674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.293897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.293994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.294125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.294359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.294601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.294817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.294927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.295027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.295132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.295158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.381 [2024-11-20 12:54:41.295279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.295372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.381 [2024-11-20 12:54:41.295398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.381 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.295489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.295585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.295611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.295731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.295822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.295849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.295945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.296198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.296435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.296701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.296817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.296938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.297219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.297458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.297665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.297896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.297982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.298099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.298352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.298564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.298774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.298887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.298988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.299215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.299446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.299660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.299895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.299982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.300131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.300357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.300597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.300848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.300965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.382 qpair failed and we were unable to recover it. 00:27:08.382 [2024-11-20 12:54:41.301095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.382 [2024-11-20 12:54:41.301221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.301359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.301586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.301843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.301994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.302088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.302352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.302566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.302838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.302982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.303080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.303355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.303568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.303808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.303928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.304016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.304259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.304505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.304723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.304870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.304964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.305171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.305414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.305627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.305840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.305949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.306067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.306338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.306582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.306782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.306927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.307025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.307259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.307466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.307706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.383 [2024-11-20 12:54:41.307830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.383 qpair failed and we were unable to recover it. 00:27:08.383 [2024-11-20 12:54:41.307920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.308219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.308448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.308681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.308800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.308923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.309158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.309429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.309673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.309896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.309988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.310190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.310395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.310644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.310790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.310885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.311163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.311398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.311614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.311856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.311970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.312062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.312285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.312536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.312745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.312855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.312954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.313214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.313448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.313675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.313789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.313905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.314182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.314396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.384 qpair failed and we were unable to recover it. 00:27:08.384 [2024-11-20 12:54:41.314651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.384 [2024-11-20 12:54:41.314767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.314792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.314885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.314970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.314995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.315095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.315341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.315612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.315812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.315934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.316034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.316334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.316551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.316769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.316890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.316993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.317256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.317496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.317721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.317874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.317992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.318199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.318442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.318669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.318900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.318986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.319109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.319333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.319550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.319758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.319899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.320017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.320234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.320439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.320654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.320763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.320913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.321004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.321029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.321128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.321250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.385 [2024-11-20 12:54:41.321276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.385 qpair failed and we were unable to recover it. 00:27:08.385 [2024-11-20 12:54:41.321401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.321494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.321519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.321638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.321724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.321750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.321874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.321973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.321998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.322098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.322333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.322591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.322806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.322925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.323023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.323236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.323447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.323695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.323846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.323942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.324175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.324397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.324646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.324862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.324987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.325104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.325343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.325556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.325759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.325871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.326001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.326235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.326479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.326720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.326838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.326952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.327078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.327110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.386 qpair failed and we were unable to recover it. 00:27:08.386 [2024-11-20 12:54:41.327234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.386 [2024-11-20 12:54:41.327327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.327353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.327445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.327569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.327594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.327690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.327789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.327816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.327913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.328168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.328435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.328640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.328779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.328904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.329130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.329340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.329585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.329833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.329987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.330082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.330313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.330556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.330773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.330893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.330987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.331197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.331476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.331744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.331864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.331978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.332232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.332475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.332744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.332858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.332982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.333224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.333474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.333719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.333867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.333959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.334083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.334110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.334200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.334321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.387 [2024-11-20 12:54:41.334347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.387 qpair failed and we were unable to recover it. 00:27:08.387 [2024-11-20 12:54:41.334465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.334558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.334585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.334677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.334769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.334795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.334923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.335175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.335388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.335656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.335868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.335990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.336110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.336361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.336628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.336854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.336977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.337101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.337337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.337551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.337792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.337913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.337999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.338263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.338471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.338689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.338836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.338959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.339234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.339469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.339682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.339804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.339897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.340173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.340406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.340614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.340822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.340967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.341090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.341181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.341207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.341292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.341391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.341416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.388 [2024-11-20 12:54:41.341545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.341665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.388 [2024-11-20 12:54:41.341692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.388 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.341808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.341903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.341928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.342054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.342287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.342505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.342744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.342871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.342992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.343235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.343448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.343667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.343793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.343888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.344158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.344372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.344610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.344830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.344979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.345074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.345319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.345515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.345791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.345908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.346001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.346238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.346487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.346697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.346846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.346933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.347189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.347398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.347596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.347870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.347991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.348085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.348302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd850000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.348525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.389 qpair failed and we were unable to recover it. 00:27:08.389 [2024-11-20 12:54:41.348761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.389 [2024-11-20 12:54:41.348879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.349087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.349285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.349309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.349413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.349537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.349562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.349651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.349766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.349792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.349912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.350167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.350396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.350616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.350833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.350951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.351045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.351289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.351556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.351766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.351891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.351991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.352223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.352482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.352688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.352903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.352998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.353154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.353391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.353639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.353885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.353988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.354106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.354338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.354557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.354709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.354909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.355157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.355363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.355568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.355800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.355914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.356039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.356158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.356184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.390 qpair failed and we were unable to recover it. 00:27:08.390 [2024-11-20 12:54:41.356284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.390 [2024-11-20 12:54:41.356481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.356507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.356624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.356719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.356744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.356870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.356968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.356994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.357097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.357310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.357650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.357864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.357990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.358090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.358325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.358581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.358797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.358947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.359048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.359280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.359499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.359714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.359836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.359919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.360173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.360427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.360745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.360887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.360977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.361236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.361471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.361663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.361880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.361993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.362095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.362372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.362582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.362774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.391 [2024-11-20 12:54:41.362886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.391 qpair failed and we were unable to recover it. 00:27:08.391 [2024-11-20 12:54:41.363006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.363296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.363552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.363834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.363982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.364085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.364301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.364523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.364726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.364868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.364963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.365219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.365434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.365648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.365850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.365970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.366096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.366343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.366588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.366812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.366956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.367061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.367290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.367507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.367736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.367877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.367979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.368229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.368497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.368753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.368876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.368975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.369179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.369422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.369642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.369860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.392 [2024-11-20 12:54:41.369980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.392 qpair failed and we were unable to recover it. 00:27:08.392 [2024-11-20 12:54:41.370082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.370303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.370546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.370759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.370875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.370991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.371233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.371451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.371668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.371908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.371997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.372120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.372354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.372595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.372717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.372806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.373126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.373378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.373590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.373860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.373982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.374103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.374373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.374597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.374807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.374953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.375078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.375363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.375605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.375843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.375964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.376058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.376175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.376200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.376296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.376413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.376438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.376538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.376737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.376763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.376861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.377129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.377350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.377587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.393 qpair failed and we were unable to recover it. 00:27:08.393 [2024-11-20 12:54:41.377784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.393 [2024-11-20 12:54:41.377922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.378017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.378273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.378488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.378692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.378809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.378910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.379163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.379510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.379781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.379896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.380100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.380360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.380591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.380848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.380968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.381097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.381310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.381550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.381771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.381886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.382011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.382250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.382465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.382742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.382860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.382947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.383159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.383374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.383591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.383802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.383913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.384009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.384251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.384570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.384846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.384962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.385091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.385351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.385566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.394 [2024-11-20 12:54:41.385839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.394 [2024-11-20 12:54:41.385957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.394 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.386055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.386309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.386518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.386722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.386836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.386930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.387166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.387429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.387673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.387787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.387910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.388161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.388446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.388652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.388795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.388914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.389150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.389366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.389620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.389897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.389993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.390110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.390383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.390594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.390831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.390988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.395 [2024-11-20 12:54:41.391084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.391190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.395 [2024-11-20 12:54:41.391217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.395 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.391351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.391451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.391476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.391566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.391662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.391688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.391782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.391915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.391940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.392032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.392280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.392499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.392759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.392879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.392983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.393230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.393497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.393739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.393858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.393951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.394203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.394442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.394678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.394787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.394903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.395146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.395371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.395599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.395805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.395929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.396030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.396275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.396514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.396756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.396879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.396978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.397237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.397451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.397685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.396 [2024-11-20 12:54:41.397798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.396 qpair failed and we were unable to recover it. 00:27:08.396 [2024-11-20 12:54:41.397918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.398163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.398397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.398608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.398833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.398974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.399123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.399323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.399541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.399741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.399891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.400010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.400239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.400493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.400700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.400842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.400971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.401207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.401409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.401624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.401863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.401979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.402066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.402280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.402491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.402751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.402899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.403015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.403228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.403471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.403697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.403823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.403923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.404018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.404044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.404206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.404330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.404356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.397 qpair failed and we were unable to recover it. 00:27:08.397 [2024-11-20 12:54:41.404478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.404577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.397 [2024-11-20 12:54:41.404602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.404719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.404818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.404843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.404965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.405188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.405440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.405685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.405808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.405902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.406156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.406383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.406600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.406814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.406920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.407013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.407232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.407488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.407722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.407845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.407964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.408218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.408512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.408728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.408868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.408960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.409187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.409460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.409701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.409818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.409925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.410185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.410425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.410627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.410742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.410864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.411010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.411035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.411142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.411230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.398 [2024-11-20 12:54:41.411256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.398 qpair failed and we were unable to recover it. 00:27:08.398 [2024-11-20 12:54:41.411351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.411447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.411473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.411609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.411700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.411726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.411840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.411944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.411969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.412088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.412308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.412522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.412768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.412948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.413075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.413316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.413567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.413849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.413970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.414091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.414339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.414535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.414747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.414862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.414953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.415177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.415439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.415687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.415808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.415931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.416180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.416396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.416613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.416843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.416990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.399 qpair failed and we were unable to recover it. 00:27:08.399 [2024-11-20 12:54:41.417093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.417214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.399 [2024-11-20 12:54:41.417240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.417333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.417426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.417451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.417558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.417650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.417675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.417770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.417861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.417886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.418005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.418268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.418494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.418696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.418818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.418911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.419156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.419378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.419594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.419832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.419949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.420053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.420288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.420501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.420700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.420818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.420939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.421167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.421404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.421618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.421862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.421974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.422101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.422310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.422551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.422793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.422912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.422998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.423088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.423114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.423248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.423342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.423368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.400 qpair failed and we were unable to recover it. 00:27:08.400 [2024-11-20 12:54:41.423460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.400 [2024-11-20 12:54:41.423550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.423575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.423670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.423789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.423815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.423915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.424140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.424376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.424622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.424891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.424995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.425110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.425334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.425552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.401 [2024-11-20 12:54:41.425795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.401 [2024-11-20 12:54:41.425910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.401 qpair failed and we were unable to recover it. 00:27:08.686 [2024-11-20 12:54:41.425999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.686 qpair failed and we were unable to recover it. 00:27:08.686 [2024-11-20 12:54:41.426222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.686 qpair failed and we were unable to recover it. 00:27:08.686 [2024-11-20 12:54:41.426446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.686 qpair failed and we were unable to recover it. 00:27:08.686 [2024-11-20 12:54:41.426692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.686 [2024-11-20 12:54:41.426831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.426923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.427139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.427409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.427640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.427874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.427995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.428122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.428358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.428587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.428809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.428931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.429047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.429291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.429554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.429774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.429920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.430007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.430222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.430431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.430660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.430801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.430894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.431021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.431045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.431156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.431250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.431276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.687 qpair failed and we were unable to recover it. 00:27:08.687 [2024-11-20 12:54:41.431378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.687 [2024-11-20 12:54:41.431472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.431497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.431614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.431730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.431755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.431881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.431972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.431996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.432095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.432348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.432564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.432800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.432941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.433038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.433265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.433505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.433704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.433821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.433949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.434194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.434399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.434622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.434840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.434955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.435053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.435311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.435511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.435738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.688 [2024-11-20 12:54:41.435861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.688 qpair failed and we were unable to recover it. 00:27:08.688 [2024-11-20 12:54:41.435981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.436186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.436413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.436682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.436897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.436993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.437155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.437367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.437574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.437820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.437968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.438054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.438335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.438550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.438805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.438928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.439058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.439292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.439533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.439781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.439896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.439994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.440114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.440140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.440226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.440321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.440347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.689 qpair failed and we were unable to recover it. 00:27:08.689 [2024-11-20 12:54:41.440448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.440576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.689 [2024-11-20 12:54:41.440602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.440706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.440797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.440822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.440913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.441158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.441384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.441648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.441889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.441988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.442103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.442349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.442586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.442808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.442919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.443009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.443276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.443479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.443712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.443855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.443954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.444179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.444414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.444625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.444868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.444990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.445015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.690 qpair failed and we were unable to recover it. 00:27:08.690 [2024-11-20 12:54:41.445112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.690 [2024-11-20 12:54:41.445201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.445325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.445556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.445805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.445926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.446019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.446282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.446514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.446722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.446863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.446984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.447208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.447425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.447634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.447781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.447928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.448164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.448397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.448614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.448882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.448975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.449098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.449350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.691 [2024-11-20 12:54:41.449567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.691 [2024-11-20 12:54:41.449677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.691 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.449773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.449896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.449921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.450026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.450234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.450478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.450719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.450845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.450941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.451218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.451425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.451643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.451792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.451913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.452133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.452388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.452602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.452813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.452926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.453025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.453269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.453476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.453691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.453803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.453893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.454017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.454043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.692 qpair failed and we were unable to recover it. 00:27:08.692 [2024-11-20 12:54:41.454152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.692 [2024-11-20 12:54:41.454241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.454361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.454568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.454839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.454951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.455037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.455268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.455478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.455682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.455792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.455886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.456127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.456351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.456577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.456816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.456941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.457030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.457143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.457169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.457269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.457363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.457388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.693 [2024-11-20 12:54:41.457487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.457586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.693 [2024-11-20 12:54:41.457611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.693 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.457742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.457862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.457887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.458005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.458233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.458477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.458723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.458834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.458934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.459148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.459388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.459586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.459813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.459924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.460045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.460293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.460491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.460736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.460874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.460967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.461212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.461431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.461648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.461856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.461973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.694 qpair failed and we were unable to recover it. 00:27:08.694 [2024-11-20 12:54:41.462116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.462211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.694 [2024-11-20 12:54:41.462238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.462334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.462456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.462481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.462580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.462667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.462692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.462778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.462860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.462884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.462974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.463213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.463458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.463653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.463852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.463976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.464065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.464280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.464530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.464773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.464890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.464973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.465206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.465413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.465647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.465857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.465999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.466101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.466239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.466265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.466357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.466447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.466473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.695 qpair failed and we were unable to recover it. 00:27:08.695 [2024-11-20 12:54:41.466564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.695 [2024-11-20 12:54:41.466684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.466709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.466806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.466900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.466924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.467044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.467274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.467556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.467754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.467897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.468017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.468237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.468483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.468684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.468805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.468905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.469132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.469359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.469577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.469836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.469943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.470039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.470292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.470510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.470789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.470911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.471010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.471115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.696 [2024-11-20 12:54:41.471140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.696 qpair failed and we were unable to recover it. 00:27:08.696 [2024-11-20 12:54:41.471232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.471464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.471677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.471881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.471995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.472109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.472338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.472571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.472774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.472923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.473022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.473243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.473456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.473677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.473822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.473923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.474198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.474421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.474650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.474880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.474996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.475153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.475373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.697 [2024-11-20 12:54:41.475567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.697 [2024-11-20 12:54:41.475687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.697 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.475777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.475876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.475903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.476003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.476246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.476477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.476735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.476879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.476973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.477203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.477403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.477642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.477856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.477972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.478073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.478289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.478526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.478755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.478867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.478984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.479234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.479443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.479734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.479849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.479947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.480064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.480095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.698 qpair failed and we were unable to recover it. 00:27:08.698 [2024-11-20 12:54:41.480192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.698 [2024-11-20 12:54:41.480289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.480314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.480435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.480561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.480586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.480674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.480763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.480789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.480916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.481168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.481373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.481603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.481824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.481943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.482027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.482295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.482517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.482738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.482880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.482974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.483242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.483450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.483649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.483884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.483977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.484126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.484370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.699 qpair failed and we were unable to recover it. 00:27:08.699 [2024-11-20 12:54:41.484598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.699 [2024-11-20 12:54:41.484742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.484833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.484947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.484972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.485063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.485282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.485483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.485681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.485893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.485985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.486118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.486372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.486613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.486817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.486943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.487061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.487285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.487512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.487750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.487865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.487964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.488089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.488115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.700 qpair failed and we were unable to recover it. 00:27:08.700 [2024-11-20 12:54:41.488246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.488335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.700 [2024-11-20 12:54:41.488359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.488449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.488543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.488569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.488665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.488763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.488790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.488883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.488972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.488997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.489087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.489289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.489532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.489772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.489894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.489998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.490198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.490431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.490638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.490899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.490987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.491135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.491368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.491635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.491828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.491972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.492079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.492291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.492535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.701 qpair failed and we were unable to recover it. 00:27:08.701 [2024-11-20 12:54:41.492748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.701 [2024-11-20 12:54:41.492837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.492862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.492961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.493217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.493456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.493696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.493818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.493916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.494183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.494393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.494602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.494833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.494982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.495122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.495320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.495528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.495766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.495906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.495995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.496241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.496460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.496662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.496783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.496876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.497001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.497027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.497130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.497248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.702 [2024-11-20 12:54:41.497273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.702 qpair failed and we were unable to recover it. 00:27:08.702 [2024-11-20 12:54:41.497358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.497455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.497480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.497570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.497687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.497712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.497793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.497883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.497908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.498020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.498271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.498484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.498701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.498904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.498994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.499112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.499325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.499528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.499737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.499882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.499973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.500221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.500466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.500667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.500789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.500885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.501145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.501380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.703 [2024-11-20 12:54:41.501624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.703 [2024-11-20 12:54:41.501762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.703 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.501863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.501958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.501982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.502072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.502296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.502531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.502772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.502881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.502970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.503264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.503481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.503713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.503837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.503925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.504136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.504353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.504552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.504783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.504929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.505016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.505260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.505507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.505738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.505850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.505967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.506064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.506100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.506194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.506314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.506339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.704 qpair failed and we were unable to recover it. 00:27:08.704 [2024-11-20 12:54:41.506468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.704 [2024-11-20 12:54:41.506559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.506584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.506684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.506773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.506797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.506924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.507208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.507426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.507661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.507858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.507978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.508081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.508318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.508568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.508797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.508967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.509058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.509277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.509500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.509735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.509854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.509999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.510238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.510447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.510653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.510908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.510994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.511018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.511124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.511248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.511273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.705 [2024-11-20 12:54:41.511359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.511457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.705 [2024-11-20 12:54:41.511482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.705 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.511572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.511662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.511686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.511779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.511899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.511924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.512015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.512222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.512490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.512693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.512899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.512992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.513124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.513349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.513584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.513802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.513951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.514049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.514258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.514465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.514704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.514825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.514921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.515010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.515035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.515151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.515244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.515271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.515365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.515450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.706 [2024-11-20 12:54:41.515476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.706 qpair failed and we were unable to recover it. 00:27:08.706 [2024-11-20 12:54:41.515595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.515689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.515715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.515804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.515896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.515921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.516014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.516257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.516454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.516670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.516809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.516900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.517175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.517392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.517632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.517843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.517991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.518084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.518296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.518525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.518743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.518862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.518951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.519192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.519412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.519629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.519838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.519952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.520041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.520184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.520210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.707 qpair failed and we were unable to recover it. 00:27:08.707 [2024-11-20 12:54:41.520306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.707 [2024-11-20 12:54:41.520393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.520417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.520511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.520634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.520658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.520748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.520870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.520896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.520993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.521264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.521468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.521666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.521806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.521919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.522173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.522399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.522622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.522817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.522975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.523105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.523354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.523585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.523781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.523893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.523988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.524198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.524438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.524643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.524842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.524991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.708 qpair failed and we were unable to recover it. 00:27:08.708 [2024-11-20 12:54:41.525103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.525194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.708 [2024-11-20 12:54:41.525219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.525334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.525430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.525456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.525573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.525665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.525691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.525784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.525879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.525904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.526029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.526295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.526544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.526787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.526928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.527022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.527232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.527471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.527724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.527832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.527949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.528194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.528401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.528603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.528802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.528944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.529033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.529280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.529593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.529789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.529931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.709 [2024-11-20 12:54:41.530021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.530121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.709 [2024-11-20 12:54:41.530147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.709 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.530347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.530445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.530471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.530592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.530714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.530739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.530832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.530919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.530944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.531040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.531254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.531500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.531738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.531907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.532025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.532275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.532493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.532698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.532814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.532931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.533166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.533401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.533646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.533842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.533966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.534089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.534306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.534571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.534812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.534963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.535078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.535176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.535201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.535291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.535387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.535414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.710 [2024-11-20 12:54:41.535508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.535623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.710 [2024-11-20 12:54:41.535648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.710 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.535737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.535818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.535843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.535945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.536200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.536436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.536682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.536914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.536999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.537152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.537365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.537571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.537805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.537927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.538022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.538269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.538500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.538715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.538830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.538945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.539209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.539469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.539727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.539847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.539983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.540245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.540451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.540660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.540780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.711 [2024-11-20 12:54:41.540864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.541016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.711 [2024-11-20 12:54:41.541041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.711 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.541133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.541335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.541593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.541828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.541933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.542054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.542312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.542523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.542757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.542869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.542988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.543227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.543498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.543692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.543805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.543919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.544168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.544398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.544626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.544836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.544949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.545061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.545183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.545208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.545296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.545382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.545407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.545539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.545625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.712 [2024-11-20 12:54:41.545656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.712 qpair failed and we were unable to recover it. 00:27:08.712 [2024-11-20 12:54:41.545745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.545861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.545886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.546000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.546245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.546453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.546672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.546904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.546990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.547111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.547349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.547582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.547788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.547916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.548009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.548247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.548481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.548698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.548838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.548960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.549211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.549448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.549663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.549804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.549928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.550146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.550365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.550575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.550817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.550931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.551047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.551174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.713 qpair failed and we were unable to recover it. 00:27:08.713 [2024-11-20 12:54:41.551269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.713 [2024-11-20 12:54:41.551416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.551440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.551523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.551614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.551639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.551731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.551815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.551840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.551937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.552166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.552374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.552593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.552807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.552948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.553035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.553315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.553544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.553759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.553875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.553991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.554197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.554409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.554617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.554828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.554979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.555100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.555320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.555532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.555740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.555855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.555945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.556153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.556392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.714 [2024-11-20 12:54:41.556590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.714 [2024-11-20 12:54:41.556732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.714 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.556849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.556935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.556960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.557060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.557268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.557508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.557747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.557868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.557988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.558216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.558420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.558683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.558805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.558901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 A controller has encountered a failure and is being reset. 00:27:08.715 [2024-11-20 12:54:41.559170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.559416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.559630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.559863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.559998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.560087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.560318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.560550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.560755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.560896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.561026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.561270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.561486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.561735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.561849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.561957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.562081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.562107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.562191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.562312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.562336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.715 qpair failed and we were unable to recover it. 00:27:08.715 [2024-11-20 12:54:41.562432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.715 [2024-11-20 12:54:41.562519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.562545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.562640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.562755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.562780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.562878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.562968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.562992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.563109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.563309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.563522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.563754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.563871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.563972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.564233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.564447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.564668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.564813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.564933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.565153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.565389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.565591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.565831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.565948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.566039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.566265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.566473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.566746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.566889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.566980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.567239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.567441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.567688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.567803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.567923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.568013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.716 [2024-11-20 12:54:41.568037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.716 qpair failed and we were unable to recover it. 00:27:08.716 [2024-11-20 12:54:41.568144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.568410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.568652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.568880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.568996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.569114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.569323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.569527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.569763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.569935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.570030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.570256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.570462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.570674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.570816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.570915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.571167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.571409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.571640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.571904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.571990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.572136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.572375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.572642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.572843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.572961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.717 qpair failed and we were unable to recover it. 00:27:08.717 [2024-11-20 12:54:41.573052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.573151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.717 [2024-11-20 12:54:41.573176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.573272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.573365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.573390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.573481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.573599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.573624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.573729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.573824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.573849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.573975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.574186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.574464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.574670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.574908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.574994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.575138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.575381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.575619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.575864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.575978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.576100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.576303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.576506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.576704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.576821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.576939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.577160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.577371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.577603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.577846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.577965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.578086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.578332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.578569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.578782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.578926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.718 [2024-11-20 12:54:41.579020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.579114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.718 [2024-11-20 12:54:41.579140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.718 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.579234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.579318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.579343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.579427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.579566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.579591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.579713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.579801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.579826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.579911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.580156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.580366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.580608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.580812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.580921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.581019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.581235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.581469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.581674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.581875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.581991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.582082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.582281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.582505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.582710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.582818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.582913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.583151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.583354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.583608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.583814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.583932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.584055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.584270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.584471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.584682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.584806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.584923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.585006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.585032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.719 qpair failed and we were unable to recover it. 00:27:08.719 [2024-11-20 12:54:41.585130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.585226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.719 [2024-11-20 12:54:41.585251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.585340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.585431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.585457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.585576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.585660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.585685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.585774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.585859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.585884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.585980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.586218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.586434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.586668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.586908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.586990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.587106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.587301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.587547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.587786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.587901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.587995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.588210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.588476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.588680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.588914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.588998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.589127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.589335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.589569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.589805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.589922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.590011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.590212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.590443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.590657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.590878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.590988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.591085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.591205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.591230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.720 qpair failed and we were unable to recover it. 00:27:08.720 [2024-11-20 12:54:41.591319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.720 [2024-11-20 12:54:41.591431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.591456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.591577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.591675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.591700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.591792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.591889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.591913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.592011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.592217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.592430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.592669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.592878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.592977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.593117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.593325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.593540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.593765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.593875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.593998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.594229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.594433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.594640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.594887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.594997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.595088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.595298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.595501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.595732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.595868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.595990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.596216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.596414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.596652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.596858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.596996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.597092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.597181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.597206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.597300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.597385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.597409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.721 qpair failed and we were unable to recover it. 00:27:08.721 [2024-11-20 12:54:41.597500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.721 [2024-11-20 12:54:41.597595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.597622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.597714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.597796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.597821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.597918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.598156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.598396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.598607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.598831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.598948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.599039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.599251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.599457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.599664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.599885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.599996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.600115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.600330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.600574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.600866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.600971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.601094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.601302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.601503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.601719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.601859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.601950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.602177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.602397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.602600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.722 qpair failed and we were unable to recover it. 00:27:08.722 [2024-11-20 12:54:41.602810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.722 [2024-11-20 12:54:41.602892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.602917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.603041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.603292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.603499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.603763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.603874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.603969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.604195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.604408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.604604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.604823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.604968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.605059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.605292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.605505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.605755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.605868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.605959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.606179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.606443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.606688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.606904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.606996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.607142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.607362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.607594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.607831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.607945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.608042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.608278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.608523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.608725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.608837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.608919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.609153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.609385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.609658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.609774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.609926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.610137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.610365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.723 qpair failed and we were unable to recover it. 00:27:08.723 [2024-11-20 12:54:41.610593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.723 [2024-11-20 12:54:41.610692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.610717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.610802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.610896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.610920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.611050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.611258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.611507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.611724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.611838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.611940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.612182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.612400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.612607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.612875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.612985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.613075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.613288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.613509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.613751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.613872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.613960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.614225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.614470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.614674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.614840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.614933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.615154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.615396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.615608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.615851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.615969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.616057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.616305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.616569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.616772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.616922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.617010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.617216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.617491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.617736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.617848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.617941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.618182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.618388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.618628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.618865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.618981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.619100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.619323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.619526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.619757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.619866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.619954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.620046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.620076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.620166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.620264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.620289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.724 qpair failed and we were unable to recover it. 00:27:08.724 [2024-11-20 12:54:41.620382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.724 [2024-11-20 12:54:41.620494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.620519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.620614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.620711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.620740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.620831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.620912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.620936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.621025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.621264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.621459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.621692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.621799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.621892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.622161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.622425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.622629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.622854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.622975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.623078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.623278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.623507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.623740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.623847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.623947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.624209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.624448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.624667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.624793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.624921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.625161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.625382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.625594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.625824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.625975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.626061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.626338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.626570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.626806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.626923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.627047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.627294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.627503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.627742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.627852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.627950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.628179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.628420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.628631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.628863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.628970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.629118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.629211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.629235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.725 qpair failed and we were unable to recover it. 00:27:08.725 [2024-11-20 12:54:41.629349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.629431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.725 [2024-11-20 12:54:41.629456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.629557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.629649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.629675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.629789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.629903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.629928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.630021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.630242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.630482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.630696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.630901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.630997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.631123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.631398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.631657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.631890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.631979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.632097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.632305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.632531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.632740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.632878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.632965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.633191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.633458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.633691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.633802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.633916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.634161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.634394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.634627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.634888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.634977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.635093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.635326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.635593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.635793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.635917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.636031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.636245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.636475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.636716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.636832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.636932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.637213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.637429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.637657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.637871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.637989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.638108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.638346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.638585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.638819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.638934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.726 [2024-11-20 12:54:41.639025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.639117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.726 [2024-11-20 12:54:41.639144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.726 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.639259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.639359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.639384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.639480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.639619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.639645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.639794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.639916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.639942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.640029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.640250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.640485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.640726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.640846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.640939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.641151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.641395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.641640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.641870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.641986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.642080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.642308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.642542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.642751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.642892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.643008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.643242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.643505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.643709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.643854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.643952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.644200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.644439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.644661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.644782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.644901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.645151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.645353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.645629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.645869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.645992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.646109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.646344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.646593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.646798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.646907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.647024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.647239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.647465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.647703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.647847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.647932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.648155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.648364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.648610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.727 qpair failed and we were unable to recover it. 00:27:08.727 [2024-11-20 12:54:41.648874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.727 [2024-11-20 12:54:41.648965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.648990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.649123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.649326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.649565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.649795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.649911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.649997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.650257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.650498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.650696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.650820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.650909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.651122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.651331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.651575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.651779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.651900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.652017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.652221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.652441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.652730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.652839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.652932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.653146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.653391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.653615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.653833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.653985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.654079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.654322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.654554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.654795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.654904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.655024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.655258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.655456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.655708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.655855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.655945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.656195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.656417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.656652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.656891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.656975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.657103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.657343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.657567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.657760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.657885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.657980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.658079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.658105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.658220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.658318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.658342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.658433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.658560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.728 [2024-11-20 12:54:41.658584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.728 qpair failed and we were unable to recover it. 00:27:08.728 [2024-11-20 12:54:41.658673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.658799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.658825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.658919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.659134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.659346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.659573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.659782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.659956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.660040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.660249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.660446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.660689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.660837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.660921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.661191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.661400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.661636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.661846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.661997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.662093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.662294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.662599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.662798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.662945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.663036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.663275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.663498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.663717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.663832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.663926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.664130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.664329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.664568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.664763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.664905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.665022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.665233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.665441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.665666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.665789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.665872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.666127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.666345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.666576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.666788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.666935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.667028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.667131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.667157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.729 qpair failed and we were unable to recover it. 00:27:08.729 [2024-11-20 12:54:41.667244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.667333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.729 [2024-11-20 12:54:41.667357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.667451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.667577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.667601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.667692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.667786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.667811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.667925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.668195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.668407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.668682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.668892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.668985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.669105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.669361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.669566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.669812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.669958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.670050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.670266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.670473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.670674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.670818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.670936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.671156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.671360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.671592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.671800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.671915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.672014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.672261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.672474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.672680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.672886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.672996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.673095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.673304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.673547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.673772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.673889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.673985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.674190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.674434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.674638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.674875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.674990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.675109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.675316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.675534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.675736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.675885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.676009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.676214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.676428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.676654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.730 qpair failed and we were unable to recover it. 00:27:08.730 [2024-11-20 12:54:41.676909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.730 [2024-11-20 12:54:41.676997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.677124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.677348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.677580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.677848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.677968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.678062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.678316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.678516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.678759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.678897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.678990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.679225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.679437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.679635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.679838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.679984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.680075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.680312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.680555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.680758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.680875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.680961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.681209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.681464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.681697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.681842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.681959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.682180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.682410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.682609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.682838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.682965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.683055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.683329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.683538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.683747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.683855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.683949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.684226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.684426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.684657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.684772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.684859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.685118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.685363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.685559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.685753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.685862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.685961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.686055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.686086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.686184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.686301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.686326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.686419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.686510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.731 [2024-11-20 12:54:41.686536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.731 qpair failed and we were unable to recover it. 00:27:08.731 [2024-11-20 12:54:41.686688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.686784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.686809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.686936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.687162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.687399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.687635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.687865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.687986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.688076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.688319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.688553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.688794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.688904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.688985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.689290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.689495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.689766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.689882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.690031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.690251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.690455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.690703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.690820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.690910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.691125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.691342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.691578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.691780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.691921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.692074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.692288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.692500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.692727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.692846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.692984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.693205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.693523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.693727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.693847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.693965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.694185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.694457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.694673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.694872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.694991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.695082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.695199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.695225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.732 qpair failed and we were unable to recover it. 00:27:08.732 [2024-11-20 12:54:41.695307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.732 [2024-11-20 12:54:41.695403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.695428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.695522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.695635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.695660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.695759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.695851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.695877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.695971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.696182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.696383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.696598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.696803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.696942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.697035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.697315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.697532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.697761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.697872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.697967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.698218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.698457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.698667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.698874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.698991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.699102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.699320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.699539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.699734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.699886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.699970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.700184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.700389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.700646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.700854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.700993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.701096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.701309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.701570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.701777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.701886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.702016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.702255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.702457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.702719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.702868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.702962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.703192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.703405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.703648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.703855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.703999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.704086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.704283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.704536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.704749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.733 [2024-11-20 12:54:41.704863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.733 qpair failed and we were unable to recover it. 00:27:08.733 [2024-11-20 12:54:41.704950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.705222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.705468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.705733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.705848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.705971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.706187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.706396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.706631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.706863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.706982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.707103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.707311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.707546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.707753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.707894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.707986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.708211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.708448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.708663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.708808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.708936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.709180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.709392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.709629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.709897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.709988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.710109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.710321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.710533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.710776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.710888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.710976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.711214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.711444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.711654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.711862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.711981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.712094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.712304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.712519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.712729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.712881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.712977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.713206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.713418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.713608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.713821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.713939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.714024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.714115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.714141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.714255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.714348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.714373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.734 qpair failed and we were unable to recover it. 00:27:08.734 [2024-11-20 12:54:41.714488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.714579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.734 [2024-11-20 12:54:41.714605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.714722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.714803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.714828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.714957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.715181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.715398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.715597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.715804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.715953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.716045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.716254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.716461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.716686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.716809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.716937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.717167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.717407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.717639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.717852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.717993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.718082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.718319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.718547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.718790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.718907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.719000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.719213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.719427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.719646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.719847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.719960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.720051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.720276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.720506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.735 qpair failed and we were unable to recover it. 00:27:08.735 [2024-11-20 12:54:41.720715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.735 [2024-11-20 12:54:41.720830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.720854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.720948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.721208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.721433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.721674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.721800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.721920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.722132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.722360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.722625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.722864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.722986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.723085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.723327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.723538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.723748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.723885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.724005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.724223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.724458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.724699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.724906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.724989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.725116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.725325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.725557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.725785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.725925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.726043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.726252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.726456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.726689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.726832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.726925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.727138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.727383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.727600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.727839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.727956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.728083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.728301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.728543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.728813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.728928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.729016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.729260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.729481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.729711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.729831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.729948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.730038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.730063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.730157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.730252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.730277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.736 [2024-11-20 12:54:41.730364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.730462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.736 [2024-11-20 12:54:41.730488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.736 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.730590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.730674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.730698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.730831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.730919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.730949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.731045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.731287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.731498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.731728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.731844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.731933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.732138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.732338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.732568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.732798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.732940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.733030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.733279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.733538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.733797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.733913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.734002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.734209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.734416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.734626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.734780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.734899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.735141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.735386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.735623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.735839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.735957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.736043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.736248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.736445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.736674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.736897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.736980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.737101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.737327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.737533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.737750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.737895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.737987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.738226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.738426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.738718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.738914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.738996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.739210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.739415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.739669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.737 [2024-11-20 12:54:41.739810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.737 qpair failed and we were unable to recover it. 00:27:08.737 [2024-11-20 12:54:41.739899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.739999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.740118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.740384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.740594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.740823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.740942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.741036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.741334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.741536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.741770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.741909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.741998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.742230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.742476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.742671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.742891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.742999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.743106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.743320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.743541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.743778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.743918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.744008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.744222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.744432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.744646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.744870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.744993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.745113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.745320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.745560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.745823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.745938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.746030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.746272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.746479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.746681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.746787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.746908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.747172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.747391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.747618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.747834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.747945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.748049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.748143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.748169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.748263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.748386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.748411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.738 [2024-11-20 12:54:41.748497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.748590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.738 [2024-11-20 12:54:41.748616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.738 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.748705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.748822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.748849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.748972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.749188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.749405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.749610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.749817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.749937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.750063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.750276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.750481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.750738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.750852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.750939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.751211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.751410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.751653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.751862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.751982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.752102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.752312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.752516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.752780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.752902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.752997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.753200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.753450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.753656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.753869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.753989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.754095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.754298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.754538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.754746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.754892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.754988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.755233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.755460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.755751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.755871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.755959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.756225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.756436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.756663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.756776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.756925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd85c000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.757204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.757471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.757706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.757849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.757967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.758062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.758096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.758217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.758304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.758330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.739 [2024-11-20 12:54:41.758434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.758555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.739 [2024-11-20 12:54:41.758582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.739 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.758678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.758798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.758823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.758915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.759169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.759421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.759634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.759845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.759987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.760106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.760326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.760602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.760843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.760967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.761062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.761318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.761534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.761796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.761915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.762011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.762221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.762489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.762750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.762865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.762987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.763222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.763442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.763690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.763895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.763989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.764124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.764371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.764628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.764835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.764945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.765034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.765249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.765521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.765775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.765917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.766018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.766231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.766530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:08.740 [2024-11-20 12:54:41.766742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.740 [2024-11-20 12:54:41.766866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:08.740 qpair failed and we were unable to recover it. 00:27:09.026 [2024-11-20 12:54:41.766964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.026 qpair failed and we were unable to recover it. 00:27:09.026 [2024-11-20 12:54:41.767202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.026 qpair failed and we were unable to recover it. 00:27:09.026 [2024-11-20 12:54:41.767428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.026 qpair failed and we were unable to recover it. 00:27:09.026 [2024-11-20 12:54:41.767739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.767855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.026 qpair failed and we were unable to recover it. 00:27:09.026 [2024-11-20 12:54:41.767943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.026 [2024-11-20 12:54:41.768034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.768172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.768394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.768600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.768842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.768959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.769058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.769306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.769603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.769814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.769960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.770057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.770275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.770522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.770748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.770887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.771011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.771224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.771429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.771659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.771898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.771993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.772109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.772361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.772609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.772828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.772945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.773038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.773269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.773497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.773730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.773878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.773999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.774089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.774115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.774208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.774299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.774325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.027 qpair failed and we were unable to recover it. 00:27:09.027 [2024-11-20 12:54:41.774449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.027 [2024-11-20 12:54:41.774547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.774573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.774699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.774815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.774840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.774929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.775167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.775381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.775617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.775826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.775948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.776076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.776284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.776524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.776728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.776836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.776919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.777163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.777378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.777639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.777845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.777978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.778067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.778290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.778576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.778780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.778904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.779034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.779282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.779531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.779805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.779930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.780033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.780282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.780566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.780777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.780894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.028 qpair failed and we were unable to recover it. 00:27:09.028 [2024-11-20 12:54:41.781015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.028 [2024-11-20 12:54:41.781114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.781266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.781537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.781775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.781896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.781981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.782222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.782431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.782666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.782783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.782907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.783119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.783330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.783568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.783792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.783912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.783997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.784221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.784472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.784688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.784805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.784898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.785185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.785387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.785622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.785820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.785927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.786018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.786243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.786488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd854000b90 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.786732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.786867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.786999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.787116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.787144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.787241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.787327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.787353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.029 [2024-11-20 12:54:41.787449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.787544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.029 [2024-11-20 12:54:41.787568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.029 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.787691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.787792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.787816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.787946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.788160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.788405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.788648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.788896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.788979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.789101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.789318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.789575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.789773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.789889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.789985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.790216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.790417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.790664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.790894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.790992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.791137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.791336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.791622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.791818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.791932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.792027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.792250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.792448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.792654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.792855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.792961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.793061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.793314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.793551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.793806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.793930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.030 qpair failed and we were unable to recover it. 00:27:09.030 [2024-11-20 12:54:41.794052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.794148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.030 [2024-11-20 12:54:41.794173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.794261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.794350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.794382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.794472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.794565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.794597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.794697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.794810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.794842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.794938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.795136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.795340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.795609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.795867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.795997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.796147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.796359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.796578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.796831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.796982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.797117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.797229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.797254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.797414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.797507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.797532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.797648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.797762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.797786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.797914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.798168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.798400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.798631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.798860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.798967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.799052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.799309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.799562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.031 qpair failed and we were unable to recover it. 00:27:09.031 [2024-11-20 12:54:41.799761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.031 [2024-11-20 12:54:41.799905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.799995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.800224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.800473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.800721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.800845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.800953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.801200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.801440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.801683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.801837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.801932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.802222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.802443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.802687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.802830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.802918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.803145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.803352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.803586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.803844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.803960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.804094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.804309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.804512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.804785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.804894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.804987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.805210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.805485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.805762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.805887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.806006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.806203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.806229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.806321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.806413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.806439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.806539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.806657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.032 [2024-11-20 12:54:41.806682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.032 qpair failed and we were unable to recover it. 00:27:09.032 [2024-11-20 12:54:41.806782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.806897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.806922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.807046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.807270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.807506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.807704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.807841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.807939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.808187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.808419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.808643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.808857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.808968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.809091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.809305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.809561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.809805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.809917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.810022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.810267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.810483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.810718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.810830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.810918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.811142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.811374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.811597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.811805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.811943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.812067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.812283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.812498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.812704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.812817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.812939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.813105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.813131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.813219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.813308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.033 [2024-11-20 12:54:41.813333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.033 qpair failed and we were unable to recover it. 00:27:09.033 [2024-11-20 12:54:41.813432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.813528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.813553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.813678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.813762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.813787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.813880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.813999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.814181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.814380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.814592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.814796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.814908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.815007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.815250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.815478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.815711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.815911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.815998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.816129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.816391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.816692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.816798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.816890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.817139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.817336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.817559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.817840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.817999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.818106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.818317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.818550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.818809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.818953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.819076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.819291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.819532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.819783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.819892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.034 [2024-11-20 12:54:41.819984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.820084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.034 [2024-11-20 12:54:41.820110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.034 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.820245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.820342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.820367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.820459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.820582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.820607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.820698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.820789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.820814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.820917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.821195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.821418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.821674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.821874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.821992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.822141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.822352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.822598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.822874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.822991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.823120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.823331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.823527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.823777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.823884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.823976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.824198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.824457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.824674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.824785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.824923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.825151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.825375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.825627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.825834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.825949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.826048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.826150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.826175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.826258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.826347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.826372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.826480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.826595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.035 [2024-11-20 12:54:41.826619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.035 qpair failed and we were unable to recover it. 00:27:09.035 [2024-11-20 12:54:41.826715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.826831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.826855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.826948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.827179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.827481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.827684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.827804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.827938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.828155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.828363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.828572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.828815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.828924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.829056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.829300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.829542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.829774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.829883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.830005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.830216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.830429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.830627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.830775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.830925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.831134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.831408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.831636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.831871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.831981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.832108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.832197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.832222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.832336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.832434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.832458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.036 qpair failed and we were unable to recover it. 00:27:09.036 [2024-11-20 12:54:41.832589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.036 [2024-11-20 12:54:41.832683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.832707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.832802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.832919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.832944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.833034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.833260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.833463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.833695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.833877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.833963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.834213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.834522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.834769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.834924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.835027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.835247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.835444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.835660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.835861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.835977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.836067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.836281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.836571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.836783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.836899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.836990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.837256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.837499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.837740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.837878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.837988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.838204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.838460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.838677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.838799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.838920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.839053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.839087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.839179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.839270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.839294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.037 qpair failed and we were unable to recover it. 00:27:09.037 [2024-11-20 12:54:41.839394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.037 [2024-11-20 12:54:41.839482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.839506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.839596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.839711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.839736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.839830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.839954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.839978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.840079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.840291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.840521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.840768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.840873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.840972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.841228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.841443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.841661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.841802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.841897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.842140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.842350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.842553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.842783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.842901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.843007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.843229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.843493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.843717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.843840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.843939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.844155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.844366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.844604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.844829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.844970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.845104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.845309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.845532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.845789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.038 [2024-11-20 12:54:41.845900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.038 qpair failed and we were unable to recover it. 00:27:09.038 [2024-11-20 12:54:41.846014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.846232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.846429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.846645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.846790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.846888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.847154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.847347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.847587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.847866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.847985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.848074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.848280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.848535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.848781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.848904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.848993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.849216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.849483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.849691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.849831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.849931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.850190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.850422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.850666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.850790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.850881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.851161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.851385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.851617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.851835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.851948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.852066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.852163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.852189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.852280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.852371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.852399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.039 [2024-11-20 12:54:41.852499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.852582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.039 [2024-11-20 12:54:41.852606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.039 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.852727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.852810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.852835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.852920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.853216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.853480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.853679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.853888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.853976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.854110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.854322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.854558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.854804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.854952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.855039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.855268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.855521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.855791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.855933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.856021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.856269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.856498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.856705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.856829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.856916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.857163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.857402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.857651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.857803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.857924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.858044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.858075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.858203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.858300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.858325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.040 qpair failed and we were unable to recover it. 00:27:09.040 [2024-11-20 12:54:41.858448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.858569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.040 [2024-11-20 12:54:41.858595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.858689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.858778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.858803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.858884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.858996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.859115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.859308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.859548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.859776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.859932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.860061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.860274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.860494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.860709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.860830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.860931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.861182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.861397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.861719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.861842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.861959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.862243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.862478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.862756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.862899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.863032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.863271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.863522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.863723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.863836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.863921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.864134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.864382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.864645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.864876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.864996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.865097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.865223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.865248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.041 qpair failed and we were unable to recover it. 00:27:09.041 [2024-11-20 12:54:41.865334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.041 [2024-11-20 12:54:41.865432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.865457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.865542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.865670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.865704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.865798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.865917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.865942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.866096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.866324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.866561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.866788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.866924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.867023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.867240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.867483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.867680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.867828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.867916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.868159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.868401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.868629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.868851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.868994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.869094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.869332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.869569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.869774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.869915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.870000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.870209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.870448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.870675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.870817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.870916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.871161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.871382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.871613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.871847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.042 [2024-11-20 12:54:41.871989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.042 qpair failed and we were unable to recover it. 00:27:09.042 [2024-11-20 12:54:41.872106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.872332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.872541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.872776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.872923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.873041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.873255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.873454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.873692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.873900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.873990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.874177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.874444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.874666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.874872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.874980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.875081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.875289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.875533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.875729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.875870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.875963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.876193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.876434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.876661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.876898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.876991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.877116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.877351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.877569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.877793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.877908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.878027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.878132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.878158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.878257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.878341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.878365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.043 qpair failed and we were unable to recover it. 00:27:09.043 [2024-11-20 12:54:41.878488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.878602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.043 [2024-11-20 12:54:41.878626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.878745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.878838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.878863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.878951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.879192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.879431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.879670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.879895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.879976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.880097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.880298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.880528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.880734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.880876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.880958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.881161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.881435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.881661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.881902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.881988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.882110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.882379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.882570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.882828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.882972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.883060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.883294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.883495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.883732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.883842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.883957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.884190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.884440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.884646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.884854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.884958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.044 qpair failed and we were unable to recover it. 00:27:09.044 [2024-11-20 12:54:41.885060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.044 [2024-11-20 12:54:41.885166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.885286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.885479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.885732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.885870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.885950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.886194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.886416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.886628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.886822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.886965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.887064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.887286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.887525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.887763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.887874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.888022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.888246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.888462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.888718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.888833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.888953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.889199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.889425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.889631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.889836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.889946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.890042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.890279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.890486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.045 [2024-11-20 12:54:41.890717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.045 [2024-11-20 12:54:41.890827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.045 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.890911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.891170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.891403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.891647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.891836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.891981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.892078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.892292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.892521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.892757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.892868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.892954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.893171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.893439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.893640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.893808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.893896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.894161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.894369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.894580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.894772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.894912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.895030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.895231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.895471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.895683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.895907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.895998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.896115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.896350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.896585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.896779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.896931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.897018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.897141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.897166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.046 qpair failed and we were unable to recover it. 00:27:09.046 [2024-11-20 12:54:41.897252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.046 [2024-11-20 12:54:41.897374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.897399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.897497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.897588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.897612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.897709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.897797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.897822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.897908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.897999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.898136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.898377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.898579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.898814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.898931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.899036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.899281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.899483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.899701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.899851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.899945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.900165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.900381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.900583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.900770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.900910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.901003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.901223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.901433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.901639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.901853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.901998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.902102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.902311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.902559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.902765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.902912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.903011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.903108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.903133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.903229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.903327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.903352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.903457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.903545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.047 [2024-11-20 12:54:41.903570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.047 qpair failed and we were unable to recover it. 00:27:09.047 [2024-11-20 12:54:41.903654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.903745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.903770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.903862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.903947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.903971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.904055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.904305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.904550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.904808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.904925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.905043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.905267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.905485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.905725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.905869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.905960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.906180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.906396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.906589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.906791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.906963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.907098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.907309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.907580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.907792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.907913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.907998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.908213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.908481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.908689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.908806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.908930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.909135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.909350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.909619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.909848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.909996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.048 qpair failed and we were unable to recover it. 00:27:09.048 [2024-11-20 12:54:41.910093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.910175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.048 [2024-11-20 12:54:41.910200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.910319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.910460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.910485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.910577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.910668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.910694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.910789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.910935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.910960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.911050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.911297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.911518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.911770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.911892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.911995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.912229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.912434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.912663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.912780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.912873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.913134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.913354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.913581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.913830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.913946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.914087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.914327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.914525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.914758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.914867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.914999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.915213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.915424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.915656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.049 [2024-11-20 12:54:41.915860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.049 [2024-11-20 12:54:41.915976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.049 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.916073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.916294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.916569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.916804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.916918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.917040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.917306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.917529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.917735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.917886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.917980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.918214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.918426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.918663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.918884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.918994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.919119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.919327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.919527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.919812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.919922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.920044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.920258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.920483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.920687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.920904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.920991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.921111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.921357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.921597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.921803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.921945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.922038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.922161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.922186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.922301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.922397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.922422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.050 qpair failed and we were unable to recover it. 00:27:09.050 [2024-11-20 12:54:41.922546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.050 [2024-11-20 12:54:41.922634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.922658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.922745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.922855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.922879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.922964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.923277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.923487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.923713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.923827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.923923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.924155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.924368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.924577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.924787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.924898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.925002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.925205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.925444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.925713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.925834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.925917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.926200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.926408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.926684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.926889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.926980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.927106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.927326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.927553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.927763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.927932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.928048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.928265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.928480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.928705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.928822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.928922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.929041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.929065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.051 qpair failed and we were unable to recover it. 00:27:09.051 [2024-11-20 12:54:41.929204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.051 [2024-11-20 12:54:41.929298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.929447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.929664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.929868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.929982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.930064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.930309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.930555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.930757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.930870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.930959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.931174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.931391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.931623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.931832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.931942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.932028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.932256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.932461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.932663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.932804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.932900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.933218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.933463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.933673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.933877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.933984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.934079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.934292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.934506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.934827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.934975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.935077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.935164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.935189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.935283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.935369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.935393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.935548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.935643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.052 [2024-11-20 12:54:41.935668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.052 qpair failed and we were unable to recover it. 00:27:09.052 [2024-11-20 12:54:41.935756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.935872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.935897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.935993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.936220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.936421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.936623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.936865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.936977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.937062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.937291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.937540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.937786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.937896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.937990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.938214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.938427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.938685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.938879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.938985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.939080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.939306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.939547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.939788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.939913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.940003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.940233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.940448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.940653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.940856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.940968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.941063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.941276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.941545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.941740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.941874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.053 [2024-11-20 12:54:41.941962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.942098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.053 [2024-11-20 12:54:41.942123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.053 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.942277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.942364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.942388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.942474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.942566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.942591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.942686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.942783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.942807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.942896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.943134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.943337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.943634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.943875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.943987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.944105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.944316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.944514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.944745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.944857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.944941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 12:54:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:09.054 [2024-11-20 12:54:41.945185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 12:54:41 -- common/autotest_common.sh@862 -- # return 0 00:27:09.054 [2024-11-20 12:54:41.945281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.945437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 12:54:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:09.054 [2024-11-20 12:54:41.945554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.945654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 12:54:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:09.054 [2024-11-20 12:54:41.945865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.945983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.946097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 12:54:41 -- common/autotest_common.sh@10 -- # set +x 00:27:09.054 [2024-11-20 12:54:41.946191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.946307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.946523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.946840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.946945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.947045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.947291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.947523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.054 qpair failed and we were unable to recover it. 00:27:09.054 [2024-11-20 12:54:41.947738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.054 [2024-11-20 12:54:41.947827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.947852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.947969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.948181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.948407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.948603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.948831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.949032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.949262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.949467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.949671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.949810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.949899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.950210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.950419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.950621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.950860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.950970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.951062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.951292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.951503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.951729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.951951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.952038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.952279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.952513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.952722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.952826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.952921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.953165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.953380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.953616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.953853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.953990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.954117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.954202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.954227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.055 qpair failed and we were unable to recover it. 00:27:09.055 [2024-11-20 12:54:41.954320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.954416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.055 [2024-11-20 12:54:41.954441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.954529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.954615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.954640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.954735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.954822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.954846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.954927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.955174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.955404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.955705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.955823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.955917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.956191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.956435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.956641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.956860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.956970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.957067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.957316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.957666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.957888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.957977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.958001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.958119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.958213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.958237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c44cb0 with addr=10.0.0.2, port=4420 00:27:09.056 qpair failed and we were unable to recover it. 00:27:09.056 [2024-11-20 12:54:41.958382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.958545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.056 [2024-11-20 12:54:41.958573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c52600 with addr=10.0.0.2, port=4420 00:27:09.056 [2024-11-20 12:54:41.958592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c52600 is same with the state(5) to be set 00:27:09.056 [2024-11-20 12:54:41.958620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c52600 (9): Bad file descriptor 00:27:09.056 [2024-11-20 12:54:41.958640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.056 [2024-11-20 12:54:41.958654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.056 [2024-11-20 12:54:41.958672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.056 Unable to reset the controller. 00:27:09.056 12:54:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:09.056 12:54:41 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:09.056 12:54:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.056 12:54:41 -- common/autotest_common.sh@10 -- # set +x 00:27:09.056 Malloc0 00:27:09.056 12:54:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.056 12:54:41 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:09.056 12:54:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.056 12:54:41 -- common/autotest_common.sh@10 -- # set +x 00:27:09.056 [2024-11-20 12:54:41.995424] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:09.056 12:54:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.056 12:54:42 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:09.056 12:54:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.056 12:54:42 -- common/autotest_common.sh@10 -- # set +x 00:27:09.056 12:54:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.056 12:54:42 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:09.056 12:54:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.056 12:54:42 -- common/autotest_common.sh@10 -- # set +x 00:27:09.056 12:54:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.056 12:54:42 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:09.056 12:54:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.056 12:54:42 -- common/autotest_common.sh@10 -- # set +x 00:27:09.056 [2024-11-20 12:54:42.023729] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:09.056 12:54:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.056 12:54:42 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:09.056 12:54:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.056 12:54:42 -- common/autotest_common.sh@10 -- # set +x 00:27:09.056 12:54:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.056 12:54:42 -- host/target_disconnect.sh@58 -- # wait 3644704 00:27:09.994 Controller properly reset. 00:27:14.187 Initializing NVMe Controllers 00:27:14.187 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:14.187 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:14.187 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:14.187 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:14.187 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:14.187 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:14.187 Initialization complete. Launching workers. 00:27:14.187 Starting thread on core 1 00:27:14.187 Starting thread on core 2 00:27:14.187 Starting thread on core 3 00:27:14.187 Starting thread on core 0 00:27:14.187 12:54:47 -- host/target_disconnect.sh@59 -- # sync 00:27:14.187 00:27:14.187 real 0m11.359s 00:27:14.187 user 0m33.901s 00:27:14.187 sys 0m7.495s 00:27:14.187 12:54:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:14.187 12:54:47 -- common/autotest_common.sh@10 -- # set +x 00:27:14.187 ************************************ 00:27:14.187 END TEST nvmf_target_disconnect_tc2 00:27:14.187 ************************************ 00:27:14.187 12:54:47 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:14.187 12:54:47 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:14.187 12:54:47 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:14.187 12:54:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:14.187 12:54:47 -- nvmf/common.sh@116 -- # sync 00:27:14.187 12:54:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:14.187 12:54:47 -- nvmf/common.sh@119 -- # set +e 00:27:14.187 12:54:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:14.187 12:54:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:14.187 rmmod nvme_tcp 00:27:14.187 rmmod nvme_fabrics 00:27:14.187 rmmod nvme_keyring 00:27:14.187 12:54:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:14.187 12:54:47 -- nvmf/common.sh@123 -- # set -e 00:27:14.187 12:54:47 -- nvmf/common.sh@124 -- # return 0 00:27:14.187 12:54:47 -- nvmf/common.sh@477 -- # '[' -n 3645234 ']' 00:27:14.187 12:54:47 -- nvmf/common.sh@478 -- # killprocess 3645234 00:27:14.187 12:54:47 -- common/autotest_common.sh@936 -- # '[' -z 3645234 ']' 00:27:14.187 12:54:47 -- common/autotest_common.sh@940 -- # kill -0 3645234 00:27:14.187 12:54:47 -- common/autotest_common.sh@941 -- # uname 00:27:14.187 12:54:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.187 12:54:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3645234 00:27:14.187 12:54:47 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:14.187 12:54:47 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:14.187 12:54:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3645234' 00:27:14.187 killing process with pid 3645234 00:27:14.187 12:54:47 -- common/autotest_common.sh@955 -- # kill 3645234 00:27:14.187 12:54:47 -- common/autotest_common.sh@960 -- # wait 3645234 00:27:14.446 12:54:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:14.446 12:54:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:14.446 12:54:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:14.446 12:54:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:14.446 12:54:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:14.446 12:54:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:14.447 12:54:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:14.447 12:54:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:16.979 12:54:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:16.979 00:27:16.979 real 0m16.200s 00:27:16.979 user 0m59.191s 00:27:16.979 sys 0m9.862s 00:27:16.979 12:54:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:16.979 12:54:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.979 ************************************ 00:27:16.979 END TEST nvmf_target_disconnect 00:27:16.979 ************************************ 00:27:16.979 12:54:49 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:16.979 12:54:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:16.979 12:54:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.979 12:54:49 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:16.979 00:27:16.979 real 21m25.798s 00:27:16.979 user 62m7.181s 00:27:16.979 sys 5m7.349s 00:27:16.979 12:54:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:16.979 12:54:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.979 ************************************ 00:27:16.979 END TEST nvmf_tcp 00:27:16.979 ************************************ 00:27:16.979 12:54:49 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:16.979 12:54:49 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:16.980 12:54:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:16.980 12:54:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:16.980 12:54:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.980 ************************************ 00:27:16.980 START TEST spdkcli_nvmf_tcp 00:27:16.980 ************************************ 00:27:16.980 12:54:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:16.980 * Looking for test storage... 00:27:16.980 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:16.980 12:54:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:16.980 12:54:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:16.980 12:54:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:16.980 12:54:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:16.980 12:54:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:16.980 12:54:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:16.980 12:54:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:16.980 12:54:49 -- scripts/common.sh@335 -- # IFS=.-: 00:27:16.980 12:54:49 -- scripts/common.sh@335 -- # read -ra ver1 00:27:16.980 12:54:49 -- scripts/common.sh@336 -- # IFS=.-: 00:27:16.980 12:54:49 -- scripts/common.sh@336 -- # read -ra ver2 00:27:16.980 12:54:49 -- scripts/common.sh@337 -- # local 'op=<' 00:27:16.980 12:54:49 -- scripts/common.sh@339 -- # ver1_l=2 00:27:16.980 12:54:49 -- scripts/common.sh@340 -- # ver2_l=1 00:27:16.980 12:54:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:16.980 12:54:49 -- scripts/common.sh@343 -- # case "$op" in 00:27:16.980 12:54:49 -- scripts/common.sh@344 -- # : 1 00:27:16.980 12:54:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:16.980 12:54:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:16.980 12:54:49 -- scripts/common.sh@364 -- # decimal 1 00:27:16.980 12:54:49 -- scripts/common.sh@352 -- # local d=1 00:27:16.980 12:54:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:16.980 12:54:49 -- scripts/common.sh@354 -- # echo 1 00:27:16.980 12:54:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:16.980 12:54:49 -- scripts/common.sh@365 -- # decimal 2 00:27:16.980 12:54:49 -- scripts/common.sh@352 -- # local d=2 00:27:16.980 12:54:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:16.980 12:54:49 -- scripts/common.sh@354 -- # echo 2 00:27:16.980 12:54:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:16.980 12:54:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:16.980 12:54:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:16.980 12:54:49 -- scripts/common.sh@367 -- # return 0 00:27:16.980 12:54:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:16.980 12:54:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:16.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.980 --rc genhtml_branch_coverage=1 00:27:16.980 --rc genhtml_function_coverage=1 00:27:16.980 --rc genhtml_legend=1 00:27:16.980 --rc geninfo_all_blocks=1 00:27:16.980 --rc geninfo_unexecuted_blocks=1 00:27:16.980 00:27:16.980 ' 00:27:16.980 12:54:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:16.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.980 --rc genhtml_branch_coverage=1 00:27:16.980 --rc genhtml_function_coverage=1 00:27:16.980 --rc genhtml_legend=1 00:27:16.980 --rc geninfo_all_blocks=1 00:27:16.980 --rc geninfo_unexecuted_blocks=1 00:27:16.980 00:27:16.980 ' 00:27:16.980 12:54:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:16.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.980 --rc genhtml_branch_coverage=1 00:27:16.980 --rc genhtml_function_coverage=1 00:27:16.980 --rc genhtml_legend=1 00:27:16.980 --rc geninfo_all_blocks=1 00:27:16.980 --rc geninfo_unexecuted_blocks=1 00:27:16.980 00:27:16.980 ' 00:27:16.980 12:54:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:16.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.980 --rc genhtml_branch_coverage=1 00:27:16.980 --rc genhtml_function_coverage=1 00:27:16.980 --rc genhtml_legend=1 00:27:16.980 --rc geninfo_all_blocks=1 00:27:16.980 --rc geninfo_unexecuted_blocks=1 00:27:16.980 00:27:16.980 ' 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:16.980 12:54:49 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:16.980 12:54:49 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:16.980 12:54:49 -- nvmf/common.sh@7 -- # uname -s 00:27:16.980 12:54:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:16.980 12:54:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:16.980 12:54:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:16.980 12:54:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:16.980 12:54:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:16.980 12:54:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:16.980 12:54:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:16.980 12:54:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:16.980 12:54:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:16.980 12:54:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:16.980 12:54:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:16.980 12:54:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:16.980 12:54:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:16.980 12:54:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:16.980 12:54:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:16.980 12:54:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:16.980 12:54:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:16.980 12:54:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:16.980 12:54:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:16.980 12:54:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.980 12:54:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.980 12:54:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.980 12:54:49 -- paths/export.sh@5 -- # export PATH 00:27:16.980 12:54:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.980 12:54:49 -- nvmf/common.sh@46 -- # : 0 00:27:16.980 12:54:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:16.980 12:54:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:16.980 12:54:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:16.980 12:54:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:16.980 12:54:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:16.980 12:54:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:16.980 12:54:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:16.980 12:54:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:16.980 12:54:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:16.980 12:54:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.980 12:54:49 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:16.980 12:54:49 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3646460 00:27:16.980 12:54:49 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:16.980 12:54:49 -- spdkcli/common.sh@34 -- # waitforlisten 3646460 00:27:16.980 12:54:49 -- common/autotest_common.sh@829 -- # '[' -z 3646460 ']' 00:27:16.980 12:54:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:16.980 12:54:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:16.980 12:54:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:16.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:16.980 12:54:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:16.980 12:54:49 -- common/autotest_common.sh@10 -- # set +x 00:27:16.980 [2024-11-20 12:54:49.823176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:16.980 [2024-11-20 12:54:49.823274] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3646460 ] 00:27:16.980 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.980 [2024-11-20 12:54:49.884542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:16.980 [2024-11-20 12:54:50.003563] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:16.980 [2024-11-20 12:54:50.003806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:16.980 [2024-11-20 12:54:50.003812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:17.913 12:54:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:17.913 12:54:50 -- common/autotest_common.sh@862 -- # return 0 00:27:17.913 12:54:50 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:17.913 12:54:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:17.913 12:54:50 -- common/autotest_common.sh@10 -- # set +x 00:27:17.913 12:54:50 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:17.913 12:54:50 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:17.913 12:54:50 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:17.913 12:54:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:17.913 12:54:50 -- common/autotest_common.sh@10 -- # set +x 00:27:17.913 12:54:50 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:17.913 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:17.913 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:17.913 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:17.913 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:17.913 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:17.913 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:17.913 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:17.913 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:17.913 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:17.913 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:17.913 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:17.913 ' 00:27:18.172 [2024-11-20 12:54:51.264929] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:20.707 [2024-11-20 12:54:53.466960] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:21.641 [2024-11-20 12:54:54.719444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:24.174 [2024-11-20 12:54:57.034721] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:26.076 [2024-11-20 12:54:59.029280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:27.450 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:27.450 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:27.450 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:27.450 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:27.450 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:27.450 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:27.450 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:27.450 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:27.450 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:27.450 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:27.450 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:27.450 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:27.708 12:55:00 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:27.708 12:55:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:27.708 12:55:00 -- common/autotest_common.sh@10 -- # set +x 00:27:27.708 12:55:00 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:27.708 12:55:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:27.708 12:55:00 -- common/autotest_common.sh@10 -- # set +x 00:27:27.708 12:55:00 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:27.708 12:55:00 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:28.274 12:55:01 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:28.274 12:55:01 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:28.274 12:55:01 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:28.274 12:55:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:28.274 12:55:01 -- common/autotest_common.sh@10 -- # set +x 00:27:28.274 12:55:01 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:28.274 12:55:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:28.274 12:55:01 -- common/autotest_common.sh@10 -- # set +x 00:27:28.274 12:55:01 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:28.274 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:28.274 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:28.274 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:28.274 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:28.274 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:28.274 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:28.274 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:28.274 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:28.274 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:28.274 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:28.274 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:28.274 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:28.274 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:28.274 ' 00:27:33.537 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:33.537 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:33.537 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:33.537 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:33.537 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:33.537 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:33.537 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:33.537 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:33.537 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:33.537 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:33.537 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:33.537 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:33.537 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:33.537 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:33.537 12:55:06 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:33.537 12:55:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:33.537 12:55:06 -- common/autotest_common.sh@10 -- # set +x 00:27:33.537 12:55:06 -- spdkcli/nvmf.sh@90 -- # killprocess 3646460 00:27:33.537 12:55:06 -- common/autotest_common.sh@936 -- # '[' -z 3646460 ']' 00:27:33.537 12:55:06 -- common/autotest_common.sh@940 -- # kill -0 3646460 00:27:33.537 12:55:06 -- common/autotest_common.sh@941 -- # uname 00:27:33.537 12:55:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:33.537 12:55:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3646460 00:27:33.537 12:55:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:33.537 12:55:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:33.537 12:55:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3646460' 00:27:33.537 killing process with pid 3646460 00:27:33.537 12:55:06 -- common/autotest_common.sh@955 -- # kill 3646460 00:27:33.537 [2024-11-20 12:55:06.590967] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:33.537 12:55:06 -- common/autotest_common.sh@960 -- # wait 3646460 00:27:33.796 12:55:06 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:33.796 12:55:06 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:33.796 12:55:06 -- spdkcli/common.sh@13 -- # '[' -n 3646460 ']' 00:27:33.796 12:55:06 -- spdkcli/common.sh@14 -- # killprocess 3646460 00:27:33.796 12:55:06 -- common/autotest_common.sh@936 -- # '[' -z 3646460 ']' 00:27:33.796 12:55:06 -- common/autotest_common.sh@940 -- # kill -0 3646460 00:27:33.796 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3646460) - No such process 00:27:33.796 12:55:06 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3646460 is not found' 00:27:33.796 Process with pid 3646460 is not found 00:27:33.796 12:55:06 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:33.796 12:55:06 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:33.796 12:55:06 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:33.796 00:27:33.796 real 0m17.226s 00:27:33.796 user 0m36.836s 00:27:33.796 sys 0m0.802s 00:27:33.796 12:55:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:33.796 12:55:06 -- common/autotest_common.sh@10 -- # set +x 00:27:33.796 ************************************ 00:27:33.796 END TEST spdkcli_nvmf_tcp 00:27:33.796 ************************************ 00:27:33.796 12:55:06 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:33.796 12:55:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:33.796 12:55:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:33.796 12:55:06 -- common/autotest_common.sh@10 -- # set +x 00:27:33.796 ************************************ 00:27:33.796 START TEST nvmf_identify_passthru 00:27:33.796 ************************************ 00:27:33.796 12:55:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:34.054 * Looking for test storage... 00:27:34.054 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:34.054 12:55:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:34.054 12:55:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:34.054 12:55:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:34.054 12:55:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:34.054 12:55:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:34.054 12:55:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:34.054 12:55:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:34.054 12:55:07 -- scripts/common.sh@335 -- # IFS=.-: 00:27:34.054 12:55:07 -- scripts/common.sh@335 -- # read -ra ver1 00:27:34.054 12:55:07 -- scripts/common.sh@336 -- # IFS=.-: 00:27:34.054 12:55:07 -- scripts/common.sh@336 -- # read -ra ver2 00:27:34.054 12:55:07 -- scripts/common.sh@337 -- # local 'op=<' 00:27:34.054 12:55:07 -- scripts/common.sh@339 -- # ver1_l=2 00:27:34.054 12:55:07 -- scripts/common.sh@340 -- # ver2_l=1 00:27:34.054 12:55:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:34.054 12:55:07 -- scripts/common.sh@343 -- # case "$op" in 00:27:34.054 12:55:07 -- scripts/common.sh@344 -- # : 1 00:27:34.054 12:55:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:34.054 12:55:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:34.054 12:55:07 -- scripts/common.sh@364 -- # decimal 1 00:27:34.054 12:55:07 -- scripts/common.sh@352 -- # local d=1 00:27:34.054 12:55:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:34.054 12:55:07 -- scripts/common.sh@354 -- # echo 1 00:27:34.054 12:55:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:34.054 12:55:07 -- scripts/common.sh@365 -- # decimal 2 00:27:34.054 12:55:07 -- scripts/common.sh@352 -- # local d=2 00:27:34.054 12:55:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:34.054 12:55:07 -- scripts/common.sh@354 -- # echo 2 00:27:34.054 12:55:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:34.054 12:55:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:34.054 12:55:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:34.054 12:55:07 -- scripts/common.sh@367 -- # return 0 00:27:34.054 12:55:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:34.054 12:55:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:34.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:34.054 --rc genhtml_branch_coverage=1 00:27:34.054 --rc genhtml_function_coverage=1 00:27:34.054 --rc genhtml_legend=1 00:27:34.054 --rc geninfo_all_blocks=1 00:27:34.054 --rc geninfo_unexecuted_blocks=1 00:27:34.054 00:27:34.054 ' 00:27:34.054 12:55:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:34.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:34.054 --rc genhtml_branch_coverage=1 00:27:34.054 --rc genhtml_function_coverage=1 00:27:34.054 --rc genhtml_legend=1 00:27:34.054 --rc geninfo_all_blocks=1 00:27:34.054 --rc geninfo_unexecuted_blocks=1 00:27:34.054 00:27:34.054 ' 00:27:34.054 12:55:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:34.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:34.054 --rc genhtml_branch_coverage=1 00:27:34.054 --rc genhtml_function_coverage=1 00:27:34.054 --rc genhtml_legend=1 00:27:34.054 --rc geninfo_all_blocks=1 00:27:34.054 --rc geninfo_unexecuted_blocks=1 00:27:34.054 00:27:34.054 ' 00:27:34.054 12:55:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:34.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:34.054 --rc genhtml_branch_coverage=1 00:27:34.054 --rc genhtml_function_coverage=1 00:27:34.054 --rc genhtml_legend=1 00:27:34.054 --rc geninfo_all_blocks=1 00:27:34.054 --rc geninfo_unexecuted_blocks=1 00:27:34.055 00:27:34.055 ' 00:27:34.055 12:55:07 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:34.055 12:55:07 -- nvmf/common.sh@7 -- # uname -s 00:27:34.055 12:55:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:34.055 12:55:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:34.055 12:55:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:34.055 12:55:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:34.055 12:55:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:34.055 12:55:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:34.055 12:55:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:34.055 12:55:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:34.055 12:55:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:34.055 12:55:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:34.055 12:55:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:34.055 12:55:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:34.055 12:55:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:34.055 12:55:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:34.055 12:55:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:34.055 12:55:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:34.055 12:55:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:34.055 12:55:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:34.055 12:55:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:34.055 12:55:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- paths/export.sh@5 -- # export PATH 00:27:34.055 12:55:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- nvmf/common.sh@46 -- # : 0 00:27:34.055 12:55:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:34.055 12:55:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:34.055 12:55:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:34.055 12:55:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:34.055 12:55:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:34.055 12:55:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:34.055 12:55:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:34.055 12:55:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:34.055 12:55:07 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:34.055 12:55:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:34.055 12:55:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:34.055 12:55:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:34.055 12:55:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- paths/export.sh@5 -- # export PATH 00:27:34.055 12:55:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:34.055 12:55:07 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:34.055 12:55:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:34.055 12:55:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:34.055 12:55:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:34.055 12:55:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:34.055 12:55:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:34.055 12:55:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:34.055 12:55:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:34.055 12:55:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:34.055 12:55:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:34.055 12:55:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:34.055 12:55:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:34.055 12:55:07 -- common/autotest_common.sh@10 -- # set +x 00:27:35.954 12:55:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:35.954 12:55:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:35.954 12:55:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:35.954 12:55:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:35.954 12:55:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:35.954 12:55:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:35.954 12:55:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:35.954 12:55:08 -- nvmf/common.sh@294 -- # net_devs=() 00:27:35.954 12:55:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:35.954 12:55:08 -- nvmf/common.sh@295 -- # e810=() 00:27:35.954 12:55:08 -- nvmf/common.sh@295 -- # local -ga e810 00:27:35.954 12:55:08 -- nvmf/common.sh@296 -- # x722=() 00:27:35.954 12:55:08 -- nvmf/common.sh@296 -- # local -ga x722 00:27:35.954 12:55:08 -- nvmf/common.sh@297 -- # mlx=() 00:27:35.954 12:55:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:35.954 12:55:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:35.954 12:55:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:35.954 12:55:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:35.954 12:55:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:35.954 12:55:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:35.954 12:55:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:35.954 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:35.954 12:55:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:35.954 12:55:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:35.954 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:35.954 12:55:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:35.954 12:55:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:35.954 12:55:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:35.954 12:55:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:35.954 12:55:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:35.954 12:55:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:35.954 12:55:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:35.954 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:35.954 12:55:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:35.954 12:55:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:35.954 12:55:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:35.954 12:55:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:35.954 12:55:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:35.954 12:55:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:35.954 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:35.955 12:55:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:35.955 12:55:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:35.955 12:55:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:35.955 12:55:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:35.955 12:55:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:35.955 12:55:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:35.955 12:55:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:35.955 12:55:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:35.955 12:55:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:35.955 12:55:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:35.955 12:55:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:35.955 12:55:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:35.955 12:55:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:35.955 12:55:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:35.955 12:55:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:35.955 12:55:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:35.955 12:55:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:35.955 12:55:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:35.955 12:55:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:35.955 12:55:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:35.955 12:55:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:35.955 12:55:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:36.213 12:55:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:36.213 12:55:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:36.213 12:55:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:36.213 12:55:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:36.213 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:36.213 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:27:36.213 00:27:36.213 --- 10.0.0.2 ping statistics --- 00:27:36.213 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:36.213 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:27:36.213 12:55:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:36.213 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:36.213 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:27:36.213 00:27:36.213 --- 10.0.0.1 ping statistics --- 00:27:36.213 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:36.213 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:27:36.213 12:55:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:36.213 12:55:09 -- nvmf/common.sh@410 -- # return 0 00:27:36.213 12:55:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:36.213 12:55:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:36.213 12:55:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:36.213 12:55:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:36.213 12:55:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:36.213 12:55:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:36.213 12:55:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:36.213 12:55:09 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:36.213 12:55:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:36.213 12:55:09 -- common/autotest_common.sh@10 -- # set +x 00:27:36.213 12:55:09 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:36.213 12:55:09 -- common/autotest_common.sh@1519 -- # bdfs=() 00:27:36.213 12:55:09 -- common/autotest_common.sh@1519 -- # local bdfs 00:27:36.213 12:55:09 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:27:36.213 12:55:09 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:27:36.213 12:55:09 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:36.213 12:55:09 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:36.213 12:55:09 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:36.213 12:55:09 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:36.213 12:55:09 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:36.213 12:55:09 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:36.213 12:55:09 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:36.213 12:55:09 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:27:36.213 12:55:09 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:36.213 12:55:09 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:36.213 12:55:09 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:36.213 12:55:09 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:36.213 12:55:09 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:36.213 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.403 12:55:13 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:27:40.403 12:55:13 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:40.403 12:55:13 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:27:40.403 12:55:13 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:27:40.403 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.591 12:55:17 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:27:44.591 12:55:17 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:27:44.591 12:55:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:44.591 12:55:17 -- common/autotest_common.sh@10 -- # set +x 00:27:44.591 12:55:17 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:27:44.591 12:55:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:44.591 12:55:17 -- common/autotest_common.sh@10 -- # set +x 00:27:44.591 12:55:17 -- target/identify_passthru.sh@31 -- # nvmfpid=3651218 00:27:44.591 12:55:17 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:27:44.591 12:55:17 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:44.591 12:55:17 -- target/identify_passthru.sh@35 -- # waitforlisten 3651218 00:27:44.591 12:55:17 -- common/autotest_common.sh@829 -- # '[' -z 3651218 ']' 00:27:44.591 12:55:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:44.591 12:55:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:44.591 12:55:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:44.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:44.591 12:55:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:44.591 12:55:17 -- common/autotest_common.sh@10 -- # set +x 00:27:44.591 [2024-11-20 12:55:17.681756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:44.592 [2024-11-20 12:55:17.681833] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:44.850 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.850 [2024-11-20 12:55:17.745272] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:44.850 [2024-11-20 12:55:17.856267] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:44.850 [2024-11-20 12:55:17.856441] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:44.850 [2024-11-20 12:55:17.856461] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:44.850 [2024-11-20 12:55:17.856475] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:44.850 [2024-11-20 12:55:17.856535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:44.850 [2024-11-20 12:55:17.856604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:44.850 [2024-11-20 12:55:17.856702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:44.850 [2024-11-20 12:55:17.856704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:44.850 12:55:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:44.850 12:55:17 -- common/autotest_common.sh@862 -- # return 0 00:27:44.850 12:55:17 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:27:44.850 12:55:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.850 12:55:17 -- common/autotest_common.sh@10 -- # set +x 00:27:44.850 INFO: Log level set to 20 00:27:44.850 INFO: Requests: 00:27:44.850 { 00:27:44.850 "jsonrpc": "2.0", 00:27:44.850 "method": "nvmf_set_config", 00:27:44.850 "id": 1, 00:27:44.850 "params": { 00:27:44.850 "admin_cmd_passthru": { 00:27:44.850 "identify_ctrlr": true 00:27:44.850 } 00:27:44.850 } 00:27:44.850 } 00:27:44.850 00:27:44.850 INFO: response: 00:27:44.850 { 00:27:44.850 "jsonrpc": "2.0", 00:27:44.850 "id": 1, 00:27:44.850 "result": true 00:27:44.850 } 00:27:44.850 00:27:44.850 12:55:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.850 12:55:17 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:27:44.850 12:55:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.850 12:55:17 -- common/autotest_common.sh@10 -- # set +x 00:27:44.850 INFO: Setting log level to 20 00:27:44.850 INFO: Setting log level to 20 00:27:44.850 INFO: Log level set to 20 00:27:44.850 INFO: Log level set to 20 00:27:44.850 INFO: Requests: 00:27:44.850 { 00:27:44.850 "jsonrpc": "2.0", 00:27:44.850 "method": "framework_start_init", 00:27:44.850 "id": 1 00:27:44.850 } 00:27:44.850 00:27:44.850 INFO: Requests: 00:27:44.850 { 00:27:44.850 "jsonrpc": "2.0", 00:27:44.850 "method": "framework_start_init", 00:27:44.850 "id": 1 00:27:44.850 } 00:27:44.850 00:27:45.110 [2024-11-20 12:55:18.010343] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:27:45.110 INFO: response: 00:27:45.110 { 00:27:45.110 "jsonrpc": "2.0", 00:27:45.110 "id": 1, 00:27:45.110 "result": true 00:27:45.110 } 00:27:45.110 00:27:45.110 INFO: response: 00:27:45.110 { 00:27:45.110 "jsonrpc": "2.0", 00:27:45.110 "id": 1, 00:27:45.110 "result": true 00:27:45.110 } 00:27:45.110 00:27:45.110 12:55:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.110 12:55:18 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:45.110 12:55:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.110 12:55:18 -- common/autotest_common.sh@10 -- # set +x 00:27:45.110 INFO: Setting log level to 40 00:27:45.110 INFO: Setting log level to 40 00:27:45.110 INFO: Setting log level to 40 00:27:45.110 [2024-11-20 12:55:18.020299] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:45.110 12:55:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.110 12:55:18 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:27:45.110 12:55:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:45.110 12:55:18 -- common/autotest_common.sh@10 -- # set +x 00:27:45.110 12:55:18 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:27:45.110 12:55:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.110 12:55:18 -- common/autotest_common.sh@10 -- # set +x 00:27:48.400 Nvme0n1 00:27:48.400 12:55:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.400 12:55:20 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:27:48.400 12:55:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.400 12:55:20 -- common/autotest_common.sh@10 -- # set +x 00:27:48.400 12:55:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.400 12:55:20 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:27:48.400 12:55:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.400 12:55:20 -- common/autotest_common.sh@10 -- # set +x 00:27:48.400 12:55:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.400 12:55:20 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:48.400 12:55:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.400 12:55:20 -- common/autotest_common.sh@10 -- # set +x 00:27:48.400 [2024-11-20 12:55:20.913175] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:48.400 12:55:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.400 12:55:20 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:27:48.400 12:55:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.400 12:55:20 -- common/autotest_common.sh@10 -- # set +x 00:27:48.400 [2024-11-20 12:55:20.920837] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:48.400 [ 00:27:48.400 { 00:27:48.400 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:48.400 "subtype": "Discovery", 00:27:48.400 "listen_addresses": [], 00:27:48.400 "allow_any_host": true, 00:27:48.400 "hosts": [] 00:27:48.400 }, 00:27:48.400 { 00:27:48.400 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:48.400 "subtype": "NVMe", 00:27:48.400 "listen_addresses": [ 00:27:48.400 { 00:27:48.400 "transport": "TCP", 00:27:48.400 "trtype": "TCP", 00:27:48.400 "adrfam": "IPv4", 00:27:48.400 "traddr": "10.0.0.2", 00:27:48.400 "trsvcid": "4420" 00:27:48.400 } 00:27:48.400 ], 00:27:48.400 "allow_any_host": true, 00:27:48.400 "hosts": [], 00:27:48.400 "serial_number": "SPDK00000000000001", 00:27:48.400 "model_number": "SPDK bdev Controller", 00:27:48.400 "max_namespaces": 1, 00:27:48.400 "min_cntlid": 1, 00:27:48.400 "max_cntlid": 65519, 00:27:48.400 "namespaces": [ 00:27:48.400 { 00:27:48.400 "nsid": 1, 00:27:48.400 "bdev_name": "Nvme0n1", 00:27:48.400 "name": "Nvme0n1", 00:27:48.400 "nguid": "F3790408A01843CF8E0DFF793818F261", 00:27:48.400 "uuid": "f3790408-a018-43cf-8e0d-ff793818f261" 00:27:48.400 } 00:27:48.400 ] 00:27:48.400 } 00:27:48.400 ] 00:27:48.400 12:55:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.401 12:55:20 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:27:48.401 12:55:20 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:27:48.401 12:55:20 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:27:48.401 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.401 12:55:21 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:27:48.401 12:55:21 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:27:48.401 12:55:21 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:27:48.401 12:55:21 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:27:48.401 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.401 12:55:21 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:27:48.401 12:55:21 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:27:48.401 12:55:21 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:27:48.401 12:55:21 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:48.401 12:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.401 12:55:21 -- common/autotest_common.sh@10 -- # set +x 00:27:48.401 12:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.401 12:55:21 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:27:48.401 12:55:21 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:27:48.401 12:55:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:48.401 12:55:21 -- nvmf/common.sh@116 -- # sync 00:27:48.401 12:55:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:48.401 12:55:21 -- nvmf/common.sh@119 -- # set +e 00:27:48.401 12:55:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:48.401 12:55:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:48.401 rmmod nvme_tcp 00:27:48.401 rmmod nvme_fabrics 00:27:48.401 rmmod nvme_keyring 00:27:48.401 12:55:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:48.401 12:55:21 -- nvmf/common.sh@123 -- # set -e 00:27:48.401 12:55:21 -- nvmf/common.sh@124 -- # return 0 00:27:48.401 12:55:21 -- nvmf/common.sh@477 -- # '[' -n 3651218 ']' 00:27:48.401 12:55:21 -- nvmf/common.sh@478 -- # killprocess 3651218 00:27:48.401 12:55:21 -- common/autotest_common.sh@936 -- # '[' -z 3651218 ']' 00:27:48.401 12:55:21 -- common/autotest_common.sh@940 -- # kill -0 3651218 00:27:48.401 12:55:21 -- common/autotest_common.sh@941 -- # uname 00:27:48.401 12:55:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:48.401 12:55:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3651218 00:27:48.401 12:55:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:48.401 12:55:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:48.401 12:55:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3651218' 00:27:48.401 killing process with pid 3651218 00:27:48.401 12:55:21 -- common/autotest_common.sh@955 -- # kill 3651218 00:27:48.401 [2024-11-20 12:55:21.276361] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:48.401 12:55:21 -- common/autotest_common.sh@960 -- # wait 3651218 00:27:49.779 12:55:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:49.779 12:55:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:49.779 12:55:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:49.779 12:55:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:49.779 12:55:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:49.779 12:55:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.779 12:55:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:49.779 12:55:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:52.312 12:55:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:52.312 00:27:52.312 real 0m18.022s 00:27:52.312 user 0m26.497s 00:27:52.312 sys 0m2.205s 00:27:52.312 12:55:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:52.312 12:55:24 -- common/autotest_common.sh@10 -- # set +x 00:27:52.312 ************************************ 00:27:52.312 END TEST nvmf_identify_passthru 00:27:52.312 ************************************ 00:27:52.312 12:55:24 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:27:52.312 12:55:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:52.312 12:55:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:52.312 12:55:24 -- common/autotest_common.sh@10 -- # set +x 00:27:52.312 ************************************ 00:27:52.312 START TEST nvmf_dif 00:27:52.312 ************************************ 00:27:52.312 12:55:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:27:52.312 * Looking for test storage... 00:27:52.312 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:52.312 12:55:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:52.312 12:55:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:52.312 12:55:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:52.312 12:55:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:52.312 12:55:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:52.312 12:55:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:52.312 12:55:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:52.312 12:55:25 -- scripts/common.sh@335 -- # IFS=.-: 00:27:52.312 12:55:25 -- scripts/common.sh@335 -- # read -ra ver1 00:27:52.312 12:55:25 -- scripts/common.sh@336 -- # IFS=.-: 00:27:52.312 12:55:25 -- scripts/common.sh@336 -- # read -ra ver2 00:27:52.312 12:55:25 -- scripts/common.sh@337 -- # local 'op=<' 00:27:52.312 12:55:25 -- scripts/common.sh@339 -- # ver1_l=2 00:27:52.312 12:55:25 -- scripts/common.sh@340 -- # ver2_l=1 00:27:52.312 12:55:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:52.312 12:55:25 -- scripts/common.sh@343 -- # case "$op" in 00:27:52.312 12:55:25 -- scripts/common.sh@344 -- # : 1 00:27:52.312 12:55:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:52.312 12:55:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:52.312 12:55:25 -- scripts/common.sh@364 -- # decimal 1 00:27:52.312 12:55:25 -- scripts/common.sh@352 -- # local d=1 00:27:52.312 12:55:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:52.312 12:55:25 -- scripts/common.sh@354 -- # echo 1 00:27:52.312 12:55:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:52.312 12:55:25 -- scripts/common.sh@365 -- # decimal 2 00:27:52.312 12:55:25 -- scripts/common.sh@352 -- # local d=2 00:27:52.312 12:55:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:52.312 12:55:25 -- scripts/common.sh@354 -- # echo 2 00:27:52.312 12:55:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:52.312 12:55:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:52.312 12:55:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:52.312 12:55:25 -- scripts/common.sh@367 -- # return 0 00:27:52.312 12:55:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:52.312 12:55:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:52.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.312 --rc genhtml_branch_coverage=1 00:27:52.312 --rc genhtml_function_coverage=1 00:27:52.312 --rc genhtml_legend=1 00:27:52.312 --rc geninfo_all_blocks=1 00:27:52.312 --rc geninfo_unexecuted_blocks=1 00:27:52.312 00:27:52.312 ' 00:27:52.312 12:55:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:52.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.312 --rc genhtml_branch_coverage=1 00:27:52.312 --rc genhtml_function_coverage=1 00:27:52.312 --rc genhtml_legend=1 00:27:52.312 --rc geninfo_all_blocks=1 00:27:52.312 --rc geninfo_unexecuted_blocks=1 00:27:52.312 00:27:52.312 ' 00:27:52.312 12:55:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:52.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.312 --rc genhtml_branch_coverage=1 00:27:52.312 --rc genhtml_function_coverage=1 00:27:52.312 --rc genhtml_legend=1 00:27:52.312 --rc geninfo_all_blocks=1 00:27:52.312 --rc geninfo_unexecuted_blocks=1 00:27:52.312 00:27:52.313 ' 00:27:52.313 12:55:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:52.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.313 --rc genhtml_branch_coverage=1 00:27:52.313 --rc genhtml_function_coverage=1 00:27:52.313 --rc genhtml_legend=1 00:27:52.313 --rc geninfo_all_blocks=1 00:27:52.313 --rc geninfo_unexecuted_blocks=1 00:27:52.313 00:27:52.313 ' 00:27:52.313 12:55:25 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:52.313 12:55:25 -- nvmf/common.sh@7 -- # uname -s 00:27:52.313 12:55:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:52.313 12:55:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:52.313 12:55:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:52.313 12:55:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:52.313 12:55:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:52.313 12:55:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:52.313 12:55:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:52.313 12:55:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:52.313 12:55:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:52.313 12:55:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:52.313 12:55:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:52.313 12:55:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:52.313 12:55:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:52.313 12:55:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:52.313 12:55:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:52.313 12:55:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:52.313 12:55:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:52.313 12:55:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:52.313 12:55:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:52.313 12:55:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.313 12:55:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.313 12:55:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.313 12:55:25 -- paths/export.sh@5 -- # export PATH 00:27:52.313 12:55:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.313 12:55:25 -- nvmf/common.sh@46 -- # : 0 00:27:52.313 12:55:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:52.313 12:55:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:52.313 12:55:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:52.313 12:55:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:52.313 12:55:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:52.313 12:55:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:52.313 12:55:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:52.313 12:55:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:52.313 12:55:25 -- target/dif.sh@15 -- # NULL_META=16 00:27:52.313 12:55:25 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:27:52.313 12:55:25 -- target/dif.sh@15 -- # NULL_SIZE=64 00:27:52.313 12:55:25 -- target/dif.sh@15 -- # NULL_DIF=1 00:27:52.313 12:55:25 -- target/dif.sh@135 -- # nvmftestinit 00:27:52.313 12:55:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:52.313 12:55:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:52.313 12:55:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:52.313 12:55:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:52.313 12:55:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:52.313 12:55:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:52.313 12:55:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:52.313 12:55:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:52.313 12:55:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:52.313 12:55:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:52.313 12:55:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:52.313 12:55:25 -- common/autotest_common.sh@10 -- # set +x 00:27:54.266 12:55:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:54.267 12:55:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:54.267 12:55:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:54.267 12:55:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:54.267 12:55:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:54.267 12:55:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:54.267 12:55:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:54.267 12:55:27 -- nvmf/common.sh@294 -- # net_devs=() 00:27:54.267 12:55:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:54.267 12:55:27 -- nvmf/common.sh@295 -- # e810=() 00:27:54.267 12:55:27 -- nvmf/common.sh@295 -- # local -ga e810 00:27:54.267 12:55:27 -- nvmf/common.sh@296 -- # x722=() 00:27:54.267 12:55:27 -- nvmf/common.sh@296 -- # local -ga x722 00:27:54.267 12:55:27 -- nvmf/common.sh@297 -- # mlx=() 00:27:54.267 12:55:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:54.267 12:55:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:54.267 12:55:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:54.267 12:55:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:54.267 12:55:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:54.267 12:55:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.267 12:55:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:54.267 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:54.267 12:55:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.267 12:55:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:54.267 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:54.267 12:55:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:54.267 12:55:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.267 12:55:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.267 12:55:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.267 12:55:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.267 12:55:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:54.267 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:54.267 12:55:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.267 12:55:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.267 12:55:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.267 12:55:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.267 12:55:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.267 12:55:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:54.267 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:54.267 12:55:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.267 12:55:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:54.267 12:55:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:54.267 12:55:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:54.267 12:55:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:54.267 12:55:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:54.267 12:55:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:54.267 12:55:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:54.267 12:55:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:54.267 12:55:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:54.267 12:55:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:54.267 12:55:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:54.267 12:55:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:54.267 12:55:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:54.267 12:55:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:54.267 12:55:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:54.267 12:55:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:54.267 12:55:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:54.267 12:55:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:54.267 12:55:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:54.267 12:55:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:54.267 12:55:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:54.267 12:55:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:54.267 12:55:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:54.267 12:55:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:54.267 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:54.267 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:27:54.267 00:27:54.267 --- 10.0.0.2 ping statistics --- 00:27:54.267 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.267 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:27:54.267 12:55:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:54.267 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:54.267 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:27:54.267 00:27:54.267 --- 10.0.0.1 ping statistics --- 00:27:54.267 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.267 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:27:54.267 12:55:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:54.267 12:55:27 -- nvmf/common.sh@410 -- # return 0 00:27:54.267 12:55:27 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:27:54.267 12:55:27 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:27:55.640 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:27:55.641 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:27:55.641 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:27:55.641 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:27:55.641 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:27:55.641 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:27:55.641 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:27:55.641 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:27:55.641 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:27:55.641 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:27:55.641 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:27:55.641 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:27:55.641 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:27:55.641 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:27:55.641 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:27:55.641 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:27:55.641 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:27:55.641 12:55:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:55.641 12:55:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:55.641 12:55:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:55.641 12:55:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:55.641 12:55:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:55.641 12:55:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:55.641 12:55:28 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:27:55.641 12:55:28 -- target/dif.sh@137 -- # nvmfappstart 00:27:55.641 12:55:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:55.641 12:55:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:55.641 12:55:28 -- common/autotest_common.sh@10 -- # set +x 00:27:55.641 12:55:28 -- nvmf/common.sh@469 -- # nvmfpid=3654549 00:27:55.641 12:55:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:27:55.641 12:55:28 -- nvmf/common.sh@470 -- # waitforlisten 3654549 00:27:55.641 12:55:28 -- common/autotest_common.sh@829 -- # '[' -z 3654549 ']' 00:27:55.641 12:55:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:55.641 12:55:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:55.641 12:55:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:55.641 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:55.641 12:55:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:55.641 12:55:28 -- common/autotest_common.sh@10 -- # set +x 00:27:55.641 [2024-11-20 12:55:28.699093] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:55.641 [2024-11-20 12:55:28.699157] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:55.641 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.898 [2024-11-20 12:55:28.760733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:55.898 [2024-11-20 12:55:28.864352] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:55.898 [2024-11-20 12:55:28.864550] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:55.898 [2024-11-20 12:55:28.864567] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:55.898 [2024-11-20 12:55:28.864590] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:55.898 [2024-11-20 12:55:28.864620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:56.832 12:55:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:56.832 12:55:29 -- common/autotest_common.sh@862 -- # return 0 00:27:56.832 12:55:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:56.832 12:55:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 12:55:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:56.832 12:55:29 -- target/dif.sh@139 -- # create_transport 00:27:56.832 12:55:29 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:27:56.832 12:55:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 [2024-11-20 12:55:29.700969] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:56.832 12:55:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.832 12:55:29 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:27:56.832 12:55:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:56.832 12:55:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 ************************************ 00:27:56.832 START TEST fio_dif_1_default 00:27:56.832 ************************************ 00:27:56.832 12:55:29 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:27:56.832 12:55:29 -- target/dif.sh@86 -- # create_subsystems 0 00:27:56.832 12:55:29 -- target/dif.sh@28 -- # local sub 00:27:56.832 12:55:29 -- target/dif.sh@30 -- # for sub in "$@" 00:27:56.832 12:55:29 -- target/dif.sh@31 -- # create_subsystem 0 00:27:56.832 12:55:29 -- target/dif.sh@18 -- # local sub_id=0 00:27:56.832 12:55:29 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:27:56.832 12:55:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 bdev_null0 00:27:56.832 12:55:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.832 12:55:29 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:56.832 12:55:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 12:55:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.832 12:55:29 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:56.832 12:55:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 12:55:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.832 12:55:29 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:56.832 12:55:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.832 12:55:29 -- common/autotest_common.sh@10 -- # set +x 00:27:56.832 [2024-11-20 12:55:29.737273] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:56.832 12:55:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.832 12:55:29 -- target/dif.sh@87 -- # fio /dev/fd/62 00:27:56.832 12:55:29 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:27:56.832 12:55:29 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:27:56.832 12:55:29 -- nvmf/common.sh@520 -- # config=() 00:27:56.832 12:55:29 -- nvmf/common.sh@520 -- # local subsystem config 00:27:56.832 12:55:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:56.832 12:55:29 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:56.832 12:55:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:56.832 { 00:27:56.832 "params": { 00:27:56.832 "name": "Nvme$subsystem", 00:27:56.832 "trtype": "$TEST_TRANSPORT", 00:27:56.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:56.832 "adrfam": "ipv4", 00:27:56.832 "trsvcid": "$NVMF_PORT", 00:27:56.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:56.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:56.832 "hdgst": ${hdgst:-false}, 00:27:56.832 "ddgst": ${ddgst:-false} 00:27:56.832 }, 00:27:56.832 "method": "bdev_nvme_attach_controller" 00:27:56.832 } 00:27:56.832 EOF 00:27:56.832 )") 00:27:56.832 12:55:29 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:56.832 12:55:29 -- target/dif.sh@82 -- # gen_fio_conf 00:27:56.832 12:55:29 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:56.832 12:55:29 -- target/dif.sh@54 -- # local file 00:27:56.832 12:55:29 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:56.832 12:55:29 -- target/dif.sh@56 -- # cat 00:27:56.832 12:55:29 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:56.832 12:55:29 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:56.832 12:55:29 -- common/autotest_common.sh@1330 -- # shift 00:27:56.832 12:55:29 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:56.832 12:55:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:56.832 12:55:29 -- nvmf/common.sh@542 -- # cat 00:27:56.832 12:55:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:56.832 12:55:29 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:56.832 12:55:29 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:56.832 12:55:29 -- target/dif.sh@72 -- # (( file <= files )) 00:27:56.833 12:55:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:56.833 12:55:29 -- nvmf/common.sh@544 -- # jq . 00:27:56.833 12:55:29 -- nvmf/common.sh@545 -- # IFS=, 00:27:56.833 12:55:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:56.833 "params": { 00:27:56.833 "name": "Nvme0", 00:27:56.833 "trtype": "tcp", 00:27:56.833 "traddr": "10.0.0.2", 00:27:56.833 "adrfam": "ipv4", 00:27:56.833 "trsvcid": "4420", 00:27:56.833 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:56.833 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:56.833 "hdgst": false, 00:27:56.833 "ddgst": false 00:27:56.833 }, 00:27:56.833 "method": "bdev_nvme_attach_controller" 00:27:56.833 }' 00:27:56.833 12:55:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:56.833 12:55:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:56.833 12:55:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:56.833 12:55:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:56.833 12:55:29 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:56.833 12:55:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:56.833 12:55:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:56.833 12:55:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:56.833 12:55:29 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:56.833 12:55:29 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:57.092 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:27:57.092 fio-3.35 00:27:57.092 Starting 1 thread 00:27:57.092 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.658 [2024-11-20 12:55:30.605586] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:57.658 [2024-11-20 12:55:30.605638] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:07.623 00:28:07.623 filename0: (groupid=0, jobs=1): err= 0: pid=3654912: Wed Nov 20 12:55:40 2024 00:28:07.623 read: IOPS=188, BW=755KiB/s (773kB/s)(7552KiB/10005msec) 00:28:07.623 slat (nsec): min=4467, max=46310, avg=8170.28, stdev=2574.56 00:28:07.623 clat (usec): min=572, max=48647, avg=21170.93, stdev=20345.47 00:28:07.623 lat (usec): min=578, max=48670, avg=21179.10, stdev=20345.36 00:28:07.624 clat percentiles (usec): 00:28:07.624 | 1.00th=[ 603], 5.00th=[ 627], 10.00th=[ 635], 20.00th=[ 652], 00:28:07.624 | 30.00th=[ 660], 40.00th=[ 685], 50.00th=[41157], 60.00th=[41157], 00:28:07.624 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:07.624 | 99.00th=[42206], 99.50th=[42206], 99.90th=[48497], 99.95th=[48497], 00:28:07.624 | 99.99th=[48497] 00:28:07.624 bw ( KiB/s): min= 672, max= 768, per=99.76%, avg=753.60, stdev=30.22, samples=20 00:28:07.624 iops : min= 168, max= 192, avg=188.40, stdev= 7.56, samples=20 00:28:07.624 lat (usec) : 750=47.99%, 1000=1.59% 00:28:07.624 lat (msec) : 50=50.42% 00:28:07.624 cpu : usr=91.39%, sys=8.32%, ctx=30, majf=0, minf=258 00:28:07.624 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:07.624 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:07.624 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:07.624 issued rwts: total=1888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:07.624 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:07.624 00:28:07.624 Run status group 0 (all jobs): 00:28:07.624 READ: bw=755KiB/s (773kB/s), 755KiB/s-755KiB/s (773kB/s-773kB/s), io=7552KiB (7733kB), run=10005-10005msec 00:28:08.190 12:55:41 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:08.190 12:55:41 -- target/dif.sh@43 -- # local sub 00:28:08.190 12:55:41 -- target/dif.sh@45 -- # for sub in "$@" 00:28:08.190 12:55:41 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:08.190 12:55:41 -- target/dif.sh@36 -- # local sub_id=0 00:28:08.190 12:55:41 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 00:28:08.190 real 0m11.326s 00:28:08.190 user 0m10.441s 00:28:08.190 sys 0m1.155s 00:28:08.190 12:55:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 ************************************ 00:28:08.190 END TEST fio_dif_1_default 00:28:08.190 ************************************ 00:28:08.190 12:55:41 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:08.190 12:55:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:08.190 12:55:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 ************************************ 00:28:08.190 START TEST fio_dif_1_multi_subsystems 00:28:08.190 ************************************ 00:28:08.190 12:55:41 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:08.190 12:55:41 -- target/dif.sh@92 -- # local files=1 00:28:08.190 12:55:41 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:08.190 12:55:41 -- target/dif.sh@28 -- # local sub 00:28:08.190 12:55:41 -- target/dif.sh@30 -- # for sub in "$@" 00:28:08.190 12:55:41 -- target/dif.sh@31 -- # create_subsystem 0 00:28:08.190 12:55:41 -- target/dif.sh@18 -- # local sub_id=0 00:28:08.190 12:55:41 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 bdev_null0 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 [2024-11-20 12:55:41.095888] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@30 -- # for sub in "$@" 00:28:08.190 12:55:41 -- target/dif.sh@31 -- # create_subsystem 1 00:28:08.190 12:55:41 -- target/dif.sh@18 -- # local sub_id=1 00:28:08.190 12:55:41 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 bdev_null1 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:08.190 12:55:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.190 12:55:41 -- common/autotest_common.sh@10 -- # set +x 00:28:08.190 12:55:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.190 12:55:41 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:08.190 12:55:41 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:08.190 12:55:41 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:08.190 12:55:41 -- nvmf/common.sh@520 -- # config=() 00:28:08.190 12:55:41 -- nvmf/common.sh@520 -- # local subsystem config 00:28:08.190 12:55:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:08.190 12:55:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:08.190 { 00:28:08.190 "params": { 00:28:08.190 "name": "Nvme$subsystem", 00:28:08.190 "trtype": "$TEST_TRANSPORT", 00:28:08.190 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:08.190 "adrfam": "ipv4", 00:28:08.190 "trsvcid": "$NVMF_PORT", 00:28:08.190 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:08.190 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:08.190 "hdgst": ${hdgst:-false}, 00:28:08.190 "ddgst": ${ddgst:-false} 00:28:08.190 }, 00:28:08.190 "method": "bdev_nvme_attach_controller" 00:28:08.190 } 00:28:08.190 EOF 00:28:08.190 )") 00:28:08.190 12:55:41 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:08.190 12:55:41 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:08.191 12:55:41 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:08.191 12:55:41 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:08.191 12:55:41 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:08.191 12:55:41 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:08.191 12:55:41 -- target/dif.sh@82 -- # gen_fio_conf 00:28:08.191 12:55:41 -- common/autotest_common.sh@1330 -- # shift 00:28:08.191 12:55:41 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:08.191 12:55:41 -- target/dif.sh@54 -- # local file 00:28:08.191 12:55:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:08.191 12:55:41 -- target/dif.sh@56 -- # cat 00:28:08.191 12:55:41 -- nvmf/common.sh@542 -- # cat 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:08.191 12:55:41 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:08.191 12:55:41 -- target/dif.sh@72 -- # (( file <= files )) 00:28:08.191 12:55:41 -- target/dif.sh@73 -- # cat 00:28:08.191 12:55:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:08.191 12:55:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:08.191 { 00:28:08.191 "params": { 00:28:08.191 "name": "Nvme$subsystem", 00:28:08.191 "trtype": "$TEST_TRANSPORT", 00:28:08.191 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:08.191 "adrfam": "ipv4", 00:28:08.191 "trsvcid": "$NVMF_PORT", 00:28:08.191 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:08.191 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:08.191 "hdgst": ${hdgst:-false}, 00:28:08.191 "ddgst": ${ddgst:-false} 00:28:08.191 }, 00:28:08.191 "method": "bdev_nvme_attach_controller" 00:28:08.191 } 00:28:08.191 EOF 00:28:08.191 )") 00:28:08.191 12:55:41 -- nvmf/common.sh@542 -- # cat 00:28:08.191 12:55:41 -- target/dif.sh@72 -- # (( file++ )) 00:28:08.191 12:55:41 -- target/dif.sh@72 -- # (( file <= files )) 00:28:08.191 12:55:41 -- nvmf/common.sh@544 -- # jq . 00:28:08.191 12:55:41 -- nvmf/common.sh@545 -- # IFS=, 00:28:08.191 12:55:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:08.191 "params": { 00:28:08.191 "name": "Nvme0", 00:28:08.191 "trtype": "tcp", 00:28:08.191 "traddr": "10.0.0.2", 00:28:08.191 "adrfam": "ipv4", 00:28:08.191 "trsvcid": "4420", 00:28:08.191 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:08.191 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:08.191 "hdgst": false, 00:28:08.191 "ddgst": false 00:28:08.191 }, 00:28:08.191 "method": "bdev_nvme_attach_controller" 00:28:08.191 },{ 00:28:08.191 "params": { 00:28:08.191 "name": "Nvme1", 00:28:08.191 "trtype": "tcp", 00:28:08.191 "traddr": "10.0.0.2", 00:28:08.191 "adrfam": "ipv4", 00:28:08.191 "trsvcid": "4420", 00:28:08.191 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:08.191 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:08.191 "hdgst": false, 00:28:08.191 "ddgst": false 00:28:08.191 }, 00:28:08.191 "method": "bdev_nvme_attach_controller" 00:28:08.191 }' 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:08.191 12:55:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:08.191 12:55:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:08.191 12:55:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:08.191 12:55:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:08.191 12:55:41 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:08.191 12:55:41 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:08.449 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:08.449 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:08.449 fio-3.35 00:28:08.449 Starting 2 threads 00:28:08.449 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.016 [2024-11-20 12:55:42.011558] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:09.016 [2024-11-20 12:55:42.011623] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:21.225 00:28:21.225 filename0: (groupid=0, jobs=1): err= 0: pid=3656353: Wed Nov 20 12:55:52 2024 00:28:21.225 read: IOPS=189, BW=759KiB/s (777kB/s)(7600KiB/10012msec) 00:28:21.225 slat (nsec): min=7141, max=28772, avg=9221.86, stdev=2586.42 00:28:21.225 clat (usec): min=553, max=44302, avg=21047.79, stdev=20396.53 00:28:21.225 lat (usec): min=561, max=44322, avg=21057.01, stdev=20396.30 00:28:21.225 clat percentiles (usec): 00:28:21.225 | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 603], 00:28:21.225 | 30.00th=[ 611], 40.00th=[ 627], 50.00th=[41157], 60.00th=[41157], 00:28:21.225 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:21.225 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:28:21.225 | 99.99th=[44303] 00:28:21.225 bw ( KiB/s): min= 704, max= 768, per=50.09%, avg=758.40, stdev=23.45, samples=20 00:28:21.225 iops : min= 176, max= 192, avg=189.60, stdev= 5.86, samples=20 00:28:21.225 lat (usec) : 750=49.26%, 1000=0.63% 00:28:21.225 lat (msec) : 50=50.11% 00:28:21.225 cpu : usr=95.30%, sys=4.29%, ctx=65, majf=0, minf=146 00:28:21.225 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:21.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:21.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:21.225 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:21.225 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:21.225 filename1: (groupid=0, jobs=1): err= 0: pid=3656354: Wed Nov 20 12:55:52 2024 00:28:21.225 read: IOPS=188, BW=755KiB/s (773kB/s)(7552KiB/10001msec) 00:28:21.225 slat (nsec): min=4956, max=37249, avg=9327.93, stdev=2475.08 00:28:21.225 clat (usec): min=574, max=45670, avg=21158.02, stdev=20354.04 00:28:21.225 lat (usec): min=582, max=45685, avg=21167.35, stdev=20353.86 00:28:21.225 clat percentiles (usec): 00:28:21.225 | 1.00th=[ 586], 5.00th=[ 603], 10.00th=[ 611], 20.00th=[ 627], 00:28:21.225 | 30.00th=[ 652], 40.00th=[ 668], 50.00th=[41157], 60.00th=[41157], 00:28:21.225 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:21.225 | 99.00th=[41681], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876], 00:28:21.225 | 99.99th=[45876] 00:28:21.225 bw ( KiB/s): min= 672, max= 768, per=49.95%, avg=756.21, stdev=28.64, samples=19 00:28:21.225 iops : min= 168, max= 192, avg=189.05, stdev= 7.16, samples=19 00:28:21.225 lat (usec) : 750=49.58% 00:28:21.225 lat (msec) : 50=50.42% 00:28:21.225 cpu : usr=96.07%, sys=3.59%, ctx=21, majf=0, minf=159 00:28:21.225 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:21.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:21.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:21.225 issued rwts: total=1888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:21.225 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:21.225 00:28:21.225 Run status group 0 (all jobs): 00:28:21.225 READ: bw=1513KiB/s (1550kB/s), 755KiB/s-759KiB/s (773kB/s-777kB/s), io=14.8MiB (15.5MB), run=10001-10012msec 00:28:21.225 12:55:52 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:21.225 12:55:52 -- target/dif.sh@43 -- # local sub 00:28:21.225 12:55:52 -- target/dif.sh@45 -- # for sub in "$@" 00:28:21.225 12:55:52 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:21.225 12:55:52 -- target/dif.sh@36 -- # local sub_id=0 00:28:21.225 12:55:52 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:21.225 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.225 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.225 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.225 12:55:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:21.225 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.225 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.225 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.225 12:55:52 -- target/dif.sh@45 -- # for sub in "$@" 00:28:21.225 12:55:52 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:21.225 12:55:52 -- target/dif.sh@36 -- # local sub_id=1 00:28:21.225 12:55:52 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:21.225 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.225 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.225 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.225 12:55:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:21.225 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.225 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.225 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.225 00:28:21.225 real 0m11.437s 00:28:21.225 user 0m20.650s 00:28:21.225 sys 0m1.103s 00:28:21.225 12:55:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:21.225 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.225 ************************************ 00:28:21.225 END TEST fio_dif_1_multi_subsystems 00:28:21.225 ************************************ 00:28:21.225 12:55:52 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:21.225 12:55:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:21.225 12:55:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:21.225 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.225 ************************************ 00:28:21.225 START TEST fio_dif_rand_params 00:28:21.225 ************************************ 00:28:21.225 12:55:52 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:21.225 12:55:52 -- target/dif.sh@100 -- # local NULL_DIF 00:28:21.225 12:55:52 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:21.226 12:55:52 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:21.226 12:55:52 -- target/dif.sh@103 -- # bs=128k 00:28:21.226 12:55:52 -- target/dif.sh@103 -- # numjobs=3 00:28:21.226 12:55:52 -- target/dif.sh@103 -- # iodepth=3 00:28:21.226 12:55:52 -- target/dif.sh@103 -- # runtime=5 00:28:21.226 12:55:52 -- target/dif.sh@105 -- # create_subsystems 0 00:28:21.226 12:55:52 -- target/dif.sh@28 -- # local sub 00:28:21.226 12:55:52 -- target/dif.sh@30 -- # for sub in "$@" 00:28:21.226 12:55:52 -- target/dif.sh@31 -- # create_subsystem 0 00:28:21.226 12:55:52 -- target/dif.sh@18 -- # local sub_id=0 00:28:21.226 12:55:52 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:21.226 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.226 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.226 bdev_null0 00:28:21.226 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.226 12:55:52 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:21.226 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.226 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.226 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.226 12:55:52 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:21.226 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.226 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.226 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.226 12:55:52 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:21.226 12:55:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:21.226 12:55:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.226 [2024-11-20 12:55:52.566848] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:21.226 12:55:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:21.226 12:55:52 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:21.226 12:55:52 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:21.226 12:55:52 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:21.226 12:55:52 -- nvmf/common.sh@520 -- # config=() 00:28:21.226 12:55:52 -- nvmf/common.sh@520 -- # local subsystem config 00:28:21.226 12:55:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:21.226 12:55:52 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:21.226 12:55:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:21.226 { 00:28:21.226 "params": { 00:28:21.226 "name": "Nvme$subsystem", 00:28:21.226 "trtype": "$TEST_TRANSPORT", 00:28:21.226 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:21.226 "adrfam": "ipv4", 00:28:21.226 "trsvcid": "$NVMF_PORT", 00:28:21.226 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:21.226 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:21.226 "hdgst": ${hdgst:-false}, 00:28:21.226 "ddgst": ${ddgst:-false} 00:28:21.226 }, 00:28:21.226 "method": "bdev_nvme_attach_controller" 00:28:21.226 } 00:28:21.226 EOF 00:28:21.226 )") 00:28:21.226 12:55:52 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:21.226 12:55:52 -- target/dif.sh@82 -- # gen_fio_conf 00:28:21.226 12:55:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:21.226 12:55:52 -- target/dif.sh@54 -- # local file 00:28:21.226 12:55:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:21.226 12:55:52 -- target/dif.sh@56 -- # cat 00:28:21.226 12:55:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:21.226 12:55:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:21.226 12:55:52 -- common/autotest_common.sh@1330 -- # shift 00:28:21.226 12:55:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:21.226 12:55:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:21.226 12:55:52 -- nvmf/common.sh@542 -- # cat 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:21.226 12:55:52 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:21.226 12:55:52 -- target/dif.sh@72 -- # (( file <= files )) 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:21.226 12:55:52 -- nvmf/common.sh@544 -- # jq . 00:28:21.226 12:55:52 -- nvmf/common.sh@545 -- # IFS=, 00:28:21.226 12:55:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:21.226 "params": { 00:28:21.226 "name": "Nvme0", 00:28:21.226 "trtype": "tcp", 00:28:21.226 "traddr": "10.0.0.2", 00:28:21.226 "adrfam": "ipv4", 00:28:21.226 "trsvcid": "4420", 00:28:21.226 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:21.226 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:21.226 "hdgst": false, 00:28:21.226 "ddgst": false 00:28:21.226 }, 00:28:21.226 "method": "bdev_nvme_attach_controller" 00:28:21.226 }' 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:21.226 12:55:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:21.226 12:55:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:21.226 12:55:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:21.226 12:55:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:21.226 12:55:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:21.226 12:55:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:21.226 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:21.226 ... 00:28:21.226 fio-3.35 00:28:21.226 Starting 3 threads 00:28:21.226 EAL: No free 2048 kB hugepages reported on node 1 00:28:21.226 [2024-11-20 12:55:53.334890] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:21.226 [2024-11-20 12:55:53.334973] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:25.414 00:28:25.414 filename0: (groupid=0, jobs=1): err= 0: pid=3657788: Wed Nov 20 12:55:58 2024 00:28:25.414 read: IOPS=248, BW=31.1MiB/s (32.6MB/s)(157MiB/5045msec) 00:28:25.414 slat (nsec): min=4498, max=58086, avg=16180.15, stdev=6574.68 00:28:25.414 clat (usec): min=4489, max=53239, avg=12005.42, stdev=6316.30 00:28:25.414 lat (usec): min=4501, max=53250, avg=12021.60, stdev=6316.27 00:28:25.414 clat percentiles (usec): 00:28:25.414 | 1.00th=[ 5080], 5.00th=[ 6259], 10.00th=[ 7767], 20.00th=[ 8979], 00:28:25.414 | 30.00th=[10028], 40.00th=[10683], 50.00th=[11338], 60.00th=[11863], 00:28:25.414 | 70.00th=[12518], 80.00th=[13304], 90.00th=[14615], 95.00th=[16188], 00:28:25.414 | 99.00th=[50070], 99.50th=[51119], 99.90th=[53216], 99.95th=[53216], 00:28:25.414 | 99.99th=[53216] 00:28:25.415 bw ( KiB/s): min=23040, max=37120, per=37.05%, avg=32076.80, stdev=4774.17, samples=10 00:28:25.415 iops : min= 180, max= 290, avg=250.60, stdev=37.30, samples=10 00:28:25.415 lat (msec) : 10=28.45%, 20=69.24%, 50=1.35%, 100=0.96% 00:28:25.415 cpu : usr=92.96%, sys=6.52%, ctx=15, majf=0, minf=112 00:28:25.415 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:25.415 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.415 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.415 issued rwts: total=1255,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:25.415 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:25.415 filename0: (groupid=0, jobs=1): err= 0: pid=3657789: Wed Nov 20 12:55:58 2024 00:28:25.415 read: IOPS=213, BW=26.7MiB/s (28.0MB/s)(134MiB/5004msec) 00:28:25.415 slat (nsec): min=4432, max=45111, avg=13086.16, stdev=3572.31 00:28:25.415 clat (usec): min=3986, max=55871, avg=14011.17, stdev=9009.52 00:28:25.415 lat (usec): min=3997, max=55883, avg=14024.26, stdev=9009.54 00:28:25.415 clat percentiles (usec): 00:28:25.415 | 1.00th=[ 5145], 5.00th=[ 7439], 10.00th=[ 8455], 20.00th=[ 9896], 00:28:25.415 | 30.00th=[10814], 40.00th=[11731], 50.00th=[12387], 60.00th=[13042], 00:28:25.415 | 70.00th=[13566], 80.00th=[14484], 90.00th=[15926], 95.00th=[46400], 00:28:25.415 | 99.00th=[52691], 99.50th=[53216], 99.90th=[55837], 99.95th=[55837], 00:28:25.415 | 99.99th=[55837] 00:28:25.415 bw ( KiB/s): min=19456, max=33024, per=31.55%, avg=27320.40, stdev=3931.11, samples=10 00:28:25.415 iops : min= 152, max= 258, avg=213.40, stdev=30.73, samples=10 00:28:25.415 lat (msec) : 4=0.09%, 10=20.37%, 20=74.21%, 50=2.15%, 100=3.18% 00:28:25.415 cpu : usr=93.78%, sys=5.74%, ctx=19, majf=0, minf=133 00:28:25.415 IO depths : 1=1.4%, 2=98.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:25.415 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.415 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.415 issued rwts: total=1070,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:25.415 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:25.415 filename0: (groupid=0, jobs=1): err= 0: pid=3657790: Wed Nov 20 12:55:58 2024 00:28:25.415 read: IOPS=215, BW=27.0MiB/s (28.3MB/s)(136MiB/5047msec) 00:28:25.415 slat (usec): min=4, max=228, avg=13.22, stdev= 7.35 00:28:25.415 clat (usec): min=4571, max=91643, avg=13843.64, stdev=8918.45 00:28:25.415 lat (usec): min=4582, max=91654, avg=13856.86, stdev=8918.50 00:28:25.415 clat percentiles (usec): 00:28:25.415 | 1.00th=[ 4948], 5.00th=[ 6521], 10.00th=[ 8160], 20.00th=[ 9765], 00:28:25.415 | 30.00th=[11076], 40.00th=[11994], 50.00th=[12649], 60.00th=[13304], 00:28:25.415 | 70.00th=[13829], 80.00th=[14615], 90.00th=[15533], 95.00th=[18482], 00:28:25.415 | 99.00th=[52167], 99.50th=[53740], 99.90th=[56361], 99.95th=[91751], 00:28:25.415 | 99.99th=[91751] 00:28:25.415 bw ( KiB/s): min=20992, max=30464, per=32.14%, avg=27827.20, stdev=3172.40, samples=10 00:28:25.415 iops : min= 164, max= 238, avg=217.40, stdev=24.78, samples=10 00:28:25.415 lat (msec) : 10=21.30%, 20=73.92%, 50=1.93%, 100=2.85% 00:28:25.415 cpu : usr=93.54%, sys=5.97%, ctx=13, majf=0, minf=124 00:28:25.415 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:25.415 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.415 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.415 issued rwts: total=1089,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:25.415 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:25.415 00:28:25.415 Run status group 0 (all jobs): 00:28:25.415 READ: bw=84.6MiB/s (88.7MB/s), 26.7MiB/s-31.1MiB/s (28.0MB/s-32.6MB/s), io=427MiB (447MB), run=5004-5047msec 00:28:25.673 12:55:58 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:25.673 12:55:58 -- target/dif.sh@43 -- # local sub 00:28:25.673 12:55:58 -- target/dif.sh@45 -- # for sub in "$@" 00:28:25.673 12:55:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:25.673 12:55:58 -- target/dif.sh@36 -- # local sub_id=0 00:28:25.673 12:55:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:25.673 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.673 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.673 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.673 12:55:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:25.673 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.673 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.673 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.673 12:55:58 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:25.673 12:55:58 -- target/dif.sh@109 -- # bs=4k 00:28:25.673 12:55:58 -- target/dif.sh@109 -- # numjobs=8 00:28:25.673 12:55:58 -- target/dif.sh@109 -- # iodepth=16 00:28:25.673 12:55:58 -- target/dif.sh@109 -- # runtime= 00:28:25.673 12:55:58 -- target/dif.sh@109 -- # files=2 00:28:25.673 12:55:58 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:25.673 12:55:58 -- target/dif.sh@28 -- # local sub 00:28:25.673 12:55:58 -- target/dif.sh@30 -- # for sub in "$@" 00:28:25.673 12:55:58 -- target/dif.sh@31 -- # create_subsystem 0 00:28:25.673 12:55:58 -- target/dif.sh@18 -- # local sub_id=0 00:28:25.673 12:55:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:25.673 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.673 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.673 bdev_null0 00:28:25.673 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.673 12:55:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:25.673 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.673 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.673 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.673 12:55:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:25.673 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.673 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.673 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.673 12:55:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:25.673 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.673 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.673 [2024-11-20 12:55:58.764579] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:25.674 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.674 12:55:58 -- target/dif.sh@30 -- # for sub in "$@" 00:28:25.674 12:55:58 -- target/dif.sh@31 -- # create_subsystem 1 00:28:25.674 12:55:58 -- target/dif.sh@18 -- # local sub_id=1 00:28:25.674 12:55:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:25.674 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.674 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.674 bdev_null1 00:28:25.674 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.674 12:55:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:25.674 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.674 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:25.932 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.932 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:25.932 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.932 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@30 -- # for sub in "$@" 00:28:25.932 12:55:58 -- target/dif.sh@31 -- # create_subsystem 2 00:28:25.932 12:55:58 -- target/dif.sh@18 -- # local sub_id=2 00:28:25.932 12:55:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:25.932 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.932 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 bdev_null2 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:25.932 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.932 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:25.932 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.932 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:25.932 12:55:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.932 12:55:58 -- common/autotest_common.sh@10 -- # set +x 00:28:25.932 12:55:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.932 12:55:58 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:25.932 12:55:58 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:25.932 12:55:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:25.932 12:55:58 -- nvmf/common.sh@520 -- # config=() 00:28:25.932 12:55:58 -- nvmf/common.sh@520 -- # local subsystem config 00:28:25.932 12:55:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:25.932 12:55:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:25.932 { 00:28:25.932 "params": { 00:28:25.932 "name": "Nvme$subsystem", 00:28:25.932 "trtype": "$TEST_TRANSPORT", 00:28:25.932 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:25.932 "adrfam": "ipv4", 00:28:25.932 "trsvcid": "$NVMF_PORT", 00:28:25.932 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:25.932 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:25.932 "hdgst": ${hdgst:-false}, 00:28:25.932 "ddgst": ${ddgst:-false} 00:28:25.932 }, 00:28:25.933 "method": "bdev_nvme_attach_controller" 00:28:25.933 } 00:28:25.933 EOF 00:28:25.933 )") 00:28:25.933 12:55:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.933 12:55:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.933 12:55:58 -- target/dif.sh@82 -- # gen_fio_conf 00:28:25.933 12:55:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:25.933 12:55:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:25.933 12:55:58 -- target/dif.sh@54 -- # local file 00:28:25.933 12:55:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:25.933 12:55:58 -- target/dif.sh@56 -- # cat 00:28:25.933 12:55:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.933 12:55:58 -- common/autotest_common.sh@1330 -- # shift 00:28:25.933 12:55:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:25.933 12:55:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.933 12:55:58 -- nvmf/common.sh@542 -- # cat 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.933 12:55:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:25.933 12:55:58 -- target/dif.sh@72 -- # (( file <= files )) 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:25.933 12:55:58 -- target/dif.sh@73 -- # cat 00:28:25.933 12:55:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:25.933 12:55:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:25.933 { 00:28:25.933 "params": { 00:28:25.933 "name": "Nvme$subsystem", 00:28:25.933 "trtype": "$TEST_TRANSPORT", 00:28:25.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:25.933 "adrfam": "ipv4", 00:28:25.933 "trsvcid": "$NVMF_PORT", 00:28:25.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:25.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:25.933 "hdgst": ${hdgst:-false}, 00:28:25.933 "ddgst": ${ddgst:-false} 00:28:25.933 }, 00:28:25.933 "method": "bdev_nvme_attach_controller" 00:28:25.933 } 00:28:25.933 EOF 00:28:25.933 )") 00:28:25.933 12:55:58 -- nvmf/common.sh@542 -- # cat 00:28:25.933 12:55:58 -- target/dif.sh@72 -- # (( file++ )) 00:28:25.933 12:55:58 -- target/dif.sh@72 -- # (( file <= files )) 00:28:25.933 12:55:58 -- target/dif.sh@73 -- # cat 00:28:25.933 12:55:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:25.933 12:55:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:25.933 { 00:28:25.933 "params": { 00:28:25.933 "name": "Nvme$subsystem", 00:28:25.933 "trtype": "$TEST_TRANSPORT", 00:28:25.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:25.933 "adrfam": "ipv4", 00:28:25.933 "trsvcid": "$NVMF_PORT", 00:28:25.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:25.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:25.933 "hdgst": ${hdgst:-false}, 00:28:25.933 "ddgst": ${ddgst:-false} 00:28:25.933 }, 00:28:25.933 "method": "bdev_nvme_attach_controller" 00:28:25.933 } 00:28:25.933 EOF 00:28:25.933 )") 00:28:25.933 12:55:58 -- target/dif.sh@72 -- # (( file++ )) 00:28:25.933 12:55:58 -- target/dif.sh@72 -- # (( file <= files )) 00:28:25.933 12:55:58 -- nvmf/common.sh@542 -- # cat 00:28:25.933 12:55:58 -- nvmf/common.sh@544 -- # jq . 00:28:25.933 12:55:58 -- nvmf/common.sh@545 -- # IFS=, 00:28:25.933 12:55:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:25.933 "params": { 00:28:25.933 "name": "Nvme0", 00:28:25.933 "trtype": "tcp", 00:28:25.933 "traddr": "10.0.0.2", 00:28:25.933 "adrfam": "ipv4", 00:28:25.933 "trsvcid": "4420", 00:28:25.933 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:25.933 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:25.933 "hdgst": false, 00:28:25.933 "ddgst": false 00:28:25.933 }, 00:28:25.933 "method": "bdev_nvme_attach_controller" 00:28:25.933 },{ 00:28:25.933 "params": { 00:28:25.933 "name": "Nvme1", 00:28:25.933 "trtype": "tcp", 00:28:25.933 "traddr": "10.0.0.2", 00:28:25.933 "adrfam": "ipv4", 00:28:25.933 "trsvcid": "4420", 00:28:25.933 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:25.933 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:25.933 "hdgst": false, 00:28:25.933 "ddgst": false 00:28:25.933 }, 00:28:25.933 "method": "bdev_nvme_attach_controller" 00:28:25.933 },{ 00:28:25.933 "params": { 00:28:25.933 "name": "Nvme2", 00:28:25.933 "trtype": "tcp", 00:28:25.933 "traddr": "10.0.0.2", 00:28:25.933 "adrfam": "ipv4", 00:28:25.933 "trsvcid": "4420", 00:28:25.933 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:25.933 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:25.933 "hdgst": false, 00:28:25.933 "ddgst": false 00:28:25.933 }, 00:28:25.933 "method": "bdev_nvme_attach_controller" 00:28:25.933 }' 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:25.933 12:55:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:25.933 12:55:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:25.933 12:55:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:25.933 12:55:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:25.933 12:55:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:25.933 12:55:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:26.192 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:26.192 ... 00:28:26.192 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:26.192 ... 00:28:26.192 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:26.192 ... 00:28:26.192 fio-3.35 00:28:26.192 Starting 24 threads 00:28:26.192 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.126 [2024-11-20 12:56:00.118353] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:27.126 [2024-11-20 12:56:00.118432] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:39.335 00:28:39.335 filename0: (groupid=0, jobs=1): err= 0: pid=3658680: Wed Nov 20 12:56:10 2024 00:28:39.335 read: IOPS=64, BW=258KiB/s (264kB/s)(2608KiB/10109msec) 00:28:39.335 slat (nsec): min=6567, max=53525, avg=11059.28, stdev=5611.01 00:28:39.335 clat (msec): min=105, max=370, avg=247.55, stdev=39.19 00:28:39.335 lat (msec): min=105, max=370, avg=247.56, stdev=39.19 00:28:39.335 clat percentiles (msec): 00:28:39.335 | 1.00th=[ 107], 5.00th=[ 165], 10.00th=[ 218], 20.00th=[ 230], 00:28:39.335 | 30.00th=[ 236], 40.00th=[ 239], 50.00th=[ 251], 60.00th=[ 255], 00:28:39.335 | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 288], 95.00th=[ 292], 00:28:39.335 | 99.00th=[ 326], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], 00:28:39.335 | 99.99th=[ 372] 00:28:39.335 bw ( KiB/s): min= 176, max= 384, per=5.17%, avg=254.40, stdev=52.14, samples=20 00:28:39.335 iops : min= 44, max= 96, avg=63.60, stdev=13.04, samples=20 00:28:39.335 lat (msec) : 250=47.85%, 500=52.15% 00:28:39.335 cpu : usr=98.88%, sys=0.73%, ctx=13, majf=0, minf=64 00:28:39.335 IO depths : 1=0.2%, 2=0.8%, 4=8.0%, 8=78.7%, 16=12.4%, 32=0.0%, >=64=0.0% 00:28:39.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 complete : 0=0.0%, 4=89.2%, 8=5.3%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 issued rwts: total=652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.335 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.335 filename0: (groupid=0, jobs=1): err= 0: pid=3658681: Wed Nov 20 12:56:10 2024 00:28:39.335 read: IOPS=60, BW=243KiB/s (248kB/s)(2432KiB/10023msec) 00:28:39.335 slat (usec): min=7, max=116, avg=15.51, stdev=17.72 00:28:39.335 clat (msec): min=181, max=366, avg=263.61, stdev=39.34 00:28:39.335 lat (msec): min=181, max=366, avg=263.62, stdev=39.35 00:28:39.335 clat percentiles (msec): 00:28:39.335 | 1.00th=[ 182], 5.00th=[ 192], 10.00th=[ 211], 20.00th=[ 213], 00:28:39.335 | 30.00th=[ 259], 40.00th=[ 268], 50.00th=[ 271], 60.00th=[ 279], 00:28:39.335 | 70.00th=[ 288], 80.00th=[ 292], 90.00th=[ 300], 95.00th=[ 326], 00:28:39.335 | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], 00:28:39.335 | 99.99th=[ 368] 00:28:39.335 bw ( KiB/s): min= 127, max= 256, per=4.80%, avg=236.75, stdev=47.01, samples=20 00:28:39.335 iops : min= 31, max= 64, avg=59.15, stdev=11.85, samples=20 00:28:39.335 lat (msec) : 250=29.93%, 500=70.07% 00:28:39.335 cpu : usr=98.75%, sys=0.87%, ctx=25, majf=0, minf=25 00:28:39.335 IO depths : 1=4.8%, 2=11.0%, 4=25.0%, 8=51.5%, 16=7.7%, 32=0.0%, >=64=0.0% 00:28:39.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.335 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.335 filename0: (groupid=0, jobs=1): err= 0: pid=3658682: Wed Nov 20 12:56:10 2024 00:28:39.335 read: IOPS=55, BW=224KiB/s (229kB/s)(2256KiB/10085msec) 00:28:39.335 slat (usec): min=7, max=118, avg=22.03, stdev=17.02 00:28:39.335 clat (msec): min=83, max=484, avg=285.73, stdev=74.14 00:28:39.335 lat (msec): min=83, max=484, avg=285.76, stdev=74.14 00:28:39.335 clat percentiles (msec): 00:28:39.335 | 1.00th=[ 84], 5.00th=[ 178], 10.00th=[ 199], 20.00th=[ 230], 00:28:39.335 | 30.00th=[ 259], 40.00th=[ 271], 50.00th=[ 292], 60.00th=[ 300], 00:28:39.335 | 70.00th=[ 317], 80.00th=[ 368], 90.00th=[ 380], 95.00th=[ 380], 00:28:39.335 | 99.00th=[ 477], 99.50th=[ 481], 99.90th=[ 485], 99.95th=[ 485], 00:28:39.335 | 99.99th=[ 485] 00:28:39.335 bw ( KiB/s): min= 128, max= 368, per=4.46%, avg=219.15, stdev=64.62, samples=20 00:28:39.335 iops : min= 32, max= 92, avg=54.75, stdev=16.13, samples=20 00:28:39.335 lat (msec) : 100=2.84%, 250=24.82%, 500=72.34% 00:28:39.335 cpu : usr=98.81%, sys=0.67%, ctx=34, majf=0, minf=39 00:28:39.335 IO depths : 1=1.2%, 2=5.7%, 4=19.1%, 8=62.4%, 16=11.5%, 32=0.0%, >=64=0.0% 00:28:39.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 complete : 0=0.0%, 4=92.4%, 8=2.4%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 issued rwts: total=564,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.335 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.335 filename0: (groupid=0, jobs=1): err= 0: pid=3658683: Wed Nov 20 12:56:10 2024 00:28:39.335 read: IOPS=42, BW=171KiB/s (176kB/s)(1728KiB/10080msec) 00:28:39.335 slat (usec): min=3, max=150, avg=92.02, stdev=24.07 00:28:39.335 clat (msec): min=267, max=538, avg=372.54, stdev=45.63 00:28:39.335 lat (msec): min=267, max=538, avg=372.63, stdev=45.65 00:28:39.335 clat percentiles (msec): 00:28:39.335 | 1.00th=[ 268], 5.00th=[ 292], 10.00th=[ 309], 20.00th=[ 338], 00:28:39.335 | 30.00th=[ 368], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.335 | 70.00th=[ 393], 80.00th=[ 401], 90.00th=[ 426], 95.00th=[ 443], 00:28:39.335 | 99.00th=[ 477], 99.50th=[ 485], 99.90th=[ 542], 99.95th=[ 542], 00:28:39.335 | 99.99th=[ 542] 00:28:39.335 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=60.18, samples=20 00:28:39.335 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:28:39.335 lat (msec) : 500=99.54%, 750=0.46% 00:28:39.335 cpu : usr=98.11%, sys=1.18%, ctx=32, majf=0, minf=35 00:28:39.335 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:28:39.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.335 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.335 filename0: (groupid=0, jobs=1): err= 0: pid=3658684: Wed Nov 20 12:56:10 2024 00:28:39.335 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10071msec) 00:28:39.335 slat (nsec): min=6594, max=52080, avg=29382.63, stdev=7481.76 00:28:39.335 clat (msec): min=230, max=444, avg=372.68, stdev=40.49 00:28:39.335 lat (msec): min=230, max=444, avg=372.71, stdev=40.49 00:28:39.335 clat percentiles (msec): 00:28:39.335 | 1.00th=[ 271], 5.00th=[ 296], 10.00th=[ 300], 20.00th=[ 368], 00:28:39.335 | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.335 | 70.00th=[ 393], 80.00th=[ 401], 90.00th=[ 426], 95.00th=[ 443], 00:28:39.335 | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], 00:28:39.335 | 99.99th=[ 447] 00:28:39.335 bw ( KiB/s): min= 127, max= 256, per=3.38%, avg=166.35, stdev=51.79, samples=20 00:28:39.335 iops : min= 31, max= 64, avg=41.55, stdev=12.98, samples=20 00:28:39.335 lat (msec) : 250=0.46%, 500=99.54% 00:28:39.335 cpu : usr=98.96%, sys=0.67%, ctx=15, majf=0, minf=52 00:28:39.335 IO depths : 1=0.5%, 2=6.7%, 4=25.0%, 8=55.8%, 16=12.0%, 32=0.0%, >=64=0.0% 00:28:39.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.335 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.335 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.335 filename0: (groupid=0, jobs=1): err= 0: pid=3658685: Wed Nov 20 12:56:10 2024 00:28:39.335 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10067msec) 00:28:39.335 slat (usec): min=18, max=135, avg=87.59, stdev=15.30 00:28:39.335 clat (msec): min=227, max=438, avg=372.05, stdev=44.63 00:28:39.336 lat (msec): min=227, max=438, avg=372.14, stdev=44.63 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 228], 5.00th=[ 268], 10.00th=[ 288], 20.00th=[ 368], 00:28:39.336 | 30.00th=[ 372], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 388], 00:28:39.336 | 70.00th=[ 397], 80.00th=[ 401], 90.00th=[ 405], 95.00th=[ 414], 00:28:39.336 | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], 00:28:39.336 | 99.99th=[ 439] 00:28:39.336 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=60.18, samples=20 00:28:39.336 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:28:39.336 lat (msec) : 250=3.70%, 500=96.30% 00:28:39.336 cpu : usr=98.46%, sys=0.96%, ctx=17, majf=0, minf=36 00:28:39.336 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:39.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.336 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.336 filename0: (groupid=0, jobs=1): err= 0: pid=3658686: Wed Nov 20 12:56:10 2024 00:28:39.336 read: IOPS=51, BW=208KiB/s (213kB/s)(2096KiB/10083msec) 00:28:39.336 slat (usec): min=7, max=133, avg=42.28, stdev=40.93 00:28:39.336 clat (msec): min=193, max=525, avg=306.84, stdev=65.11 00:28:39.336 lat (msec): min=193, max=525, avg=306.88, stdev=65.14 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 194], 5.00th=[ 228], 10.00th=[ 243], 20.00th=[ 249], 00:28:39.336 | 30.00th=[ 259], 40.00th=[ 275], 50.00th=[ 288], 60.00th=[ 300], 00:28:39.336 | 70.00th=[ 363], 80.00th=[ 376], 90.00th=[ 405], 95.00th=[ 409], 00:28:39.336 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 527], 99.95th=[ 527], 00:28:39.336 | 99.99th=[ 527] 00:28:39.336 bw ( KiB/s): min= 127, max= 256, per=4.13%, avg=203.15, stdev=57.43, samples=20 00:28:39.336 iops : min= 31, max= 64, avg=50.75, stdev=14.41, samples=20 00:28:39.336 lat (msec) : 250=26.34%, 500=73.28%, 750=0.38% 00:28:39.336 cpu : usr=98.90%, sys=0.67%, ctx=44, majf=0, minf=28 00:28:39.336 IO depths : 1=1.7%, 2=5.9%, 4=18.7%, 8=62.8%, 16=10.9%, 32=0.0%, >=64=0.0% 00:28:39.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 complete : 0=0.0%, 4=92.3%, 8=2.2%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 issued rwts: total=524,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.336 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.336 filename0: (groupid=0, jobs=1): err= 0: pid=3658687: Wed Nov 20 12:56:10 2024 00:28:39.336 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10068msec) 00:28:39.336 slat (usec): min=13, max=131, avg=47.15, stdev=27.37 00:28:39.336 clat (msec): min=218, max=539, avg=372.47, stdev=51.85 00:28:39.336 lat (msec): min=218, max=539, avg=372.52, stdev=51.85 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 268], 5.00th=[ 271], 10.00th=[ 296], 20.00th=[ 338], 00:28:39.336 | 30.00th=[ 368], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.336 | 70.00th=[ 393], 80.00th=[ 405], 90.00th=[ 443], 95.00th=[ 472], 00:28:39.336 | 99.00th=[ 502], 99.50th=[ 514], 99.90th=[ 542], 99.95th=[ 542], 00:28:39.336 | 99.99th=[ 542] 00:28:39.336 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=58.59, samples=20 00:28:39.336 iops : min= 32, max= 64, avg=41.60, stdev=14.65, samples=20 00:28:39.336 lat (msec) : 250=0.46%, 500=98.15%, 750=1.39% 00:28:39.336 cpu : usr=98.49%, sys=0.95%, ctx=45, majf=0, minf=43 00:28:39.336 IO depths : 1=3.5%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.0%, 32=0.0%, >=64=0.0% 00:28:39.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.336 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.336 filename1: (groupid=0, jobs=1): err= 0: pid=3658688: Wed Nov 20 12:56:10 2024 00:28:39.336 read: IOPS=44, BW=178KiB/s (182kB/s)(1792KiB/10083msec) 00:28:39.336 slat (nsec): min=7943, max=44306, avg=12686.10, stdev=5189.12 00:28:39.336 clat (msec): min=208, max=562, avg=358.12, stdev=64.57 00:28:39.336 lat (msec): min=208, max=562, avg=358.14, stdev=64.57 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 211], 5.00th=[ 239], 10.00th=[ 275], 20.00th=[ 288], 00:28:39.336 | 30.00th=[ 351], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.336 | 70.00th=[ 388], 80.00th=[ 401], 90.00th=[ 409], 95.00th=[ 435], 00:28:39.336 | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 567], 99.95th=[ 567], 00:28:39.336 | 99.99th=[ 567] 00:28:39.336 bw ( KiB/s): min= 127, max= 256, per=3.50%, avg=172.75, stdev=61.15, samples=20 00:28:39.336 iops : min= 31, max= 64, avg=43.15, stdev=15.32, samples=20 00:28:39.336 lat (msec) : 250=6.25%, 500=91.52%, 750=2.23% 00:28:39.336 cpu : usr=98.78%, sys=0.80%, ctx=11, majf=0, minf=47 00:28:39.336 IO depths : 1=3.3%, 2=9.4%, 4=24.3%, 8=53.8%, 16=9.2%, 32=0.0%, >=64=0.0% 00:28:39.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.336 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.336 filename1: (groupid=0, jobs=1): err= 0: pid=3658689: Wed Nov 20 12:56:10 2024 00:28:39.336 read: IOPS=53, BW=216KiB/s (221kB/s)(2176KiB/10082msec) 00:28:39.336 slat (usec): min=7, max=127, avg=38.50, stdev=39.23 00:28:39.336 clat (msec): min=208, max=506, avg=294.68, stdev=59.28 00:28:39.336 lat (msec): min=208, max=506, avg=294.72, stdev=59.31 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 209], 5.00th=[ 211], 10.00th=[ 213], 20.00th=[ 245], 00:28:39.336 | 30.00th=[ 268], 40.00th=[ 275], 50.00th=[ 288], 60.00th=[ 292], 00:28:39.336 | 70.00th=[ 300], 80.00th=[ 363], 90.00th=[ 376], 95.00th=[ 388], 00:28:39.336 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 506], 99.95th=[ 506], 00:28:39.336 | 99.99th=[ 506] 00:28:39.336 bw ( KiB/s): min= 127, max= 256, per=4.29%, avg=211.15, stdev=58.02, samples=20 00:28:39.336 iops : min= 31, max= 64, avg=52.75, stdev=14.56, samples=20 00:28:39.336 lat (msec) : 250=23.16%, 500=76.47%, 750=0.37% 00:28:39.336 cpu : usr=98.27%, sys=1.05%, ctx=57, majf=0, minf=50 00:28:39.336 IO depths : 1=1.5%, 2=7.7%, 4=25.0%, 8=54.8%, 16=11.0%, 32=0.0%, >=64=0.0% 00:28:39.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 issued rwts: total=544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.336 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.336 filename1: (groupid=0, jobs=1): err= 0: pid=3658690: Wed Nov 20 12:56:10 2024 00:28:39.336 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10065msec) 00:28:39.336 slat (nsec): min=8547, max=66997, avg=29860.23, stdev=8651.37 00:28:39.336 clat (msec): min=268, max=444, avg=372.49, stdev=40.49 00:28:39.336 lat (msec): min=268, max=445, avg=372.52, stdev=40.49 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 271], 5.00th=[ 296], 10.00th=[ 300], 20.00th=[ 368], 00:28:39.336 | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.336 | 70.00th=[ 393], 80.00th=[ 401], 90.00th=[ 426], 95.00th=[ 443], 00:28:39.336 | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], 00:28:39.336 | 99.99th=[ 447] 00:28:39.336 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=60.18, samples=20 00:28:39.336 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:28:39.336 lat (msec) : 500=100.00% 00:28:39.336 cpu : usr=98.18%, sys=1.17%, ctx=31, majf=0, minf=34 00:28:39.336 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:39.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.336 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.336 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.336 filename1: (groupid=0, jobs=1): err= 0: pid=3658691: Wed Nov 20 12:56:10 2024 00:28:39.336 read: IOPS=55, BW=224KiB/s (229kB/s)(2240KiB/10022msec) 00:28:39.336 slat (usec): min=8, max=143, avg=37.58, stdev=37.25 00:28:39.336 clat (msec): min=82, max=402, avg=285.99, stdev=65.12 00:28:39.336 lat (msec): min=82, max=402, avg=286.03, stdev=65.14 00:28:39.336 clat percentiles (msec): 00:28:39.336 | 1.00th=[ 83], 5.00th=[ 209], 10.00th=[ 211], 20.00th=[ 228], 00:28:39.336 | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 288], 60.00th=[ 292], 00:28:39.336 | 70.00th=[ 305], 80.00th=[ 368], 90.00th=[ 376], 95.00th=[ 380], 00:28:39.336 | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], 00:28:39.337 | 99.99th=[ 401] 00:28:39.337 bw ( KiB/s): min= 128, max= 256, per=4.41%, avg=217.55, stdev=60.15, samples=20 00:28:39.337 iops : min= 32, max= 64, avg=54.35, stdev=15.01, samples=20 00:28:39.337 lat (msec) : 100=2.86%, 250=22.86%, 500=74.29% 00:28:39.337 cpu : usr=98.36%, sys=1.02%, ctx=55, majf=0, minf=47 00:28:39.337 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:39.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.337 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.337 filename1: (groupid=0, jobs=1): err= 0: pid=3658692: Wed Nov 20 12:56:10 2024 00:28:39.337 read: IOPS=42, BW=171KiB/s (176kB/s)(1728KiB/10077msec) 00:28:39.337 slat (nsec): min=3828, max=83970, avg=31820.96, stdev=10722.56 00:28:39.337 clat (msec): min=268, max=444, avg=372.93, stdev=39.66 00:28:39.337 lat (msec): min=268, max=445, avg=372.96, stdev=39.67 00:28:39.337 clat percentiles (msec): 00:28:39.337 | 1.00th=[ 271], 5.00th=[ 300], 10.00th=[ 305], 20.00th=[ 368], 00:28:39.337 | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.337 | 70.00th=[ 393], 80.00th=[ 401], 90.00th=[ 426], 95.00th=[ 443], 00:28:39.337 | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], 00:28:39.337 | 99.99th=[ 447] 00:28:39.337 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=60.18, samples=20 00:28:39.337 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:28:39.337 lat (msec) : 500=100.00% 00:28:39.337 cpu : usr=98.01%, sys=1.26%, ctx=30, majf=0, minf=35 00:28:39.337 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:39.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.337 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.337 filename1: (groupid=0, jobs=1): err= 0: pid=3658693: Wed Nov 20 12:56:10 2024 00:28:39.337 read: IOPS=43, BW=172KiB/s (177kB/s)(1728KiB/10024msec) 00:28:39.337 slat (usec): min=7, max=137, avg=88.68, stdev=20.02 00:28:39.337 clat (msec): min=238, max=505, avg=370.47, stdev=44.84 00:28:39.337 lat (msec): min=238, max=505, avg=370.56, stdev=44.85 00:28:39.337 clat percentiles (msec): 00:28:39.337 | 1.00th=[ 257], 5.00th=[ 275], 10.00th=[ 288], 20.00th=[ 363], 00:28:39.337 | 30.00th=[ 372], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.337 | 70.00th=[ 393], 80.00th=[ 401], 90.00th=[ 418], 95.00th=[ 418], 00:28:39.337 | 99.00th=[ 435], 99.50th=[ 460], 99.90th=[ 506], 99.95th=[ 506], 00:28:39.337 | 99.99th=[ 506] 00:28:39.337 bw ( KiB/s): min= 127, max= 256, per=3.38%, avg=166.35, stdev=58.63, samples=20 00:28:39.337 iops : min= 31, max= 64, avg=41.55, stdev=14.68, samples=20 00:28:39.337 lat (msec) : 250=0.46%, 500=99.07%, 750=0.46% 00:28:39.337 cpu : usr=98.65%, sys=0.80%, ctx=12, majf=0, minf=35 00:28:39.337 IO depths : 1=5.1%, 2=11.3%, 4=25.0%, 8=51.2%, 16=7.4%, 32=0.0%, >=64=0.0% 00:28:39.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.337 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.337 filename1: (groupid=0, jobs=1): err= 0: pid=3658694: Wed Nov 20 12:56:10 2024 00:28:39.337 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10073msec) 00:28:39.337 slat (usec): min=8, max=137, avg=57.47, stdev=38.26 00:28:39.337 clat (msec): min=200, max=551, avg=372.61, stdev=52.44 00:28:39.337 lat (msec): min=200, max=551, avg=372.67, stdev=52.44 00:28:39.337 clat percentiles (msec): 00:28:39.337 | 1.00th=[ 259], 5.00th=[ 271], 10.00th=[ 300], 20.00th=[ 338], 00:28:39.337 | 30.00th=[ 368], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.337 | 70.00th=[ 393], 80.00th=[ 405], 90.00th=[ 443], 95.00th=[ 468], 00:28:39.337 | 99.00th=[ 485], 99.50th=[ 527], 99.90th=[ 550], 99.95th=[ 550], 00:28:39.337 | 99.99th=[ 550] 00:28:39.337 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=53.55, samples=20 00:28:39.337 iops : min= 32, max= 64, avg=41.60, stdev=13.39, samples=20 00:28:39.337 lat (msec) : 250=0.93%, 500=98.15%, 750=0.93% 00:28:39.337 cpu : usr=98.58%, sys=0.85%, ctx=21, majf=0, minf=29 00:28:39.337 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:28:39.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.337 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.337 filename1: (groupid=0, jobs=1): err= 0: pid=3658695: Wed Nov 20 12:56:10 2024 00:28:39.337 read: IOPS=63, BW=254KiB/s (260kB/s)(2560KiB/10082msec) 00:28:39.337 slat (nsec): min=7822, max=87866, avg=13031.59, stdev=11558.86 00:28:39.337 clat (msec): min=136, max=331, avg=251.92, stdev=43.14 00:28:39.337 lat (msec): min=136, max=331, avg=251.93, stdev=43.14 00:28:39.337 clat percentiles (msec): 00:28:39.337 | 1.00th=[ 138], 5.00th=[ 182], 10.00th=[ 192], 20.00th=[ 211], 00:28:39.337 | 30.00th=[ 213], 40.00th=[ 239], 50.00th=[ 266], 60.00th=[ 268], 00:28:39.337 | 70.00th=[ 284], 80.00th=[ 292], 90.00th=[ 296], 95.00th=[ 305], 00:28:39.337 | 99.00th=[ 330], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:28:39.337 | 99.99th=[ 334] 00:28:39.337 bw ( KiB/s): min= 127, max= 384, per=5.07%, avg=249.55, stdev=65.43, samples=20 00:28:39.337 iops : min= 31, max= 96, avg=62.35, stdev=16.43, samples=20 00:28:39.337 lat (msec) : 250=40.00%, 500=60.00% 00:28:39.337 cpu : usr=98.72%, sys=0.81%, ctx=17, majf=0, minf=46 00:28:39.337 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:39.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 issued rwts: total=640,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.337 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.337 filename2: (groupid=0, jobs=1): err= 0: pid=3658696: Wed Nov 20 12:56:10 2024 00:28:39.337 read: IOPS=60, BW=242KiB/s (248kB/s)(2440KiB/10085msec) 00:28:39.337 slat (usec): min=7, max=126, avg=19.80, stdev=23.56 00:28:39.337 clat (msec): min=113, max=399, avg=264.32, stdev=44.77 00:28:39.337 lat (msec): min=113, max=399, avg=264.34, stdev=44.77 00:28:39.337 clat percentiles (msec): 00:28:39.337 | 1.00th=[ 182], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 224], 00:28:39.337 | 30.00th=[ 247], 40.00th=[ 266], 50.00th=[ 268], 60.00th=[ 279], 00:28:39.337 | 70.00th=[ 288], 80.00th=[ 292], 90.00th=[ 305], 95.00th=[ 351], 00:28:39.337 | 99.00th=[ 388], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], 00:28:39.337 | 99.99th=[ 401] 00:28:39.337 bw ( KiB/s): min= 127, max= 272, per=4.82%, avg=237.55, stdev=39.09, samples=20 00:28:39.337 iops : min= 31, max= 68, avg=59.35, stdev= 9.88, samples=20 00:28:39.337 lat (msec) : 250=31.15%, 500=68.85% 00:28:39.337 cpu : usr=98.72%, sys=0.78%, ctx=35, majf=0, minf=36 00:28:39.337 IO depths : 1=1.6%, 2=6.9%, 4=21.8%, 8=58.7%, 16=11.0%, 32=0.0%, >=64=0.0% 00:28:39.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 complete : 0=0.0%, 4=93.2%, 8=1.3%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.337 issued rwts: total=610,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.337 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.337 filename2: (groupid=0, jobs=1): err= 0: pid=3658697: Wed Nov 20 12:56:10 2024 00:28:39.337 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10067msec) 00:28:39.337 slat (usec): min=8, max=114, avg=35.20, stdev=23.03 00:28:39.337 clat (msec): min=199, max=553, avg=372.55, stdev=53.02 00:28:39.338 lat (msec): min=200, max=554, avg=372.59, stdev=53.01 00:28:39.338 clat percentiles (msec): 00:28:39.338 | 1.00th=[ 259], 5.00th=[ 271], 10.00th=[ 296], 20.00th=[ 338], 00:28:39.338 | 30.00th=[ 368], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.338 | 70.00th=[ 393], 80.00th=[ 405], 90.00th=[ 443], 95.00th=[ 468], 00:28:39.338 | 99.00th=[ 485], 99.50th=[ 531], 99.90th=[ 558], 99.95th=[ 558], 00:28:39.338 | 99.99th=[ 558] 00:28:39.338 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=53.55, samples=20 00:28:39.338 iops : min= 32, max= 64, avg=41.60, stdev=13.39, samples=20 00:28:39.338 lat (msec) : 250=0.93%, 500=98.15%, 750=0.93% 00:28:39.338 cpu : usr=98.72%, sys=0.81%, ctx=24, majf=0, minf=30 00:28:39.338 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:28:39.338 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.338 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.338 filename2: (groupid=0, jobs=1): err= 0: pid=3658698: Wed Nov 20 12:56:10 2024 00:28:39.338 read: IOPS=61, BW=247KiB/s (253kB/s)(2488KiB/10085msec) 00:28:39.338 slat (nsec): min=7824, max=44950, avg=11786.79, stdev=5839.16 00:28:39.338 clat (msec): min=135, max=416, avg=259.08, stdev=45.75 00:28:39.338 lat (msec): min=135, max=416, avg=259.10, stdev=45.76 00:28:39.338 clat percentiles (msec): 00:28:39.338 | 1.00th=[ 136], 5.00th=[ 182], 10.00th=[ 201], 20.00th=[ 236], 00:28:39.338 | 30.00th=[ 243], 40.00th=[ 253], 50.00th=[ 259], 60.00th=[ 268], 00:28:39.338 | 70.00th=[ 279], 80.00th=[ 288], 90.00th=[ 305], 95.00th=[ 321], 00:28:39.338 | 99.00th=[ 401], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:28:39.338 | 99.99th=[ 418] 00:28:39.338 bw ( KiB/s): min= 127, max= 384, per=4.92%, avg=242.35, stdev=51.32, samples=20 00:28:39.338 iops : min= 31, max= 96, avg=60.55, stdev=12.92, samples=20 00:28:39.338 lat (msec) : 250=36.33%, 500=63.67% 00:28:39.338 cpu : usr=98.91%, sys=0.70%, ctx=27, majf=0, minf=33 00:28:39.338 IO depths : 1=0.8%, 2=2.9%, 4=12.2%, 8=72.2%, 16=11.9%, 32=0.0%, >=64=0.0% 00:28:39.338 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 complete : 0=0.0%, 4=90.4%, 8=4.3%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 issued rwts: total=622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.338 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.338 filename2: (groupid=0, jobs=1): err= 0: pid=3658699: Wed Nov 20 12:56:10 2024 00:28:39.338 read: IOPS=65, BW=260KiB/s (267kB/s)(2624KiB/10082msec) 00:28:39.338 slat (usec): min=7, max=104, avg=12.93, stdev=10.17 00:28:39.338 clat (msec): min=83, max=331, avg=245.77, stdev=49.63 00:28:39.338 lat (msec): min=83, max=331, avg=245.78, stdev=49.63 00:28:39.338 clat percentiles (msec): 00:28:39.338 | 1.00th=[ 84], 5.00th=[ 182], 10.00th=[ 192], 20.00th=[ 211], 00:28:39.338 | 30.00th=[ 213], 40.00th=[ 232], 50.00th=[ 259], 60.00th=[ 268], 00:28:39.338 | 70.00th=[ 275], 80.00th=[ 292], 90.00th=[ 296], 95.00th=[ 305], 00:28:39.338 | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], 00:28:39.338 | 99.99th=[ 330] 00:28:39.338 bw ( KiB/s): min= 128, max= 384, per=5.19%, avg=255.95, stdev=58.73, samples=20 00:28:39.338 iops : min= 32, max= 96, avg=63.95, stdev=14.68, samples=20 00:28:39.338 lat (msec) : 100=2.44%, 250=43.90%, 500=53.66% 00:28:39.338 cpu : usr=98.88%, sys=0.74%, ctx=12, majf=0, minf=52 00:28:39.338 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:39.338 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 issued rwts: total=656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.338 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.338 filename2: (groupid=0, jobs=1): err= 0: pid=3658700: Wed Nov 20 12:56:10 2024 00:28:39.338 read: IOPS=61, BW=245KiB/s (251kB/s)(2472KiB/10085msec) 00:28:39.338 slat (usec): min=7, max=129, avg=17.81, stdev=21.08 00:28:39.338 clat (msec): min=82, max=442, avg=260.61, stdev=54.42 00:28:39.338 lat (msec): min=82, max=442, avg=260.63, stdev=54.42 00:28:39.338 clat percentiles (msec): 00:28:39.338 | 1.00th=[ 83], 5.00th=[ 165], 10.00th=[ 213], 20.00th=[ 241], 00:28:39.338 | 30.00th=[ 245], 40.00th=[ 247], 50.00th=[ 257], 60.00th=[ 275], 00:28:39.338 | 70.00th=[ 279], 80.00th=[ 292], 90.00th=[ 309], 95.00th=[ 351], 00:28:39.338 | 99.00th=[ 393], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], 00:28:39.338 | 99.99th=[ 443] 00:28:39.338 bw ( KiB/s): min= 176, max= 336, per=4.88%, avg=240.75, stdev=51.24, samples=20 00:28:39.338 iops : min= 44, max= 84, avg=60.15, stdev=12.80, samples=20 00:28:39.338 lat (msec) : 100=2.59%, 250=45.31%, 500=52.10% 00:28:39.338 cpu : usr=98.86%, sys=0.68%, ctx=39, majf=0, minf=47 00:28:39.338 IO depths : 1=0.6%, 2=1.6%, 4=8.7%, 8=76.9%, 16=12.1%, 32=0.0%, >=64=0.0% 00:28:39.338 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 complete : 0=0.0%, 4=89.3%, 8=5.5%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 issued rwts: total=618,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.338 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.338 filename2: (groupid=0, jobs=1): err= 0: pid=3658701: Wed Nov 20 12:56:10 2024 00:28:39.338 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10067msec) 00:28:39.338 slat (nsec): min=7990, max=97886, avg=20122.79, stdev=21476.78 00:28:39.338 clat (msec): min=210, max=595, avg=372.65, stdev=53.69 00:28:39.338 lat (msec): min=210, max=595, avg=372.67, stdev=53.68 00:28:39.338 clat percentiles (msec): 00:28:39.338 | 1.00th=[ 211], 5.00th=[ 230], 10.00th=[ 288], 20.00th=[ 368], 00:28:39.338 | 30.00th=[ 372], 40.00th=[ 376], 50.00th=[ 380], 60.00th=[ 393], 00:28:39.338 | 70.00th=[ 397], 80.00th=[ 401], 90.00th=[ 409], 95.00th=[ 439], 00:28:39.338 | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 600], 99.95th=[ 600], 00:28:39.338 | 99.99th=[ 600] 00:28:39.338 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=60.18, samples=20 00:28:39.338 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:28:39.338 lat (msec) : 250=5.09%, 500=93.52%, 750=1.39% 00:28:39.338 cpu : usr=98.77%, sys=0.78%, ctx=30, majf=0, minf=38 00:28:39.338 IO depths : 1=5.6%, 2=11.8%, 4=25.0%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:39.338 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.338 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.338 filename2: (groupid=0, jobs=1): err= 0: pid=3658702: Wed Nov 20 12:56:10 2024 00:28:39.338 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10107msec) 00:28:39.338 slat (usec): min=4, max=105, avg=18.53, stdev=18.32 00:28:39.338 clat (msec): min=107, max=343, avg=257.64, stdev=43.35 00:28:39.338 lat (msec): min=107, max=343, avg=257.66, stdev=43.35 00:28:39.338 clat percentiles (msec): 00:28:39.338 | 1.00th=[ 108], 5.00th=[ 194], 10.00th=[ 209], 20.00th=[ 213], 00:28:39.338 | 30.00th=[ 236], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 279], 00:28:39.338 | 70.00th=[ 288], 80.00th=[ 292], 90.00th=[ 300], 95.00th=[ 309], 00:28:39.338 | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 342], 99.95th=[ 342], 00:28:39.338 | 99.99th=[ 342] 00:28:39.338 bw ( KiB/s): min= 144, max= 256, per=4.94%, avg=243.20, stdev=34.28, samples=20 00:28:39.338 iops : min= 36, max= 64, avg=60.80, stdev= 8.57, samples=20 00:28:39.338 lat (msec) : 250=35.26%, 500=64.74% 00:28:39.338 cpu : usr=98.82%, sys=0.70%, ctx=27, majf=0, minf=42 00:28:39.338 IO depths : 1=1.4%, 2=7.7%, 4=25.0%, 8=54.8%, 16=11.1%, 32=0.0%, >=64=0.0% 00:28:39.338 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.338 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.338 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.338 filename2: (groupid=0, jobs=1): err= 0: pid=3658703: Wed Nov 20 12:56:10 2024 00:28:39.338 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10074msec) 00:28:39.338 slat (usec): min=14, max=146, avg=93.18, stdev=20.63 00:28:39.338 clat (msec): min=219, max=538, avg=372.29, stdev=51.32 00:28:39.338 lat (msec): min=219, max=538, avg=372.39, stdev=51.33 00:28:39.338 clat percentiles (msec): 00:28:39.339 | 1.00th=[ 268], 5.00th=[ 271], 10.00th=[ 300], 20.00th=[ 338], 00:28:39.339 | 30.00th=[ 368], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 380], 00:28:39.339 | 70.00th=[ 393], 80.00th=[ 405], 90.00th=[ 443], 95.00th=[ 468], 00:28:39.339 | 99.00th=[ 502], 99.50th=[ 514], 99.90th=[ 542], 99.95th=[ 542], 00:28:39.339 | 99.99th=[ 542] 00:28:39.339 bw ( KiB/s): min= 128, max= 256, per=3.38%, avg=166.40, stdev=60.18, samples=20 00:28:39.339 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:28:39.339 lat (msec) : 250=0.46%, 500=98.15%, 750=1.39% 00:28:39.339 cpu : usr=98.60%, sys=0.83%, ctx=9, majf=0, minf=50 00:28:39.339 IO depths : 1=3.5%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.0%, 32=0.0%, >=64=0.0% 00:28:39.339 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.339 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.339 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.339 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:39.339 00:28:39.339 Run status group 0 (all jobs): 00:28:39.339 READ: bw=4915KiB/s (5033kB/s), 171KiB/s-260KiB/s (176kB/s-267kB/s), io=48.5MiB (50.9MB), run=10022-10109msec 00:28:39.339 12:56:10 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:39.339 12:56:10 -- target/dif.sh@43 -- # local sub 00:28:39.339 12:56:10 -- target/dif.sh@45 -- # for sub in "$@" 00:28:39.339 12:56:10 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:39.339 12:56:10 -- target/dif.sh@36 -- # local sub_id=0 00:28:39.339 12:56:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@45 -- # for sub in "$@" 00:28:39.339 12:56:10 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:39.339 12:56:10 -- target/dif.sh@36 -- # local sub_id=1 00:28:39.339 12:56:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@45 -- # for sub in "$@" 00:28:39.339 12:56:10 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:39.339 12:56:10 -- target/dif.sh@36 -- # local sub_id=2 00:28:39.339 12:56:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:39.339 12:56:10 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:39.339 12:56:10 -- target/dif.sh@115 -- # numjobs=2 00:28:39.339 12:56:10 -- target/dif.sh@115 -- # iodepth=8 00:28:39.339 12:56:10 -- target/dif.sh@115 -- # runtime=5 00:28:39.339 12:56:10 -- target/dif.sh@115 -- # files=1 00:28:39.339 12:56:10 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:39.339 12:56:10 -- target/dif.sh@28 -- # local sub 00:28:39.339 12:56:10 -- target/dif.sh@30 -- # for sub in "$@" 00:28:39.339 12:56:10 -- target/dif.sh@31 -- # create_subsystem 0 00:28:39.339 12:56:10 -- target/dif.sh@18 -- # local sub_id=0 00:28:39.339 12:56:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 bdev_null0 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 [2024-11-20 12:56:10.679762] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@30 -- # for sub in "$@" 00:28:39.339 12:56:10 -- target/dif.sh@31 -- # create_subsystem 1 00:28:39.339 12:56:10 -- target/dif.sh@18 -- # local sub_id=1 00:28:39.339 12:56:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 bdev_null1 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:39.339 12:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.339 12:56:10 -- common/autotest_common.sh@10 -- # set +x 00:28:39.339 12:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.339 12:56:10 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:39.339 12:56:10 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:39.339 12:56:10 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:39.339 12:56:10 -- nvmf/common.sh@520 -- # config=() 00:28:39.339 12:56:10 -- nvmf/common.sh@520 -- # local subsystem config 00:28:39.339 12:56:10 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:39.339 12:56:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:39.339 12:56:10 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:39.339 12:56:10 -- target/dif.sh@82 -- # gen_fio_conf 00:28:39.339 12:56:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:39.339 { 00:28:39.339 "params": { 00:28:39.339 "name": "Nvme$subsystem", 00:28:39.339 "trtype": "$TEST_TRANSPORT", 00:28:39.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:39.339 "adrfam": "ipv4", 00:28:39.339 "trsvcid": "$NVMF_PORT", 00:28:39.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:39.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:39.339 "hdgst": ${hdgst:-false}, 00:28:39.339 "ddgst": ${ddgst:-false} 00:28:39.339 }, 00:28:39.339 "method": "bdev_nvme_attach_controller" 00:28:39.339 } 00:28:39.339 EOF 00:28:39.339 )") 00:28:39.339 12:56:10 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:39.340 12:56:10 -- target/dif.sh@54 -- # local file 00:28:39.340 12:56:10 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:39.340 12:56:10 -- target/dif.sh@56 -- # cat 00:28:39.340 12:56:10 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:39.340 12:56:10 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:39.340 12:56:10 -- common/autotest_common.sh@1330 -- # shift 00:28:39.340 12:56:10 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:39.340 12:56:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:39.340 12:56:10 -- nvmf/common.sh@542 -- # cat 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:39.340 12:56:10 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:39.340 12:56:10 -- target/dif.sh@72 -- # (( file <= files )) 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:39.340 12:56:10 -- target/dif.sh@73 -- # cat 00:28:39.340 12:56:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:39.340 12:56:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:39.340 { 00:28:39.340 "params": { 00:28:39.340 "name": "Nvme$subsystem", 00:28:39.340 "trtype": "$TEST_TRANSPORT", 00:28:39.340 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:39.340 "adrfam": "ipv4", 00:28:39.340 "trsvcid": "$NVMF_PORT", 00:28:39.340 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:39.340 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:39.340 "hdgst": ${hdgst:-false}, 00:28:39.340 "ddgst": ${ddgst:-false} 00:28:39.340 }, 00:28:39.340 "method": "bdev_nvme_attach_controller" 00:28:39.340 } 00:28:39.340 EOF 00:28:39.340 )") 00:28:39.340 12:56:10 -- target/dif.sh@72 -- # (( file++ )) 00:28:39.340 12:56:10 -- nvmf/common.sh@542 -- # cat 00:28:39.340 12:56:10 -- target/dif.sh@72 -- # (( file <= files )) 00:28:39.340 12:56:10 -- nvmf/common.sh@544 -- # jq . 00:28:39.340 12:56:10 -- nvmf/common.sh@545 -- # IFS=, 00:28:39.340 12:56:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:39.340 "params": { 00:28:39.340 "name": "Nvme0", 00:28:39.340 "trtype": "tcp", 00:28:39.340 "traddr": "10.0.0.2", 00:28:39.340 "adrfam": "ipv4", 00:28:39.340 "trsvcid": "4420", 00:28:39.340 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:39.340 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:39.340 "hdgst": false, 00:28:39.340 "ddgst": false 00:28:39.340 }, 00:28:39.340 "method": "bdev_nvme_attach_controller" 00:28:39.340 },{ 00:28:39.340 "params": { 00:28:39.340 "name": "Nvme1", 00:28:39.340 "trtype": "tcp", 00:28:39.340 "traddr": "10.0.0.2", 00:28:39.340 "adrfam": "ipv4", 00:28:39.340 "trsvcid": "4420", 00:28:39.340 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:39.340 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:39.340 "hdgst": false, 00:28:39.340 "ddgst": false 00:28:39.340 }, 00:28:39.340 "method": "bdev_nvme_attach_controller" 00:28:39.340 }' 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:39.340 12:56:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:39.340 12:56:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:39.340 12:56:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:39.340 12:56:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:39.340 12:56:10 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:39.340 12:56:10 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:39.340 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:39.340 ... 00:28:39.340 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:39.340 ... 00:28:39.340 fio-3.35 00:28:39.340 Starting 4 threads 00:28:39.340 EAL: No free 2048 kB hugepages reported on node 1 00:28:39.340 [2024-11-20 12:56:11.680493] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:39.340 [2024-11-20 12:56:11.680564] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:44.610 00:28:44.610 filename0: (groupid=0, jobs=1): err= 0: pid=3660125: Wed Nov 20 12:56:16 2024 00:28:44.610 read: IOPS=1943, BW=15.2MiB/s (15.9MB/s)(76.0MiB/5002msec) 00:28:44.610 slat (nsec): min=4419, max=70506, avg=20801.15, stdev=11274.54 00:28:44.610 clat (usec): min=637, max=8431, avg=4043.86, stdev=453.20 00:28:44.610 lat (usec): min=646, max=8446, avg=4064.66, stdev=453.50 00:28:44.610 clat percentiles (usec): 00:28:44.610 | 1.00th=[ 2835], 5.00th=[ 3523], 10.00th=[ 3752], 20.00th=[ 3851], 00:28:44.610 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4015], 60.00th=[ 4080], 00:28:44.610 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4424], 00:28:44.610 | 99.00th=[ 6063], 99.50th=[ 6587], 99.90th=[ 7701], 99.95th=[ 8225], 00:28:44.610 | 99.99th=[ 8455] 00:28:44.610 bw ( KiB/s): min=15104, max=15872, per=24.90%, avg=15539.56, stdev=280.20, samples=9 00:28:44.610 iops : min= 1888, max= 1984, avg=1942.44, stdev=35.03, samples=9 00:28:44.610 lat (usec) : 750=0.02%, 1000=0.04% 00:28:44.610 lat (msec) : 2=0.26%, 4=44.13%, 10=55.55% 00:28:44.610 cpu : usr=95.62%, sys=3.86%, ctx=8, majf=0, minf=38 00:28:44.610 IO depths : 1=0.2%, 2=14.4%, 4=59.0%, 8=26.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.610 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 complete : 0=0.0%, 4=91.4%, 8=8.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 issued rwts: total=9723,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.610 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:44.610 filename0: (groupid=0, jobs=1): err= 0: pid=3660126: Wed Nov 20 12:56:16 2024 00:28:44.610 read: IOPS=1965, BW=15.4MiB/s (16.1MB/s)(76.8MiB/5001msec) 00:28:44.610 slat (nsec): min=3609, max=68909, avg=23026.87, stdev=11379.72 00:28:44.610 clat (usec): min=734, max=7131, avg=3986.60, stdev=402.47 00:28:44.610 lat (usec): min=753, max=7148, avg=4009.63, stdev=403.45 00:28:44.610 clat percentiles (usec): 00:28:44.610 | 1.00th=[ 2769], 5.00th=[ 3392], 10.00th=[ 3687], 20.00th=[ 3818], 00:28:44.610 | 30.00th=[ 3884], 40.00th=[ 3949], 50.00th=[ 4015], 60.00th=[ 4047], 00:28:44.610 | 70.00th=[ 4113], 80.00th=[ 4178], 90.00th=[ 4293], 95.00th=[ 4359], 00:28:44.610 | 99.00th=[ 5407], 99.50th=[ 5735], 99.90th=[ 6783], 99.95th=[ 6849], 00:28:44.610 | 99.99th=[ 7111] 00:28:44.610 bw ( KiB/s): min=15360, max=16400, per=25.20%, avg=15726.22, stdev=318.54, samples=9 00:28:44.610 iops : min= 1920, max= 2050, avg=1965.78, stdev=39.82, samples=9 00:28:44.610 lat (usec) : 750=0.01%, 1000=0.06% 00:28:44.610 lat (msec) : 2=0.35%, 4=49.64%, 10=49.94% 00:28:44.610 cpu : usr=95.78%, sys=3.70%, ctx=12, majf=0, minf=60 00:28:44.610 IO depths : 1=0.1%, 2=17.5%, 4=56.1%, 8=26.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.610 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 complete : 0=0.0%, 4=91.2%, 8=8.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 issued rwts: total=9830,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.610 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:44.610 filename1: (groupid=0, jobs=1): err= 0: pid=3660127: Wed Nov 20 12:56:16 2024 00:28:44.610 read: IOPS=1940, BW=15.2MiB/s (15.9MB/s)(75.8MiB/5002msec) 00:28:44.610 slat (nsec): min=3589, max=65576, avg=23426.01, stdev=10976.65 00:28:44.610 clat (usec): min=672, max=7319, avg=4036.99, stdev=419.47 00:28:44.610 lat (usec): min=688, max=7334, avg=4060.42, stdev=419.40 00:28:44.610 clat percentiles (usec): 00:28:44.610 | 1.00th=[ 2900], 5.00th=[ 3589], 10.00th=[ 3752], 20.00th=[ 3851], 00:28:44.610 | 30.00th=[ 3916], 40.00th=[ 3949], 50.00th=[ 4015], 60.00th=[ 4080], 00:28:44.610 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4490], 00:28:44.610 | 99.00th=[ 5669], 99.50th=[ 6259], 99.90th=[ 6849], 99.95th=[ 7177], 00:28:44.610 | 99.99th=[ 7308] 00:28:44.610 bw ( KiB/s): min=15232, max=15920, per=24.91%, avg=15544.89, stdev=207.71, samples=9 00:28:44.610 iops : min= 1904, max= 1990, avg=1943.11, stdev=25.96, samples=9 00:28:44.610 lat (usec) : 750=0.01%, 1000=0.06% 00:28:44.610 lat (msec) : 2=0.37%, 4=47.00%, 10=52.56% 00:28:44.610 cpu : usr=95.54%, sys=3.90%, ctx=9, majf=0, minf=41 00:28:44.610 IO depths : 1=0.1%, 2=17.6%, 4=56.0%, 8=26.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.610 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 complete : 0=0.0%, 4=91.1%, 8=8.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 issued rwts: total=9705,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.610 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:44.610 filename1: (groupid=0, jobs=1): err= 0: pid=3660128: Wed Nov 20 12:56:16 2024 00:28:44.610 read: IOPS=1953, BW=15.3MiB/s (16.0MB/s)(76.3MiB/5003msec) 00:28:44.610 slat (nsec): min=3678, max=64405, avg=23024.73, stdev=11120.74 00:28:44.610 clat (usec): min=669, max=7703, avg=4015.02, stdev=433.44 00:28:44.610 lat (usec): min=683, max=7726, avg=4038.05, stdev=433.72 00:28:44.610 clat percentiles (usec): 00:28:44.610 | 1.00th=[ 2540], 5.00th=[ 3490], 10.00th=[ 3720], 20.00th=[ 3851], 00:28:44.610 | 30.00th=[ 3916], 40.00th=[ 3949], 50.00th=[ 4015], 60.00th=[ 4080], 00:28:44.610 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4293], 95.00th=[ 4424], 00:28:44.610 | 99.00th=[ 5538], 99.50th=[ 6128], 99.90th=[ 7439], 99.95th=[ 7439], 00:28:44.610 | 99.99th=[ 7701] 00:28:44.610 bw ( KiB/s): min=15328, max=15904, per=25.04%, avg=15627.00, stdev=228.76, samples=10 00:28:44.610 iops : min= 1916, max= 1988, avg=1953.30, stdev=28.68, samples=10 00:28:44.610 lat (usec) : 750=0.02%, 1000=0.06% 00:28:44.610 lat (msec) : 2=0.37%, 4=47.49%, 10=52.06% 00:28:44.610 cpu : usr=96.62%, sys=2.80%, ctx=7, majf=0, minf=54 00:28:44.610 IO depths : 1=0.1%, 2=15.0%, 4=58.2%, 8=26.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.610 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.610 issued rwts: total=9771,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.610 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:44.610 00:28:44.610 Run status group 0 (all jobs): 00:28:44.610 READ: bw=60.9MiB/s (63.9MB/s), 15.2MiB/s-15.4MiB/s (15.9MB/s-16.1MB/s), io=305MiB (320MB), run=5001-5003msec 00:28:44.610 12:56:17 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:28:44.610 12:56:17 -- target/dif.sh@43 -- # local sub 00:28:44.610 12:56:17 -- target/dif.sh@45 -- # for sub in "$@" 00:28:44.610 12:56:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:44.610 12:56:17 -- target/dif.sh@36 -- # local sub_id=0 00:28:44.610 12:56:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:44.610 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.610 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.610 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.610 12:56:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:44.610 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.610 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.610 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.610 12:56:17 -- target/dif.sh@45 -- # for sub in "$@" 00:28:44.610 12:56:17 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:44.610 12:56:17 -- target/dif.sh@36 -- # local sub_id=1 00:28:44.610 12:56:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:44.610 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.610 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.610 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.610 12:56:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:44.610 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.610 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.610 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.610 00:28:44.610 real 0m24.581s 00:28:44.610 user 4m36.635s 00:28:44.610 sys 0m4.623s 00:28:44.610 12:56:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:44.610 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.610 ************************************ 00:28:44.610 END TEST fio_dif_rand_params 00:28:44.610 ************************************ 00:28:44.610 12:56:17 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:28:44.610 12:56:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:44.610 12:56:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:44.610 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.610 ************************************ 00:28:44.610 START TEST fio_dif_digest 00:28:44.610 ************************************ 00:28:44.610 12:56:17 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:28:44.610 12:56:17 -- target/dif.sh@123 -- # local NULL_DIF 00:28:44.610 12:56:17 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:28:44.611 12:56:17 -- target/dif.sh@125 -- # local hdgst ddgst 00:28:44.611 12:56:17 -- target/dif.sh@127 -- # NULL_DIF=3 00:28:44.611 12:56:17 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:28:44.611 12:56:17 -- target/dif.sh@127 -- # numjobs=3 00:28:44.611 12:56:17 -- target/dif.sh@127 -- # iodepth=3 00:28:44.611 12:56:17 -- target/dif.sh@127 -- # runtime=10 00:28:44.611 12:56:17 -- target/dif.sh@128 -- # hdgst=true 00:28:44.611 12:56:17 -- target/dif.sh@128 -- # ddgst=true 00:28:44.611 12:56:17 -- target/dif.sh@130 -- # create_subsystems 0 00:28:44.611 12:56:17 -- target/dif.sh@28 -- # local sub 00:28:44.611 12:56:17 -- target/dif.sh@30 -- # for sub in "$@" 00:28:44.611 12:56:17 -- target/dif.sh@31 -- # create_subsystem 0 00:28:44.611 12:56:17 -- target/dif.sh@18 -- # local sub_id=0 00:28:44.611 12:56:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:44.611 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.611 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.611 bdev_null0 00:28:44.611 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.611 12:56:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:44.611 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.611 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.611 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.611 12:56:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:44.611 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.611 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.611 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.611 12:56:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:44.611 12:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.611 12:56:17 -- common/autotest_common.sh@10 -- # set +x 00:28:44.611 [2024-11-20 12:56:17.171715] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:44.611 12:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.611 12:56:17 -- target/dif.sh@131 -- # fio /dev/fd/62 00:28:44.611 12:56:17 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:28:44.611 12:56:17 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:44.611 12:56:17 -- nvmf/common.sh@520 -- # config=() 00:28:44.611 12:56:17 -- nvmf/common.sh@520 -- # local subsystem config 00:28:44.611 12:56:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:44.611 12:56:17 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.611 12:56:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:44.611 { 00:28:44.611 "params": { 00:28:44.611 "name": "Nvme$subsystem", 00:28:44.611 "trtype": "$TEST_TRANSPORT", 00:28:44.611 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:44.611 "adrfam": "ipv4", 00:28:44.611 "trsvcid": "$NVMF_PORT", 00:28:44.611 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:44.611 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:44.611 "hdgst": ${hdgst:-false}, 00:28:44.611 "ddgst": ${ddgst:-false} 00:28:44.611 }, 00:28:44.611 "method": "bdev_nvme_attach_controller" 00:28:44.611 } 00:28:44.611 EOF 00:28:44.611 )") 00:28:44.611 12:56:17 -- target/dif.sh@82 -- # gen_fio_conf 00:28:44.611 12:56:17 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.611 12:56:17 -- target/dif.sh@54 -- # local file 00:28:44.611 12:56:17 -- target/dif.sh@56 -- # cat 00:28:44.611 12:56:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:44.611 12:56:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:44.611 12:56:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:44.611 12:56:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.611 12:56:17 -- common/autotest_common.sh@1330 -- # shift 00:28:44.611 12:56:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:44.611 12:56:17 -- nvmf/common.sh@542 -- # cat 00:28:44.611 12:56:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:44.611 12:56:17 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:44.611 12:56:17 -- target/dif.sh@72 -- # (( file <= files )) 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:44.611 12:56:17 -- nvmf/common.sh@544 -- # jq . 00:28:44.611 12:56:17 -- nvmf/common.sh@545 -- # IFS=, 00:28:44.611 12:56:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:44.611 "params": { 00:28:44.611 "name": "Nvme0", 00:28:44.611 "trtype": "tcp", 00:28:44.611 "traddr": "10.0.0.2", 00:28:44.611 "adrfam": "ipv4", 00:28:44.611 "trsvcid": "4420", 00:28:44.611 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:44.611 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:44.611 "hdgst": true, 00:28:44.611 "ddgst": true 00:28:44.611 }, 00:28:44.611 "method": "bdev_nvme_attach_controller" 00:28:44.611 }' 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:44.611 12:56:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:44.611 12:56:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:44.611 12:56:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:44.611 12:56:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:44.611 12:56:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:44.611 12:56:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.611 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:44.611 ... 00:28:44.611 fio-3.35 00:28:44.611 Starting 3 threads 00:28:44.611 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.251 [2024-11-20 12:56:17.985449] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:45.251 [2024-11-20 12:56:17.985504] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:55.238 00:28:55.238 filename0: (groupid=0, jobs=1): err= 0: pid=3661023: Wed Nov 20 12:56:28 2024 00:28:55.238 read: IOPS=205, BW=25.7MiB/s (26.9MB/s)(258MiB/10045msec) 00:28:55.238 slat (nsec): min=7534, max=35781, avg=12799.93, stdev=2025.01 00:28:55.238 clat (usec): min=11069, max=56911, avg=14555.71, stdev=2990.57 00:28:55.238 lat (usec): min=11081, max=56923, avg=14568.51, stdev=2990.54 00:28:55.238 clat percentiles (usec): 00:28:55.238 | 1.00th=[11994], 5.00th=[12780], 10.00th=[13042], 20.00th=[13566], 00:28:55.238 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:28:55.238 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15664], 95.00th=[16188], 00:28:55.238 | 99.00th=[17957], 99.50th=[19792], 99.90th=[55837], 99.95th=[56361], 00:28:55.238 | 99.99th=[56886] 00:28:55.238 bw ( KiB/s): min=22784, max=27904, per=33.45%, avg=26380.80, stdev=1373.53, samples=20 00:28:55.238 iops : min= 178, max= 218, avg=206.10, stdev=10.73, samples=20 00:28:55.238 lat (msec) : 20=99.52%, 50=0.05%, 100=0.44% 00:28:55.238 cpu : usr=92.05%, sys=7.45%, ctx=40, majf=0, minf=142 00:28:55.238 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:55.238 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.238 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.238 issued rwts: total=2062,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.238 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:55.238 filename0: (groupid=0, jobs=1): err= 0: pid=3661024: Wed Nov 20 12:56:28 2024 00:28:55.238 read: IOPS=203, BW=25.5MiB/s (26.7MB/s)(256MiB/10047msec) 00:28:55.238 slat (nsec): min=7477, max=37449, avg=12579.23, stdev=2106.29 00:28:55.238 clat (usec): min=7793, max=51589, avg=14694.67, stdev=1678.12 00:28:55.238 lat (usec): min=7805, max=51601, avg=14707.25, stdev=1678.08 00:28:55.238 clat percentiles (usec): 00:28:55.238 | 1.00th=[10552], 5.00th=[12780], 10.00th=[13304], 20.00th=[13829], 00:28:55.238 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:28:55.238 | 70.00th=[15270], 80.00th=[15664], 90.00th=[16188], 95.00th=[16909], 00:28:55.238 | 99.00th=[17695], 99.50th=[18220], 99.90th=[19006], 99.95th=[46924], 00:28:55.238 | 99.99th=[51643] 00:28:55.238 bw ( KiB/s): min=24576, max=27904, per=33.18%, avg=26165.75, stdev=965.68, samples=20 00:28:55.238 iops : min= 192, max= 218, avg=204.40, stdev= 7.56, samples=20 00:28:55.238 lat (msec) : 10=0.49%, 20=99.41%, 50=0.05%, 100=0.05% 00:28:55.238 cpu : usr=92.47%, sys=7.04%, ctx=30, majf=0, minf=140 00:28:55.238 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:55.238 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.238 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.238 issued rwts: total=2046,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.238 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:55.238 filename0: (groupid=0, jobs=1): err= 0: pid=3661025: Wed Nov 20 12:56:28 2024 00:28:55.238 read: IOPS=207, BW=25.9MiB/s (27.2MB/s)(260MiB/10048msec) 00:28:55.238 slat (nsec): min=7444, max=38063, avg=12869.71, stdev=2330.06 00:28:55.238 clat (usec): min=8496, max=53685, avg=14441.47, stdev=1745.28 00:28:55.238 lat (usec): min=8509, max=53697, avg=14454.34, stdev=1745.28 00:28:55.238 clat percentiles (usec): 00:28:55.238 | 1.00th=[ 9896], 5.00th=[12518], 10.00th=[13042], 20.00th=[13435], 00:28:55.238 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14746], 00:28:55.238 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16450], 00:28:55.238 | 99.00th=[17433], 99.50th=[17695], 99.90th=[22152], 99.95th=[50070], 00:28:55.238 | 99.99th=[53740] 00:28:55.238 bw ( KiB/s): min=24576, max=28928, per=33.75%, avg=26611.20, stdev=1121.97, samples=20 00:28:55.238 iops : min= 192, max= 226, avg=207.90, stdev= 8.77, samples=20 00:28:55.238 lat (msec) : 10=1.01%, 20=98.75%, 50=0.19%, 100=0.05% 00:28:55.238 cpu : usr=92.21%, sys=7.30%, ctx=30, majf=0, minf=131 00:28:55.238 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:55.238 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.238 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.238 issued rwts: total=2082,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.238 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:55.238 00:28:55.238 Run status group 0 (all jobs): 00:28:55.238 READ: bw=77.0MiB/s (80.7MB/s), 25.5MiB/s-25.9MiB/s (26.7MB/s-27.2MB/s), io=774MiB (811MB), run=10045-10048msec 00:28:55.497 12:56:28 -- target/dif.sh@132 -- # destroy_subsystems 0 00:28:55.497 12:56:28 -- target/dif.sh@43 -- # local sub 00:28:55.497 12:56:28 -- target/dif.sh@45 -- # for sub in "$@" 00:28:55.497 12:56:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:55.497 12:56:28 -- target/dif.sh@36 -- # local sub_id=0 00:28:55.497 12:56:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:55.497 12:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.497 12:56:28 -- common/autotest_common.sh@10 -- # set +x 00:28:55.497 12:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.497 12:56:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:55.497 12:56:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.497 12:56:28 -- common/autotest_common.sh@10 -- # set +x 00:28:55.497 12:56:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.497 00:28:55.497 real 0m11.268s 00:28:55.497 user 0m29.017s 00:28:55.497 sys 0m2.492s 00:28:55.497 12:56:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:55.497 12:56:28 -- common/autotest_common.sh@10 -- # set +x 00:28:55.497 ************************************ 00:28:55.497 END TEST fio_dif_digest 00:28:55.497 ************************************ 00:28:55.497 12:56:28 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:28:55.497 12:56:28 -- target/dif.sh@147 -- # nvmftestfini 00:28:55.497 12:56:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:55.497 12:56:28 -- nvmf/common.sh@116 -- # sync 00:28:55.497 12:56:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:55.497 12:56:28 -- nvmf/common.sh@119 -- # set +e 00:28:55.497 12:56:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:55.497 12:56:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:55.497 rmmod nvme_tcp 00:28:55.497 rmmod nvme_fabrics 00:28:55.497 rmmod nvme_keyring 00:28:55.497 12:56:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:55.497 12:56:28 -- nvmf/common.sh@123 -- # set -e 00:28:55.497 12:56:28 -- nvmf/common.sh@124 -- # return 0 00:28:55.497 12:56:28 -- nvmf/common.sh@477 -- # '[' -n 3654549 ']' 00:28:55.497 12:56:28 -- nvmf/common.sh@478 -- # killprocess 3654549 00:28:55.497 12:56:28 -- common/autotest_common.sh@936 -- # '[' -z 3654549 ']' 00:28:55.497 12:56:28 -- common/autotest_common.sh@940 -- # kill -0 3654549 00:28:55.497 12:56:28 -- common/autotest_common.sh@941 -- # uname 00:28:55.497 12:56:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:55.497 12:56:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3654549 00:28:55.497 12:56:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:55.497 12:56:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:55.497 12:56:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3654549' 00:28:55.497 killing process with pid 3654549 00:28:55.497 12:56:28 -- common/autotest_common.sh@955 -- # kill 3654549 00:28:55.497 12:56:28 -- common/autotest_common.sh@960 -- # wait 3654549 00:28:55.755 12:56:28 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:28:55.755 12:56:28 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:28:57.129 Waiting for block devices as requested 00:28:57.129 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:28:57.129 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:57.129 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:57.129 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:57.387 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:57.387 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:57.387 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:57.387 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:57.645 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:57.645 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:57.645 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:57.645 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:57.903 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:57.903 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:57.903 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:57.903 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:58.162 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:58.162 12:56:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:58.162 12:56:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:58.162 12:56:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:58.162 12:56:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:58.162 12:56:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:58.162 12:56:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:58.162 12:56:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:00.697 12:56:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:00.697 00:29:00.697 real 1m8.278s 00:29:00.697 user 6m35.767s 00:29:00.697 sys 0m15.736s 00:29:00.697 12:56:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:00.697 12:56:33 -- common/autotest_common.sh@10 -- # set +x 00:29:00.697 ************************************ 00:29:00.697 END TEST nvmf_dif 00:29:00.697 ************************************ 00:29:00.697 12:56:33 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:00.697 12:56:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:00.697 12:56:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:00.697 12:56:33 -- common/autotest_common.sh@10 -- # set +x 00:29:00.697 ************************************ 00:29:00.697 START TEST nvmf_abort_qd_sizes 00:29:00.697 ************************************ 00:29:00.697 12:56:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:00.697 * Looking for test storage... 00:29:00.697 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:00.697 12:56:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:00.697 12:56:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:00.697 12:56:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:00.697 12:56:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:00.697 12:56:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:00.697 12:56:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:00.697 12:56:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:00.697 12:56:33 -- scripts/common.sh@335 -- # IFS=.-: 00:29:00.697 12:56:33 -- scripts/common.sh@335 -- # read -ra ver1 00:29:00.697 12:56:33 -- scripts/common.sh@336 -- # IFS=.-: 00:29:00.697 12:56:33 -- scripts/common.sh@336 -- # read -ra ver2 00:29:00.697 12:56:33 -- scripts/common.sh@337 -- # local 'op=<' 00:29:00.697 12:56:33 -- scripts/common.sh@339 -- # ver1_l=2 00:29:00.697 12:56:33 -- scripts/common.sh@340 -- # ver2_l=1 00:29:00.697 12:56:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:00.697 12:56:33 -- scripts/common.sh@343 -- # case "$op" in 00:29:00.697 12:56:33 -- scripts/common.sh@344 -- # : 1 00:29:00.697 12:56:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:00.697 12:56:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:00.697 12:56:33 -- scripts/common.sh@364 -- # decimal 1 00:29:00.697 12:56:33 -- scripts/common.sh@352 -- # local d=1 00:29:00.697 12:56:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:00.697 12:56:33 -- scripts/common.sh@354 -- # echo 1 00:29:00.697 12:56:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:00.697 12:56:33 -- scripts/common.sh@365 -- # decimal 2 00:29:00.697 12:56:33 -- scripts/common.sh@352 -- # local d=2 00:29:00.697 12:56:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:00.697 12:56:33 -- scripts/common.sh@354 -- # echo 2 00:29:00.697 12:56:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:00.697 12:56:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:00.697 12:56:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:00.697 12:56:33 -- scripts/common.sh@367 -- # return 0 00:29:00.697 12:56:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:00.697 12:56:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:00.697 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:00.697 --rc genhtml_branch_coverage=1 00:29:00.697 --rc genhtml_function_coverage=1 00:29:00.697 --rc genhtml_legend=1 00:29:00.697 --rc geninfo_all_blocks=1 00:29:00.697 --rc geninfo_unexecuted_blocks=1 00:29:00.697 00:29:00.697 ' 00:29:00.697 12:56:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:00.697 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:00.697 --rc genhtml_branch_coverage=1 00:29:00.697 --rc genhtml_function_coverage=1 00:29:00.697 --rc genhtml_legend=1 00:29:00.697 --rc geninfo_all_blocks=1 00:29:00.697 --rc geninfo_unexecuted_blocks=1 00:29:00.697 00:29:00.697 ' 00:29:00.697 12:56:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:00.697 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:00.697 --rc genhtml_branch_coverage=1 00:29:00.697 --rc genhtml_function_coverage=1 00:29:00.697 --rc genhtml_legend=1 00:29:00.697 --rc geninfo_all_blocks=1 00:29:00.697 --rc geninfo_unexecuted_blocks=1 00:29:00.697 00:29:00.697 ' 00:29:00.697 12:56:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:00.697 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:00.697 --rc genhtml_branch_coverage=1 00:29:00.697 --rc genhtml_function_coverage=1 00:29:00.697 --rc genhtml_legend=1 00:29:00.697 --rc geninfo_all_blocks=1 00:29:00.697 --rc geninfo_unexecuted_blocks=1 00:29:00.697 00:29:00.697 ' 00:29:00.697 12:56:33 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:00.697 12:56:33 -- nvmf/common.sh@7 -- # uname -s 00:29:00.697 12:56:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:00.697 12:56:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:00.697 12:56:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:00.697 12:56:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:00.697 12:56:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:00.697 12:56:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:00.697 12:56:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:00.697 12:56:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:00.697 12:56:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:00.697 12:56:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:00.697 12:56:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:00.697 12:56:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:00.697 12:56:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:00.697 12:56:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:00.697 12:56:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:00.697 12:56:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:00.697 12:56:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:00.697 12:56:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:00.697 12:56:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:00.697 12:56:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.697 12:56:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.698 12:56:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.698 12:56:33 -- paths/export.sh@5 -- # export PATH 00:29:00.698 12:56:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.698 12:56:33 -- nvmf/common.sh@46 -- # : 0 00:29:00.698 12:56:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:00.698 12:56:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:00.698 12:56:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:00.698 12:56:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:00.698 12:56:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:00.698 12:56:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:00.698 12:56:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:00.698 12:56:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:00.698 12:56:33 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:00.698 12:56:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:00.698 12:56:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:00.698 12:56:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:00.698 12:56:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:00.698 12:56:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:00.698 12:56:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:00.698 12:56:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:00.698 12:56:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:00.698 12:56:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:00.698 12:56:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:00.698 12:56:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:00.698 12:56:33 -- common/autotest_common.sh@10 -- # set +x 00:29:02.600 12:56:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:02.601 12:56:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:02.601 12:56:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:02.601 12:56:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:02.601 12:56:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:02.601 12:56:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:02.601 12:56:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:02.601 12:56:35 -- nvmf/common.sh@294 -- # net_devs=() 00:29:02.601 12:56:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:02.601 12:56:35 -- nvmf/common.sh@295 -- # e810=() 00:29:02.601 12:56:35 -- nvmf/common.sh@295 -- # local -ga e810 00:29:02.601 12:56:35 -- nvmf/common.sh@296 -- # x722=() 00:29:02.601 12:56:35 -- nvmf/common.sh@296 -- # local -ga x722 00:29:02.601 12:56:35 -- nvmf/common.sh@297 -- # mlx=() 00:29:02.601 12:56:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:02.601 12:56:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:02.601 12:56:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:02.601 12:56:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:02.601 12:56:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:02.601 12:56:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:02.601 12:56:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:02.601 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:02.601 12:56:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:02.601 12:56:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:02.601 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:02.601 12:56:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:02.601 12:56:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:02.601 12:56:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:02.601 12:56:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:02.601 12:56:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:02.601 12:56:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:02.601 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:02.601 12:56:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:02.601 12:56:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:02.601 12:56:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:02.601 12:56:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:02.601 12:56:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:02.601 12:56:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:02.601 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:02.601 12:56:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:02.601 12:56:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:02.601 12:56:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:02.601 12:56:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:02.601 12:56:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:02.601 12:56:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:02.601 12:56:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:02.601 12:56:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:02.601 12:56:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:02.601 12:56:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:02.601 12:56:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:02.601 12:56:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:02.601 12:56:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:02.601 12:56:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:02.601 12:56:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:02.601 12:56:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:02.601 12:56:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:02.601 12:56:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:02.601 12:56:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:02.601 12:56:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:02.601 12:56:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:02.601 12:56:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:02.601 12:56:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:02.601 12:56:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:02.601 12:56:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:02.601 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:02.601 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.308 ms 00:29:02.601 00:29:02.601 --- 10.0.0.2 ping statistics --- 00:29:02.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:02.601 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:29:02.601 12:56:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:02.601 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:02.601 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:29:02.601 00:29:02.601 --- 10.0.0.1 ping statistics --- 00:29:02.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:02.601 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:29:02.601 12:56:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:02.601 12:56:35 -- nvmf/common.sh@410 -- # return 0 00:29:02.601 12:56:35 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:02.601 12:56:35 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:03.536 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:03.795 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:03.795 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:04.731 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:04.731 12:56:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:04.731 12:56:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:04.731 12:56:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:04.731 12:56:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:04.731 12:56:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:04.731 12:56:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:04.731 12:56:37 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:04.731 12:56:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:04.731 12:56:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:04.731 12:56:37 -- common/autotest_common.sh@10 -- # set +x 00:29:04.731 12:56:37 -- nvmf/common.sh@469 -- # nvmfpid=3665926 00:29:04.731 12:56:37 -- nvmf/common.sh@470 -- # waitforlisten 3665926 00:29:04.731 12:56:37 -- common/autotest_common.sh@829 -- # '[' -z 3665926 ']' 00:29:04.731 12:56:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:04.731 12:56:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:04.731 12:56:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:04.731 12:56:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:04.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:04.731 12:56:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:04.731 12:56:37 -- common/autotest_common.sh@10 -- # set +x 00:29:04.989 [2024-11-20 12:56:37.874477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:04.989 [2024-11-20 12:56:37.874563] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:04.989 EAL: No free 2048 kB hugepages reported on node 1 00:29:04.989 [2024-11-20 12:56:37.942299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:04.989 [2024-11-20 12:56:38.062215] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:04.989 [2024-11-20 12:56:38.062371] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:04.989 [2024-11-20 12:56:38.062389] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:04.989 [2024-11-20 12:56:38.062402] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:04.989 [2024-11-20 12:56:38.062470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:04.989 [2024-11-20 12:56:38.062522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:04.989 [2024-11-20 12:56:38.062643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:04.989 [2024-11-20 12:56:38.062646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:05.922 12:56:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:05.922 12:56:38 -- common/autotest_common.sh@862 -- # return 0 00:29:05.922 12:56:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:05.922 12:56:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:05.922 12:56:38 -- common/autotest_common.sh@10 -- # set +x 00:29:05.922 12:56:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:05.922 12:56:38 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:05.922 12:56:38 -- scripts/common.sh@312 -- # local nvmes 00:29:05.922 12:56:38 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:05.922 12:56:38 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:05.922 12:56:38 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:05.922 12:56:38 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:05.922 12:56:38 -- scripts/common.sh@322 -- # uname -s 00:29:05.922 12:56:38 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:05.922 12:56:38 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:05.922 12:56:38 -- scripts/common.sh@327 -- # (( 1 )) 00:29:05.922 12:56:38 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:05.922 12:56:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:05.922 12:56:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:05.922 12:56:38 -- common/autotest_common.sh@10 -- # set +x 00:29:05.922 ************************************ 00:29:05.922 START TEST spdk_target_abort 00:29:05.922 ************************************ 00:29:05.922 12:56:38 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:05.922 12:56:38 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:05.922 12:56:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.922 12:56:38 -- common/autotest_common.sh@10 -- # set +x 00:29:09.200 spdk_targetn1 00:29:09.200 12:56:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:09.200 12:56:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.200 12:56:41 -- common/autotest_common.sh@10 -- # set +x 00:29:09.200 [2024-11-20 12:56:41.701253] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:09.200 12:56:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:09.200 12:56:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.200 12:56:41 -- common/autotest_common.sh@10 -- # set +x 00:29:09.200 12:56:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:09.200 12:56:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.200 12:56:41 -- common/autotest_common.sh@10 -- # set +x 00:29:09.200 12:56:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:09.200 12:56:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.200 12:56:41 -- common/autotest_common.sh@10 -- # set +x 00:29:09.200 [2024-11-20 12:56:41.733594] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:09.200 12:56:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:09.200 12:56:41 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:09.200 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.479 Initializing NVMe Controllers 00:29:12.479 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:12.479 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:12.479 Initialization complete. Launching workers. 00:29:12.479 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12572, failed: 0 00:29:12.479 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1215, failed to submit 11357 00:29:12.479 success 734, unsuccess 481, failed 0 00:29:12.479 12:56:44 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:12.479 12:56:44 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:12.479 EAL: No free 2048 kB hugepages reported on node 1 00:29:15.758 Initializing NVMe Controllers 00:29:15.758 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:15.758 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:15.758 Initialization complete. Launching workers. 00:29:15.758 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8592, failed: 0 00:29:15.758 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1224, failed to submit 7368 00:29:15.758 success 319, unsuccess 905, failed 0 00:29:15.758 12:56:48 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:15.758 12:56:48 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:15.758 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.036 Initializing NVMe Controllers 00:29:19.036 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:19.036 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:19.036 Initialization complete. Launching workers. 00:29:19.036 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31852, failed: 0 00:29:19.036 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2785, failed to submit 29067 00:29:19.036 success 559, unsuccess 2226, failed 0 00:29:19.036 12:56:51 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:19.036 12:56:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.036 12:56:51 -- common/autotest_common.sh@10 -- # set +x 00:29:19.036 12:56:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.036 12:56:51 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:19.036 12:56:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.036 12:56:51 -- common/autotest_common.sh@10 -- # set +x 00:29:19.968 12:56:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.968 12:56:52 -- target/abort_qd_sizes.sh@62 -- # killprocess 3665926 00:29:19.968 12:56:52 -- common/autotest_common.sh@936 -- # '[' -z 3665926 ']' 00:29:19.968 12:56:52 -- common/autotest_common.sh@940 -- # kill -0 3665926 00:29:19.968 12:56:52 -- common/autotest_common.sh@941 -- # uname 00:29:19.968 12:56:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:19.968 12:56:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3665926 00:29:19.968 12:56:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:19.968 12:56:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:19.968 12:56:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3665926' 00:29:19.968 killing process with pid 3665926 00:29:19.968 12:56:52 -- common/autotest_common.sh@955 -- # kill 3665926 00:29:19.968 12:56:52 -- common/autotest_common.sh@960 -- # wait 3665926 00:29:20.226 00:29:20.226 real 0m14.329s 00:29:20.226 user 0m56.704s 00:29:20.226 sys 0m2.568s 00:29:20.226 12:56:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:20.226 12:56:53 -- common/autotest_common.sh@10 -- # set +x 00:29:20.226 ************************************ 00:29:20.226 END TEST spdk_target_abort 00:29:20.226 ************************************ 00:29:20.226 12:56:53 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:20.226 12:56:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:20.226 12:56:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:20.226 12:56:53 -- common/autotest_common.sh@10 -- # set +x 00:29:20.226 ************************************ 00:29:20.226 START TEST kernel_target_abort 00:29:20.226 ************************************ 00:29:20.226 12:56:53 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:20.226 12:56:53 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:20.226 12:56:53 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:20.226 12:56:53 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:20.226 12:56:53 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:20.226 12:56:53 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:20.226 12:56:53 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:20.226 12:56:53 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:20.226 12:56:53 -- nvmf/common.sh@627 -- # local block nvme 00:29:20.226 12:56:53 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:20.226 12:56:53 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:20.226 12:56:53 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:20.226 12:56:53 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:21.161 Waiting for block devices as requested 00:29:21.420 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:21.420 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:21.679 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:21.679 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:21.679 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:21.679 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:21.939 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:21.939 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:21.939 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:21.939 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:22.197 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:22.197 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:22.197 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:22.197 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:22.454 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:22.455 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:22.455 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:22.713 12:56:55 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:22.713 12:56:55 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:22.713 12:56:55 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:22.713 12:56:55 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:22.713 12:56:55 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:22.713 No valid GPT data, bailing 00:29:22.713 12:56:55 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:22.713 12:56:55 -- scripts/common.sh@393 -- # pt= 00:29:22.713 12:56:55 -- scripts/common.sh@394 -- # return 1 00:29:22.713 12:56:55 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:22.713 12:56:55 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:22.713 12:56:55 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:22.713 12:56:55 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:22.713 12:56:55 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:22.713 12:56:55 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:22.713 12:56:55 -- nvmf/common.sh@654 -- # echo 1 00:29:22.713 12:56:55 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:22.713 12:56:55 -- nvmf/common.sh@656 -- # echo 1 00:29:22.713 12:56:55 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:22.713 12:56:55 -- nvmf/common.sh@663 -- # echo tcp 00:29:22.713 12:56:55 -- nvmf/common.sh@664 -- # echo 4420 00:29:22.713 12:56:55 -- nvmf/common.sh@665 -- # echo ipv4 00:29:22.713 12:56:55 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:22.713 12:56:55 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:22.713 00:29:22.713 Discovery Log Number of Records 2, Generation counter 2 00:29:22.713 =====Discovery Log Entry 0====== 00:29:22.713 trtype: tcp 00:29:22.713 adrfam: ipv4 00:29:22.713 subtype: current discovery subsystem 00:29:22.713 treq: not specified, sq flow control disable supported 00:29:22.713 portid: 1 00:29:22.713 trsvcid: 4420 00:29:22.713 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:22.713 traddr: 10.0.0.1 00:29:22.713 eflags: none 00:29:22.713 sectype: none 00:29:22.713 =====Discovery Log Entry 1====== 00:29:22.713 trtype: tcp 00:29:22.713 adrfam: ipv4 00:29:22.713 subtype: nvme subsystem 00:29:22.713 treq: not specified, sq flow control disable supported 00:29:22.713 portid: 1 00:29:22.713 trsvcid: 4420 00:29:22.713 subnqn: kernel_target 00:29:22.713 traddr: 10.0.0.1 00:29:22.713 eflags: none 00:29:22.713 sectype: none 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:22.713 12:56:55 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:22.713 EAL: No free 2048 kB hugepages reported on node 1 00:29:26.084 Initializing NVMe Controllers 00:29:26.084 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:26.084 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:26.084 Initialization complete. Launching workers. 00:29:26.084 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 42499, failed: 0 00:29:26.084 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 42499, failed to submit 0 00:29:26.084 success 0, unsuccess 42499, failed 0 00:29:26.084 12:56:58 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:26.084 12:56:58 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:26.084 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.363 Initializing NVMe Controllers 00:29:29.363 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:29.363 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:29.363 Initialization complete. Launching workers. 00:29:29.363 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 77794, failed: 0 00:29:29.363 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19614, failed to submit 58180 00:29:29.363 success 0, unsuccess 19614, failed 0 00:29:29.363 12:57:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:29.363 12:57:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:29.363 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.646 Initializing NVMe Controllers 00:29:32.646 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:32.646 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:32.646 Initialization complete. Launching workers. 00:29:32.646 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 75287, failed: 0 00:29:32.646 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18798, failed to submit 56489 00:29:32.646 success 0, unsuccess 18798, failed 0 00:29:32.646 12:57:05 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:32.646 12:57:05 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:32.646 12:57:05 -- nvmf/common.sh@677 -- # echo 0 00:29:32.646 12:57:05 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:32.646 12:57:05 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:32.646 12:57:05 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:32.646 12:57:05 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:32.646 12:57:05 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:32.646 12:57:05 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:32.646 00:29:32.646 real 0m11.948s 00:29:32.646 user 0m5.581s 00:29:32.646 sys 0m2.409s 00:29:32.646 12:57:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:32.646 12:57:05 -- common/autotest_common.sh@10 -- # set +x 00:29:32.646 ************************************ 00:29:32.646 END TEST kernel_target_abort 00:29:32.646 ************************************ 00:29:32.647 12:57:05 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:32.647 12:57:05 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:32.647 12:57:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:32.647 12:57:05 -- nvmf/common.sh@116 -- # sync 00:29:32.647 12:57:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:32.647 12:57:05 -- nvmf/common.sh@119 -- # set +e 00:29:32.647 12:57:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:32.647 12:57:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:32.647 rmmod nvme_tcp 00:29:32.647 rmmod nvme_fabrics 00:29:32.647 rmmod nvme_keyring 00:29:32.647 12:57:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:32.647 12:57:05 -- nvmf/common.sh@123 -- # set -e 00:29:32.647 12:57:05 -- nvmf/common.sh@124 -- # return 0 00:29:32.647 12:57:05 -- nvmf/common.sh@477 -- # '[' -n 3665926 ']' 00:29:32.647 12:57:05 -- nvmf/common.sh@478 -- # killprocess 3665926 00:29:32.647 12:57:05 -- common/autotest_common.sh@936 -- # '[' -z 3665926 ']' 00:29:32.647 12:57:05 -- common/autotest_common.sh@940 -- # kill -0 3665926 00:29:32.647 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3665926) - No such process 00:29:32.647 12:57:05 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3665926 is not found' 00:29:32.647 Process with pid 3665926 is not found 00:29:32.647 12:57:05 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:32.647 12:57:05 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:33.215 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:33.215 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:33.473 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:33.473 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:33.473 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:33.473 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:33.473 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:33.473 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:33.473 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:33.473 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:33.473 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:33.473 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:33.473 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:33.473 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:33.473 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:33.473 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:33.473 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:33.733 12:57:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:33.733 12:57:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:33.733 12:57:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:33.733 12:57:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:33.733 12:57:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:33.733 12:57:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:33.733 12:57:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:35.638 12:57:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:35.638 00:29:35.638 real 0m35.416s 00:29:35.638 user 1m4.635s 00:29:35.638 sys 0m8.391s 00:29:35.638 12:57:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:35.638 12:57:08 -- common/autotest_common.sh@10 -- # set +x 00:29:35.638 ************************************ 00:29:35.638 END TEST nvmf_abort_qd_sizes 00:29:35.638 ************************************ 00:29:35.638 12:57:08 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:35.638 12:57:08 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:29:35.638 12:57:08 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:29:35.638 12:57:08 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:29:35.638 12:57:08 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:29:35.638 12:57:08 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:29:35.638 12:57:08 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:29:35.638 12:57:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:35.638 12:57:08 -- common/autotest_common.sh@10 -- # set +x 00:29:35.638 12:57:08 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:29:35.638 12:57:08 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:29:35.638 12:57:08 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:29:35.638 12:57:08 -- common/autotest_common.sh@10 -- # set +x 00:29:37.544 INFO: APP EXITING 00:29:37.544 INFO: killing all VMs 00:29:37.544 INFO: killing vhost app 00:29:37.544 INFO: EXIT DONE 00:29:38.481 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:38.740 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:38.740 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:38.740 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:38.740 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:38.740 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:38.740 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:38.740 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:38.740 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:38.740 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:38.740 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:38.740 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:38.740 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:38.740 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:38.740 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:38.740 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:38.740 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:40.118 Cleaning 00:29:40.118 Removing: /var/run/dpdk/spdk0/config 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:29:40.118 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:29:40.118 Removing: /var/run/dpdk/spdk0/hugepage_info 00:29:40.118 Removing: /var/run/dpdk/spdk1/config 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:29:40.118 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:29:40.118 Removing: /var/run/dpdk/spdk1/hugepage_info 00:29:40.118 Removing: /var/run/dpdk/spdk1/mp_socket 00:29:40.118 Removing: /var/run/dpdk/spdk2/config 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:29:40.118 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:29:40.118 Removing: /var/run/dpdk/spdk2/hugepage_info 00:29:40.118 Removing: /var/run/dpdk/spdk3/config 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:29:40.118 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:29:40.118 Removing: /var/run/dpdk/spdk3/hugepage_info 00:29:40.118 Removing: /var/run/dpdk/spdk4/config 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:29:40.118 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:29:40.118 Removing: /var/run/dpdk/spdk4/hugepage_info 00:29:40.118 Removing: /dev/shm/bdev_svc_trace.1 00:29:40.118 Removing: /dev/shm/nvmf_trace.0 00:29:40.118 Removing: /dev/shm/spdk_tgt_trace.pid3396952 00:29:40.118 Removing: /var/run/dpdk/spdk0 00:29:40.118 Removing: /var/run/dpdk/spdk1 00:29:40.118 Removing: /var/run/dpdk/spdk2 00:29:40.118 Removing: /var/run/dpdk/spdk3 00:29:40.118 Removing: /var/run/dpdk/spdk4 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3395232 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3396000 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3396952 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3397455 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3398798 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3399748 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3400077 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3400410 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3400629 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3400961 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3401120 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3401274 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3401596 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3402059 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3404612 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3404909 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3405084 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3405226 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3405662 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3405802 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3406118 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3406254 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3406548 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3406613 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3406856 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3406994 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3407380 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3407535 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3407800 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408047 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408066 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408256 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408394 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408578 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408825 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3408981 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3409125 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3409405 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3409554 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3409709 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3409974 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3410137 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3410281 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3410556 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3410709 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3410865 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3411088 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3411292 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3411431 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3411642 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3411851 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3412017 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3412158 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3412436 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3412581 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3412745 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3413004 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3413167 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3413316 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3413663 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3413848 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3414012 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3414275 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3414436 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3414966 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3415374 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3415518 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3415680 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3415944 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3416107 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3416249 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3416535 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3416606 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3416911 00:29:40.118 Removing: /var/run/dpdk/spdk_pid3419171 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3476514 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3479172 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3486291 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3489651 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3492156 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3492570 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3497666 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3497949 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3500637 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3504533 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3506772 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3514020 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3519499 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3520799 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3521490 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3532269 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3534644 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3537488 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3538705 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3540078 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3540218 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3540492 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3540638 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3541236 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3542637 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3543630 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3544173 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3548320 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3551900 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3555552 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3579845 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3582703 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3586681 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3587777 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3588902 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3591613 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3594149 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3598546 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3598554 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3601496 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3601671 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3601903 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3602174 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3602183 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3603292 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3604633 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3605833 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3607174 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3608896 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3610111 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3614003 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3614463 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3615789 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3616542 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3620456 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3622505 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3626125 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3629879 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3633432 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3633973 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3634398 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3634820 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3635431 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3635981 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3636536 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3637206 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3640382 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3640654 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3644514 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3644704 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3646460 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3651647 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3651652 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3654727 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3656167 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3657606 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3658490 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3659945 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3660844 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3666370 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3666771 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3667174 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3668670 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3669068 00:29:40.377 Removing: /var/run/dpdk/spdk_pid3669592 00:29:40.377 Clean 00:29:40.377 killing process with pid 3366820 00:29:48.493 killing process with pid 3366817 00:29:48.493 killing process with pid 3366819 00:29:48.751 killing process with pid 3366818 00:29:48.751 12:57:21 -- common/autotest_common.sh@1446 -- # return 0 00:29:48.751 12:57:21 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:29:48.751 12:57:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:48.751 12:57:21 -- common/autotest_common.sh@10 -- # set +x 00:29:48.751 12:57:21 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:29:48.751 12:57:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:48.751 12:57:21 -- common/autotest_common.sh@10 -- # set +x 00:29:48.751 12:57:21 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:29:48.751 12:57:21 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:29:48.751 12:57:21 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:29:48.751 12:57:21 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:29:48.751 12:57:21 -- spdk/autotest.sh@383 -- # hostname 00:29:48.751 12:57:21 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:29:49.010 geninfo: WARNING: invalid characters removed from testname! 00:30:15.575 12:57:48 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:18.856 12:57:51 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:21.395 12:57:54 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:23.965 12:57:56 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:26.508 12:57:59 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:29.806 12:58:02 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:31.715 12:58:04 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:31.973 12:58:04 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:30:31.973 12:58:04 -- common/autotest_common.sh@1690 -- $ lcov --version 00:30:31.973 12:58:04 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:30:31.973 12:58:04 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:30:31.973 12:58:04 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:30:31.973 12:58:04 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:30:31.973 12:58:04 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:30:31.974 12:58:04 -- scripts/common.sh@335 -- $ IFS=.-: 00:30:31.974 12:58:04 -- scripts/common.sh@335 -- $ read -ra ver1 00:30:31.974 12:58:04 -- scripts/common.sh@336 -- $ IFS=.-: 00:30:31.974 12:58:04 -- scripts/common.sh@336 -- $ read -ra ver2 00:30:31.974 12:58:04 -- scripts/common.sh@337 -- $ local 'op=<' 00:30:31.974 12:58:04 -- scripts/common.sh@339 -- $ ver1_l=2 00:30:31.974 12:58:04 -- scripts/common.sh@340 -- $ ver2_l=1 00:30:31.974 12:58:04 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:30:31.974 12:58:04 -- scripts/common.sh@343 -- $ case "$op" in 00:30:31.974 12:58:04 -- scripts/common.sh@344 -- $ : 1 00:30:31.974 12:58:04 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:30:31.974 12:58:04 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:31.974 12:58:04 -- scripts/common.sh@364 -- $ decimal 1 00:30:31.974 12:58:04 -- scripts/common.sh@352 -- $ local d=1 00:30:31.974 12:58:04 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:30:31.974 12:58:04 -- scripts/common.sh@354 -- $ echo 1 00:30:31.974 12:58:04 -- scripts/common.sh@364 -- $ ver1[v]=1 00:30:31.974 12:58:04 -- scripts/common.sh@365 -- $ decimal 2 00:30:31.974 12:58:04 -- scripts/common.sh@352 -- $ local d=2 00:30:31.974 12:58:04 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:30:31.974 12:58:04 -- scripts/common.sh@354 -- $ echo 2 00:30:31.974 12:58:04 -- scripts/common.sh@365 -- $ ver2[v]=2 00:30:31.974 12:58:04 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:30:31.974 12:58:04 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:30:31.974 12:58:04 -- scripts/common.sh@367 -- $ return 0 00:30:31.974 12:58:04 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:31.974 12:58:04 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:30:31.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.974 --rc genhtml_branch_coverage=1 00:30:31.974 --rc genhtml_function_coverage=1 00:30:31.974 --rc genhtml_legend=1 00:30:31.974 --rc geninfo_all_blocks=1 00:30:31.974 --rc geninfo_unexecuted_blocks=1 00:30:31.974 00:30:31.974 ' 00:30:31.974 12:58:04 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:30:31.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.974 --rc genhtml_branch_coverage=1 00:30:31.974 --rc genhtml_function_coverage=1 00:30:31.974 --rc genhtml_legend=1 00:30:31.974 --rc geninfo_all_blocks=1 00:30:31.974 --rc geninfo_unexecuted_blocks=1 00:30:31.974 00:30:31.974 ' 00:30:31.974 12:58:04 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:30:31.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.974 --rc genhtml_branch_coverage=1 00:30:31.974 --rc genhtml_function_coverage=1 00:30:31.974 --rc genhtml_legend=1 00:30:31.974 --rc geninfo_all_blocks=1 00:30:31.974 --rc geninfo_unexecuted_blocks=1 00:30:31.974 00:30:31.974 ' 00:30:31.974 12:58:04 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:30:31.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:31.974 --rc genhtml_branch_coverage=1 00:30:31.974 --rc genhtml_function_coverage=1 00:30:31.974 --rc genhtml_legend=1 00:30:31.974 --rc geninfo_all_blocks=1 00:30:31.974 --rc geninfo_unexecuted_blocks=1 00:30:31.974 00:30:31.974 ' 00:30:31.974 12:58:04 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:31.974 12:58:04 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:31.974 12:58:04 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:31.974 12:58:04 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:31.974 12:58:04 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.974 12:58:04 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.974 12:58:04 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.974 12:58:04 -- paths/export.sh@5 -- $ export PATH 00:30:31.974 12:58:04 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:31.974 12:58:04 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:31.974 12:58:04 -- common/autobuild_common.sh@440 -- $ date +%s 00:30:31.974 12:58:04 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732103884.XXXXXX 00:30:31.974 12:58:04 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732103884.KdNO3x 00:30:31.974 12:58:04 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:30:31.974 12:58:04 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:30:31.974 12:58:04 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:31.974 12:58:04 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:31.974 12:58:04 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:31.974 12:58:04 -- common/autobuild_common.sh@456 -- $ get_config_params 00:30:31.974 12:58:04 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:30:31.974 12:58:04 -- common/autotest_common.sh@10 -- $ set +x 00:30:31.974 12:58:04 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:31.974 12:58:04 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:31.974 12:58:04 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:31.974 12:58:04 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:31.974 12:58:04 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:31.974 12:58:04 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:31.974 12:58:04 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:31.974 12:58:04 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:31.974 12:58:04 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:31.974 12:58:04 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:31.974 12:58:04 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:31.974 + [[ -n 3324492 ]] 00:30:31.974 + sudo kill 3324492 00:30:31.982 [Pipeline] } 00:30:31.999 [Pipeline] // stage 00:30:32.005 [Pipeline] } 00:30:32.021 [Pipeline] // timeout 00:30:32.026 [Pipeline] } 00:30:32.041 [Pipeline] // catchError 00:30:32.048 [Pipeline] } 00:30:32.063 [Pipeline] // wrap 00:30:32.070 [Pipeline] } 00:30:32.084 [Pipeline] // catchError 00:30:32.093 [Pipeline] stage 00:30:32.095 [Pipeline] { (Epilogue) 00:30:32.107 [Pipeline] catchError 00:30:32.108 [Pipeline] { 00:30:32.120 [Pipeline] echo 00:30:32.121 Cleanup processes 00:30:32.127 [Pipeline] sh 00:30:32.412 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:32.412 3682050 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:32.427 [Pipeline] sh 00:30:32.712 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:32.712 ++ grep -v 'sudo pgrep' 00:30:32.712 ++ awk '{print $1}' 00:30:32.712 + sudo kill -9 00:30:32.712 + true 00:30:32.726 [Pipeline] sh 00:30:33.012 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:30:41.152 [Pipeline] sh 00:30:41.438 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:30:41.438 Artifacts sizes are good 00:30:41.452 [Pipeline] archiveArtifacts 00:30:41.459 Archiving artifacts 00:30:41.642 [Pipeline] sh 00:30:41.926 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:30:41.940 [Pipeline] cleanWs 00:30:41.949 [WS-CLEANUP] Deleting project workspace... 00:30:41.949 [WS-CLEANUP] Deferred wipeout is used... 00:30:41.956 [WS-CLEANUP] done 00:30:41.957 [Pipeline] } 00:30:41.973 [Pipeline] // catchError 00:30:41.983 [Pipeline] sh 00:30:42.262 + logger -p user.info -t JENKINS-CI 00:30:42.271 [Pipeline] } 00:30:42.284 [Pipeline] // stage 00:30:42.289 [Pipeline] } 00:30:42.303 [Pipeline] // node 00:30:42.308 [Pipeline] End of Pipeline 00:30:42.342 Finished: SUCCESS